Max level shown:
12024-11-02T06:30:01.380ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:45040
22024-11-02T06:30:01.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45040 req_id = 4829953f-2d1f-41b9-a022-2390bc9d3151 roles = RoleSet { roles: {} } uri = /metrics/producers
32024-11-02T06:30:01.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45040 req_id = 4829953f-2d1f-41b9-a022-2390bc9d3151 resource = Database result = Ok(()) uri = /metrics/producers
42024-11-02T06:30:01.395ZINFOnexus: assigned collector to new producer collector_id = 13175a5b-eed9-4b10-bbf4-9e75d4d6ef03 file = nexus/src/app/oximeter.rs:76 producer_id = e910c408-e8f8-499f-81a3-43816eb138fc
52024-11-02T06:30:01.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 15177 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45040 req_id = 4829953f-2d1f-41b9-a022-2390bc9d3151 response_code = 201 uri = /metrics/producers
62024-11-02T06:30:01.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 73552b44-cb6d-4086-b436-5f8d9e21df95 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
72024-11-02T06:30:01.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 73552b44-cb6d-4086-b436-5f8d9e21df95 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
82024-11-02T06:30:01.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 73552b44-cb6d-4086-b436-5f8d9e21df95 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
92024-11-02T06:30:02.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 6c3d5f55-4acd-4944-9e34-9dc595eeca06 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
102024-11-02T06:30:02.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 6c3d5f55-4acd-4944-9e34-9dc595eeca06 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
112024-11-02T06:30:02.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 6c3d5f55-4acd-4944-9e34-9dc595eeca06 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
122024-11-02T06:30:03.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 18e82b5f-9d43-4b47-89d2-f4b68e913924 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
132024-11-02T06:30:03.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 18e82b5f-9d43-4b47-89d2-f4b68e913924 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
142024-11-02T06:30:03.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 18e82b5f-9d43-4b47-89d2-f4b68e913924 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
152024-11-02T06:30:04.399ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1547 local_addr = [fd00:1122:3344:101::c]:45423 method = GET remote_addr = [fd00:1122:3344:101::d]:54698 req_id = 263a8bfa-3ecf-4c22-85a1-dc5a39201871 response_code = 200 uri = /0b0286d1-4696-4dd6-a80e-495d344ae645
162024-11-02T06:30:04.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f2e9561c-4a17-4229-92e8-87c96a0a1264 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
172024-11-02T06:30:04.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f2e9561c-4a17-4229-92e8-87c96a0a1264 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
182024-11-02T06:30:04.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f2e9561c-4a17-4229-92e8-87c96a0a1264 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
192024-11-02T06:30:05.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b6e0227a-171e-4134-82d6-95d1cc368de6 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
202024-11-02T06:30:05.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b6e0227a-171e-4134-82d6-95d1cc368de6 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
212024-11-02T06:30:05.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b6e0227a-171e-4134-82d6-95d1cc368de6 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
222024-11-02T06:30:06.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ff6b915a-c450-43b0-9c8c-26ee24d31f77 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
232024-11-02T06:30:06.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ff6b915a-c450-43b0-9c8c-26ee24d31f77 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
242024-11-02T06:30:06.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ff6b915a-c450-43b0-9c8c-26ee24d31f77 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
252024-11-02T06:30:07.324ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:61007
262024-11-02T06:30:07.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61007 req_id = 26bedc32-5ead-442b-9cea-edcaa0313c29 roles = RoleSet { roles: {} } uri = /metrics/producers
272024-11-02T06:30:07.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61007 req_id = 26bedc32-5ead-442b-9cea-edcaa0313c29 resource = Database result = Ok(()) uri = /metrics/producers
282024-11-02T06:30:07.361ZINFOnexus: assigned collector to new producer collector_id = 13175a5b-eed9-4b10-bbf4-9e75d4d6ef03 file = nexus/src/app/oximeter.rs:76 producer_id = 7ec6024f-066f-429f-b518-73983b940c39
292024-11-02T06:30:07.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36367 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61007 req_id = 26bedc32-5ead-442b-9cea-edcaa0313c29 response_code = 201 uri = /metrics/producers
302024-11-02T06:30:07.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 93e93036-de4f-4b2a-98d8-df145e24eebd roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
312024-11-02T06:30:07.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 93e93036-de4f-4b2a-98d8-df145e24eebd resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
322024-11-02T06:30:07.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 93e93036-de4f-4b2a-98d8-df145e24eebd response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
332024-11-02T06:30:07.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
342024-11-02T06:30:07.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
352024-11-02T06:30:07.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
362024-11-02T06:30:07.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
372024-11-02T06:30:07.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
382024-11-02T06:30:07.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
392024-11-02T06:30:07.947ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
402024-11-02T06:30:07.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
412024-11-02T06:30:07.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
422024-11-02T06:30:07.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
432024-11-02T06:30:07.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
442024-11-02T06:30:07.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
452024-11-02T06:30:07.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
462024-11-02T06:30:07.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
472024-11-02T06:30:07.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
482024-11-02T06:30:07.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
492024-11-02T06:30:07.966ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
502024-11-02T06:30:07.966ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.839346ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
512024-11-02T06:30:07.972ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
522024-11-02T06:30:07.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
532024-11-02T06:30:07.999ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.985691ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
542024-11-02T06:30:08.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fe6ec3dc-8161-4d67-b7b2-163a49074ee5 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
552024-11-02T06:30:08.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fe6ec3dc-8161-4d67-b7b2-163a49074ee5 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
562024-11-02T06:30:08.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fe6ec3dc-8161-4d67-b7b2-163a49074ee5 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
572024-11-02T06:30:09.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 7a4a521b-4d6f-44f4-a06c-93ef32dc2c04 roles = RoleSet { roles: {} } uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
582024-11-02T06:30:09.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 7a4a521b-4d6f-44f4-a06c-93ef32dc2c04 resource = Database result = Ok(()) uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
592024-11-02T06:30:09.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 7a4a521b-4d6f-44f4-a06c-93ef32dc2c04 response_code = 200 uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
602024-11-02T06:30:09.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 51ba2fdc-0c40-4234-a650-d5ba42d8e608 roles = RoleSet { roles: {} } uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
612024-11-02T06:30:09.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 51ba2fdc-0c40-4234-a650-d5ba42d8e608 resource = Database result = Ok(()) uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
622024-11-02T06:30:09.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 51ba2fdc-0c40-4234-a650-d5ba42d8e608 response_code = 200 uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
632024-11-02T06:30:09.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 78b0668a-0ae9-41c7-bc50-b648b9fd7acb roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
642024-11-02T06:30:09.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 78b0668a-0ae9-41c7-bc50-b648b9fd7acb resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
652024-11-02T06:30:09.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 78b0668a-0ae9-41c7-bc50-b648b9fd7acb response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
662024-11-02T06:30:10.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 177046ab-1e6c-424f-8f5f-3ab931a7291a roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
672024-11-02T06:30:10.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 177046ab-1e6c-424f-8f5f-3ab931a7291a resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
682024-11-02T06:30:10.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2519 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 177046ab-1e6c-424f-8f5f-3ab931a7291a response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
692024-11-02T06:30:11.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5f07fffd-94aa-4837-99e1-c632d35e4c26 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
702024-11-02T06:30:11.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5f07fffd-94aa-4837-99e1-c632d35e4c26 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
712024-11-02T06:30:11.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5f07fffd-94aa-4837-99e1-c632d35e4c26 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
722024-11-02T06:30:12.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = dd8d49ab-d5d6-4261-9b5a-3520651d5057 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
732024-11-02T06:30:12.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = dd8d49ab-d5d6-4261-9b5a-3520651d5057 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
742024-11-02T06:30:12.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = dd8d49ab-d5d6-4261-9b5a-3520651d5057 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
752024-11-02T06:30:13.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7ed624e4-25e3-46ad-bfd7-36719ba3798b roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
762024-11-02T06:30:13.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7ed624e4-25e3-46ad-bfd7-36719ba3798b resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
772024-11-02T06:30:13.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7ed624e4-25e3-46ad-bfd7-36719ba3798b response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
782024-11-02T06:30:14.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d644e17d-e4fc-44b2-ab34-76cf5b45beeb roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
792024-11-02T06:30:14.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d644e17d-e4fc-44b2-ab34-76cf5b45beeb resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
802024-11-02T06:30:14.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d644e17d-e4fc-44b2-ab34-76cf5b45beeb response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
812024-11-02T06:30:15.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = be672c20-6099-4d8b-8098-0f78a1aac11e roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
822024-11-02T06:30:15.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = be672c20-6099-4d8b-8098-0f78a1aac11e resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
832024-11-02T06:30:15.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = be672c20-6099-4d8b-8098-0f78a1aac11e response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
842024-11-02T06:30:16.314ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
852024-11-02T06:30:16.314ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
862024-11-02T06:30:16.345ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
872024-11-02T06:30:16.345ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:42733
882024-11-02T06:30:16.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42733 req_id = 1a737f27-9733-4f2b-80c2-9786546c5e8f roles = RoleSet { roles: {} } uri = /metrics/producers
892024-11-02T06:30:16.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42733 req_id = 1a737f27-9733-4f2b-80c2-9786546c5e8f resource = Database result = Ok(()) uri = /metrics/producers
902024-11-02T06:30:16.354ZINFOnexus: assigned collector to new producer collector_id = 13175a5b-eed9-4b10-bbf4-9e75d4d6ef03 file = nexus/src/app/oximeter.rs:76 producer_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
912024-11-02T06:30:16.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8784 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42733 req_id = 1a737f27-9733-4f2b-80c2-9786546c5e8f response_code = 201 uri = /metrics/producers
922024-11-02T06:30:16.354ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "1a737f27-9733-4f2b-80c2-9786546c5e8f", "content-length": "41", "date": "Sat, 02 Nov 2024 06:30:16 GMT"} })
932024-11-02T06:30:16.355ZDEBGnexus (producer-registration-task): registered with nexus successfully
942024-11-02T06:30:16.355ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
952024-11-02T06:30:16.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 81a2343e-95c7-4de1-8ba3-6e586563c602 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
962024-11-02T06:30:16.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 81a2343e-95c7-4de1-8ba3-6e586563c602 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
972024-11-02T06:30:16.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 81a2343e-95c7-4de1-8ba3-6e586563c602 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
982024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
992024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
1002024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1012024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
1022024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
1032024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
1042024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1052024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1062024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
1072024-11-02T06:30:17.945ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1082024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1092024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
1102024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1112024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1122024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
1132024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1142024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
1152024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
1162024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1172024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
1182024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1192024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1202024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1212024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
1222024-11-02T06:30:17.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1232024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
1242024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1252024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
1262024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.631\u{b5}s iteration = 22 status = {"errors":[],"records_set_to_done":[]}
1272024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
1282024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
1292024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.52\u{b5}s iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
1302024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 10.23\u{b5}s iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
1312024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
1322024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.12\u{b5}s iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
1332024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1342024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1352024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1362024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1372024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1382024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1392024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1402024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1412024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1422024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1432024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1442024-11-02T06:30:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1452024-11-02T06:30:17.948ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1462024-11-02T06:30:17.949ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1472024-11-02T06:30:17.949ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5394, tv_nsec: 538595179 } })
1482024-11-02T06:30:17.949ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
1492024-11-02T06:30:17.949ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.830891ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1502024-11-02T06:30:17.951ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5394, tv_nsec: 541069045 } })
1512024-11-02T06:30:17.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1522024-11-02T06:30:17.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1532024-11-02T06:30:17.951ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1542024-11-02T06:30:17.951ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1552024-11-02T06:30:17.951ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
1562024-11-02T06:30:17.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1572024-11-02T06:30:17.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1582024-11-02T06:30:17.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1592024-11-02T06:30:17.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1602024-11-02T06:30:17.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1612024-11-02T06:30:17.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1622024-11-02T06:30:17.963ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1632024-11-02T06:30:17.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1642024-11-02T06:30:17.967ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1652024-11-02T06:30:17.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1662024-11-02T06:30:17.969ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1672024-11-02T06:30:17.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1682024-11-02T06:30:17.972ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1692024-11-02T06:30:17.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1702024-11-02T06:30:17.993ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1712024-11-02T06:30:17.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1722024-11-02T06:30:17.997ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1732024-11-02T06:30:17.997ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1742024-11-02T06:30:17.997ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1752024-11-02T06:30:17.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1762024-11-02T06:30:17.998ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1772024-11-02T06:30:18.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1782024-11-02T06:30:18.001ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1792024-11-02T06:30:18.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1802024-11-02T06:30:18.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1812024-11-02T06:30:18.004ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1822024-11-02T06:30:18.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1832024-11-02T06:30:18.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1842024-11-02T06:30:18.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1852024-11-02T06:30:18.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1862024-11-02T06:30:18.006ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1872024-11-02T06:30:18.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1882024-11-02T06:30:18.007ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1892024-11-02T06:30:18.007ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.946719ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1902024-11-02T06:30:18.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1912024-11-02T06:30:18.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.944716ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1922024-11-02T06:30:18.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
1932024-11-02T06:30:18.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1942024-11-02T06:30:18.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1952024-11-02T06:30:18.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0e3a18b0-6ba3-492b-bc45-d7a745036378 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
1962024-11-02T06:30:18.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0e3a18b0-6ba3-492b-bc45-d7a745036378 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
1972024-11-02T06:30:18.017ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1982024-11-02T06:30:18.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0e3a18b0-6ba3-492b-bc45-d7a745036378 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
1992024-11-02T06:30:18.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2002024-11-02T06:30:18.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2012024-11-02T06:30:18.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2022024-11-02T06:30:18.022ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5394, tv_nsec: 612220425 } })
2032024-11-02T06:30:18.023ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
2042024-11-02T06:30:18.024ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
2052024-11-02T06:30:18.024ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.609639ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
2062024-11-02T06:30:18.030ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
2072024-11-02T06:30:18.030ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2082024-11-02T06:30:18.030ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "61d3ab44-c471-4280-acad-5b5c4d4b624f", "content-length": "26", "date": "Sat, 02 Nov 2024 06:30:18 GMT"} })
2092024-11-02T06:30:18.030ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2102024-11-02T06:30:18.032ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2112024-11-02T06:30:18.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2122024-11-02T06:30:18.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2132024-11-02T06:30:18.037ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
2142024-11-02T06:30:18.037ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2152024-11-02T06:30:18.037ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f086f91b-aac9-4db5-8157-d4bebab6e395", "content-length": "26", "date": "Sat, 02 Nov 2024 06:30:18 GMT"} })
2162024-11-02T06:30:18.037ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2172024-11-02T06:30:18.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2182024-11-02T06:30:18.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2192024-11-02T06:30:18.039ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2202024-11-02T06:30:18.039ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 93.518975ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2212024-11-02T06:30:18.048ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2222024-11-02T06:30:18.048ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2232024-11-02T06:30:18.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2242024-11-02T06:30:18.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2252024-11-02T06:30:18.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2262024-11-02T06:30:18.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2272024-11-02T06:30:18.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2282024-11-02T06:30:18.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2292024-11-02T06:30:18.069ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2302024-11-02T06:30:18.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e910c408-e8f8-499f-81a3-43816eb138fc, lookup_type: ById(e910c408-e8f8-499f-81a3-43816eb138fc) } result = Ok(())
2312024-11-02T06:30:18.076ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2322024-11-02T06:30:18.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2332024-11-02T06:30:18.079ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 134.049927ms iteration = 22 status = 0
2342024-11-02T06:30:18.082ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2352024-11-02T06:30:18.082ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2362024-11-02T06:30:18.082ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.666766ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2372024-11-02T06:30:18.089ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2382024-11-02T06:30:18.089ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 144.009202ms iteration = 26 status = {"physical_disks_added":0}
2392024-11-02T06:30:18.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2402024-11-02T06:30:18.119ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 zone_address = fd00:1122:3344:101::2
2412024-11-02T06:30:18.119ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2422024-11-02T06:30:18.119ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bb20b01-99f7-43b2-9e47-9f28fd24822c", "content-length": "26", "date": "Sat, 02 Nov 2024 06:30:18 GMT"} })
2432024-11-02T06:30:18.119ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2442024-11-02T06:30:18.121ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
2452024-11-02T06:30:18.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2462024-11-02T06:30:18.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2472024-11-02T06:30:18.215ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2482024-11-02T06:30:18.217ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2492024-11-02T06:30:18.217ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2502024-11-02T06:30:18.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2512024-11-02T06:30:18.227ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 281.290429ms iteration = 22 status = {}
2522024-11-02T06:30:18.240ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2532024-11-02T06:30:18.240ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "94c4c949-7c52-4e94-b62b-f0c13a0aebde", "content-length": "1", "date": "Sat, 02 Nov 2024 06:30:17 GMT"} })
2542024-11-02T06:30:18.242ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2552024-11-02T06:30:18.242ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2562024-11-02T06:30:18.242ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2572024-11-02T06:30:18.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2582024-11-02T06:30:18.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2592024-11-02T06:30:18.244ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 299.230032ms iteration = 22 status = null
2602024-11-02T06:30:18.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2612024-11-02T06:30:18.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2622024-11-02T06:30:18.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2632024-11-02T06:30:18.299ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2642024-11-02T06:30:18.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2652024-11-02T06:30:18.301ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 29c3f6a1-2034-455b-bc3b-3fbebec1d7c1, rack_id: a9cb4975-e69e-4875-af6f-759c07abd8a8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(72902c82-00a8-446a-b727-41c9c8c92f9b) } rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0
2662024-11-02T06:30:18.301ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2672024-11-02T06:30:18.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2682024-11-02T06:30:18.311ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2692024-11-02T06:30:18.311ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c88ea854-db71-4324-bc3f-e8028c62cd54", "content-length": "134", "date": "Sat, 02 Nov 2024 06:30:17 GMT"} })
2702024-11-02T06:30:18.311ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2712024-11-02T06:30:18.312ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 72902c82-00a8-446a-b727-41c9c8c92f9b
2722024-11-02T06:30:18.312ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2732024-11-02T06:30:18.312ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2742024-11-02T06:30:18.312ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2752024-11-02T06:30:18.312ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2762024-11-02T06:30:18.312ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2772024-11-02T06:30:18.312ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2782024-11-02T06:30:18.312ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2792024-11-02T06:30:18.312ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2802024-11-02T06:30:18.312ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
2812024-11-02T06:30:18.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2822024-11-02T06:30:18.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2832024-11-02T06:30:18.332ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2842024-11-02T06:30:18.334ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
2852024-11-02T06:30:18.334ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8159d428-3912-4a2e-af44-f80d2f0b01e2", "content-length": "2", "date": "Sat, 02 Nov 2024 06:30:17 GMT"} })
2862024-11-02T06:30:18.334ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
2872024-11-02T06:30:18.334ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f87b9f9-7b21-4602-b7f3-dcc07d78b4fb", "content-length": "52", "date": "Sat, 02 Nov 2024 06:30:17 GMT"} })
2882024-11-02T06:30:18.334ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0
2892024-11-02T06:30:18.334ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2902024-11-02T06:30:18.342ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9ae341c-20d4-4a49-ad86-4aafa72aaf27", "content-length": "372", "date": "Sat, 02 Nov 2024 06:30:18 GMT"} })
2912024-11-02T06:30:18.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2922024-11-02T06:30:18.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2932024-11-02T06:30:18.343ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9c3d452-60c7-4a3d-85a4-8dc55080f72c", "content-length": "691", "date": "Sat, 02 Nov 2024 06:30:18 GMT"} })
2942024-11-02T06:30:18.343ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
2952024-11-02T06:30:18.343ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
2962024-11-02T06:30:18.343ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
2972024-11-02T06:30:18.344ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 398.650197ms iteration = 22 status = {}
2982024-11-02T06:30:18.357ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
2992024-11-02T06:30:18.357ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3002024-11-02T06:30:18.358ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f14896b5-fe56-44ed-90c5-aa1f9b68e329", "date": "Sat, 02 Nov 2024 06:30:18 GMT"} })
3012024-11-02T06:30:18.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3022024-11-02T06:30:18.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3032024-11-02T06:30:18.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3042024-11-02T06:30:18.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3052024-11-02T06:30:18.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3062024-11-02T06:30:18.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3072024-11-02T06:30:18.366ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3082024-11-02T06:30:18.366ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3092024-11-02T06:30:18.369ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "669b67d3-ae2a-4606-8a03-b46ddb6d748b", "date": "Sat, 02 Nov 2024 06:30:18 GMT"} })
3102024-11-02T06:30:18.371ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 425.486955ms iteration = 23 status = {}
3112024-11-02T06:30:18.439ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1ed14371-5c06-40ef-a81a-4a32f3bbf73f", "date": "Sat, 02 Nov 2024 06:30:17 GMT"} })
3122024-11-02T06:30:18.439ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch = Switch0
3132024-11-02T06:30:18.439ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3142024-11-02T06:30:18.439ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e52ca2a5-f9a7-4d7b-a6d5-690e168553c6", "content-length": "682", "date": "Sat, 02 Nov 2024 06:30:18 GMT"} })
3152024-11-02T06:30:18.439ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3162024-11-02T06:30:18.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3172024-11-02T06:30:18.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3182024-11-02T06:30:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3192024-11-02T06:30:18.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3202024-11-02T06:30:18.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3212024-11-02T06:30:18.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3222024-11-02T06:30:18.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3232024-11-02T06:30:18.455ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 509.8522ms iteration = 22 status = {}
3242024-11-02T06:30:19.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 44afb99b-9777-4853-bf8d-b0721220bbaa roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3252024-11-02T06:30:19.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 44afb99b-9777-4853-bf8d-b0721220bbaa resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3262024-11-02T06:30:19.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 44afb99b-9777-4853-bf8d-b0721220bbaa response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3272024-11-02T06:30:19.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = eb9c3552-2801-4dda-a54d-e0fd2d4f4711 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
3282024-11-02T06:30:19.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = eb9c3552-2801-4dda-a54d-e0fd2d4f4711 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
3292024-11-02T06:30:19.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = eb9c3552-2801-4dda-a54d-e0fd2d4f4711 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
3302024-11-02T06:30:19.399ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1596 local_addr = [fd00:1122:3344:101::c]:45423 method = GET remote_addr = [fd00:1122:3344:101::d]:54698 req_id = 1281290a-457f-4dd8-bae9-f9dae28f1537 response_code = 200 uri = /0b0286d1-4696-4dd6-a80e-495d344ae645
3312024-11-02T06:30:20.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 81f59fa8-4109-4c2d-8345-e928ea169199 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3322024-11-02T06:30:20.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 81f59fa8-4109-4c2d-8345-e928ea169199 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3332024-11-02T06:30:20.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 81f59fa8-4109-4c2d-8345-e928ea169199 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3342024-11-02T06:30:21.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 506609d5-d37e-414c-8d4e-e612d5162538 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3352024-11-02T06:30:21.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 506609d5-d37e-414c-8d4e-e612d5162538 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3362024-11-02T06:30:21.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 506609d5-d37e-414c-8d4e-e612d5162538 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3372024-11-02T06:30:22.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9c2923f4-7821-4a9b-b1c5-78058f080a84 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3382024-11-02T06:30:22.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9c2923f4-7821-4a9b-b1c5-78058f080a84 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3392024-11-02T06:30:22.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9c2923f4-7821-4a9b-b1c5-78058f080a84 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3402024-11-02T06:30:23.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a520d84c-c2e3-458e-9546-93d94dcad311 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3412024-11-02T06:30:23.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a520d84c-c2e3-458e-9546-93d94dcad311 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3422024-11-02T06:30:23.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a520d84c-c2e3-458e-9546-93d94dcad311 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3432024-11-02T06:30:24.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5ef64c68-6129-4eec-864a-826c5c895775 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3442024-11-02T06:30:24.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5ef64c68-6129-4eec-864a-826c5c895775 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3452024-11-02T06:30:24.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5ef64c68-6129-4eec-864a-826c5c895775 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3462024-11-02T06:30:25.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f5adc3f5-b9a4-4eab-8ebf-6942a199110c roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3472024-11-02T06:30:25.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f5adc3f5-b9a4-4eab-8ebf-6942a199110c resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3482024-11-02T06:30:25.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f5adc3f5-b9a4-4eab-8ebf-6942a199110c response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3492024-11-02T06:30:26.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 19ef4342-373c-4191-bb39-4288ee09e8de roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3502024-11-02T06:30:26.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 19ef4342-373c-4191-bb39-4288ee09e8de resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3512024-11-02T06:30:26.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 19ef4342-373c-4191-bb39-4288ee09e8de response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3522024-11-02T06:30:27.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9cc73bd0-5d0c-4976-9f5c-d2b5b8bc9083 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3532024-11-02T06:30:27.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9cc73bd0-5d0c-4976-9f5c-d2b5b8bc9083 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3542024-11-02T06:30:27.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9cc73bd0-5d0c-4976-9f5c-d2b5b8bc9083 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3552024-11-02T06:30:27.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
3562024-11-02T06:30:27.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
3572024-11-02T06:30:27.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3582024-11-02T06:30:27.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3592024-11-02T06:30:27.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3602024-11-02T06:30:27.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3612024-11-02T06:30:27.947ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3622024-11-02T06:30:27.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3632024-11-02T06:30:27.949ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3642024-11-02T06:30:27.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3652024-11-02T06:30:27.951ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3662024-11-02T06:30:27.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3672024-11-02T06:30:27.977ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3682024-11-02T06:30:27.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3692024-11-02T06:30:27.986ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3702024-11-02T06:30:27.988ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
3712024-11-02T06:30:27.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3722024-11-02T06:30:27.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3732024-11-02T06:30:27.998ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
3742024-11-02T06:30:27.998ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.438852ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
3752024-11-02T06:30:28.005ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.455912ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3762024-11-02T06:30:28.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0e9900ef-5506-4252-a382-12c3b97eab01 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3772024-11-02T06:30:28.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0e9900ef-5506-4252-a382-12c3b97eab01 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3782024-11-02T06:30:28.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0e9900ef-5506-4252-a382-12c3b97eab01 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3792024-11-02T06:30:29.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = dd653a88-d7db-4f71-943b-f9dbe38d655c roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3802024-11-02T06:30:29.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = dd653a88-d7db-4f71-943b-f9dbe38d655c resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3812024-11-02T06:30:29.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = dd653a88-d7db-4f71-943b-f9dbe38d655c response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3822024-11-02T06:30:30.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fdfa247f-7caf-4951-9d08-937704f57100 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3832024-11-02T06:30:30.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fdfa247f-7caf-4951-9d08-937704f57100 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3842024-11-02T06:30:30.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fdfa247f-7caf-4951-9d08-937704f57100 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3852024-11-02T06:30:31.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7927651a-5fb5-4be4-b622-a01b6b0a105e roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3862024-11-02T06:30:31.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7927651a-5fb5-4be4-b622-a01b6b0a105e resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3872024-11-02T06:30:31.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7927651a-5fb5-4be4-b622-a01b6b0a105e response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3882024-11-02T06:30:32.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 45a0be84-0825-414d-9bcf-4cf38d3fbee5 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3892024-11-02T06:30:32.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 45a0be84-0825-414d-9bcf-4cf38d3fbee5 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3902024-11-02T06:30:32.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1739 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 45a0be84-0825-414d-9bcf-4cf38d3fbee5 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3912024-11-02T06:30:33.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5505e548-ff49-4c8b-b7ce-d144bb9438f6 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3922024-11-02T06:30:33.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5505e548-ff49-4c8b-b7ce-d144bb9438f6 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3932024-11-02T06:30:33.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5505e548-ff49-4c8b-b7ce-d144bb9438f6 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3942024-11-02T06:30:34.399ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1387 local_addr = [fd00:1122:3344:101::c]:45423 method = GET remote_addr = [fd00:1122:3344:101::d]:54698 req_id = 87805bc1-61ef-44f5-b365-f7203e04b870 response_code = 200 uri = /0b0286d1-4696-4dd6-a80e-495d344ae645
3952024-11-02T06:30:34.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0b9900cc-68f9-4c21-bcc8-af14dcbd559c roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3962024-11-02T06:30:34.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0b9900cc-68f9-4c21-bcc8-af14dcbd559c resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3972024-11-02T06:30:34.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0b9900cc-68f9-4c21-bcc8-af14dcbd559c response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3982024-11-02T06:30:35.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 6b70045b-1921-4227-bc44-671c2aac648e roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
3992024-11-02T06:30:35.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 6b70045b-1921-4227-bc44-671c2aac648e resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4002024-11-02T06:30:35.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 6b70045b-1921-4227-bc44-671c2aac648e response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4012024-11-02T06:30:36.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 31c90d12-c373-45ea-ac4a-b9093d06a5ae roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4022024-11-02T06:30:36.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 31c90d12-c373-45ea-ac4a-b9093d06a5ae resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4032024-11-02T06:30:36.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 31c90d12-c373-45ea-ac4a-b9093d06a5ae response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4042024-11-02T06:30:37.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1704dcb4-cce2-40d2-9be1-17b3b08ffe21 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4052024-11-02T06:30:37.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1704dcb4-cce2-40d2-9be1-17b3b08ffe21 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4062024-11-02T06:30:37.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1704dcb4-cce2-40d2-9be1-17b3b08ffe21 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4072024-11-02T06:30:37.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
4082024-11-02T06:30:37.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
4092024-11-02T06:30:37.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4102024-11-02T06:30:37.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4112024-11-02T06:30:37.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4122024-11-02T06:30:37.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4132024-11-02T06:30:37.947ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4142024-11-02T06:30:37.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4152024-11-02T06:30:37.949ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4162024-11-02T06:30:37.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4172024-11-02T06:30:37.951ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4182024-11-02T06:30:37.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4192024-11-02T06:30:37.974ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4202024-11-02T06:30:37.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4212024-11-02T06:30:37.976ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.942884ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4222024-11-02T06:30:37.979ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4232024-11-02T06:30:37.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
4242024-11-02T06:30:37.981ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4252024-11-02T06:30:37.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4262024-11-02T06:30:37.991ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
4272024-11-02T06:30:37.991ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.624885ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
4282024-11-02T06:30:38.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 55296cbe-474f-4b7d-9708-f9a100fcfe7a roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4292024-11-02T06:30:38.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 55296cbe-474f-4b7d-9708-f9a100fcfe7a resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4302024-11-02T06:30:38.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 55296cbe-474f-4b7d-9708-f9a100fcfe7a response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4312024-11-02T06:30:39.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 385dbe7a-f657-4169-beac-7d672134b65c roles = RoleSet { roles: {} } uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
4322024-11-02T06:30:39.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 385dbe7a-f657-4169-beac-7d672134b65c resource = Database result = Ok(()) uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
4332024-11-02T06:30:39.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2571 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 385dbe7a-f657-4169-beac-7d672134b65c response_code = 200 uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
4342024-11-02T06:30:39.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 797fd7c8-afbd-4e64-b462-169f05b670f1 roles = RoleSet { roles: {} } uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
4352024-11-02T06:30:39.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 797fd7c8-afbd-4e64-b462-169f05b670f1 resource = Database result = Ok(()) uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
4362024-11-02T06:30:39.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 797fd7c8-afbd-4e64-b462-169f05b670f1 response_code = 200 uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
4372024-11-02T06:30:39.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7785bd35-4348-4727-b21f-33d25c4afb9d roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4382024-11-02T06:30:39.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7785bd35-4348-4727-b21f-33d25c4afb9d resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4392024-11-02T06:30:39.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7785bd35-4348-4727-b21f-33d25c4afb9d response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4402024-11-02T06:30:39.856ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:40192
4412024-11-02T06:30:39.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40192 req_id = 2988da6b-a05c-4628-950a-bb872dd95dc4 roles = RoleSet { roles: {} } uri = /metrics/producers
4422024-11-02T06:30:39.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40192 req_id = 2988da6b-a05c-4628-950a-bb872dd95dc4 resource = Database result = Ok(()) uri = /metrics/producers
4432024-11-02T06:30:39.892ZINFOnexus: assigned collector to new producer collector_id = 13175a5b-eed9-4b10-bbf4-9e75d4d6ef03 file = nexus/src/app/oximeter.rs:76 producer_id = 52ca2d34-0954-4f9a-ab69-c867b3191a66
4442024-11-02T06:30:39.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36196 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40192 req_id = 2988da6b-a05c-4628-950a-bb872dd95dc4 response_code = 201 uri = /metrics/producers
4452024-11-02T06:30:40.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 99b79923-c2de-4910-b579-6d14dbf5c437 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4462024-11-02T06:30:40.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 99b79923-c2de-4910-b579-6d14dbf5c437 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4472024-11-02T06:30:40.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 99b79923-c2de-4910-b579-6d14dbf5c437 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4482024-11-02T06:30:41.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ad680d1c-a194-44a0-bd80-cf285e6323a1 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4492024-11-02T06:30:41.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ad680d1c-a194-44a0-bd80-cf285e6323a1 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4502024-11-02T06:30:41.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ad680d1c-a194-44a0-bd80-cf285e6323a1 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4512024-11-02T06:30:42.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ea5db922-dfdd-4a06-8c6e-5ddd3d20beb7 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4522024-11-02T06:30:42.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ea5db922-dfdd-4a06-8c6e-5ddd3d20beb7 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4532024-11-02T06:30:42.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ea5db922-dfdd-4a06-8c6e-5ddd3d20beb7 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4542024-11-02T06:30:43.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 64f206df-e1a5-4ef7-b174-cfe7d5ef572e roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4552024-11-02T06:30:43.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 64f206df-e1a5-4ef7-b174-cfe7d5ef572e resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4562024-11-02T06:30:43.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 64f206df-e1a5-4ef7-b174-cfe7d5ef572e response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4572024-11-02T06:30:44.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3609cb64-d6f2-413c-9f22-b3b0db064458 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4582024-11-02T06:30:44.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3609cb64-d6f2-413c-9f22-b3b0db064458 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4592024-11-02T06:30:44.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3609cb64-d6f2-413c-9f22-b3b0db064458 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4602024-11-02T06:30:45.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 61c82ab4-7a73-452c-bcb5-3e881882e3ad roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4612024-11-02T06:30:45.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 61c82ab4-7a73-452c-bcb5-3e881882e3ad resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4622024-11-02T06:30:45.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 61c82ab4-7a73-452c-bcb5-3e881882e3ad response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4632024-11-02T06:30:46.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4715446c-1799-4396-9a6c-af6c2f92bfb1 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4642024-11-02T06:30:46.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4715446c-1799-4396-9a6c-af6c2f92bfb1 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4652024-11-02T06:30:46.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4715446c-1799-4396-9a6c-af6c2f92bfb1 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4662024-11-02T06:30:47.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7db8ba64-187d-44bb-ac87-0a3c895126fc roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4672024-11-02T06:30:47.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7db8ba64-187d-44bb-ac87-0a3c895126fc resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4682024-11-02T06:30:47.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7db8ba64-187d-44bb-ac87-0a3c895126fc response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
4692024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
4702024-11-02T06:30:47.945ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4712024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
4722024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4732024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
4742024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
4752024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4762024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4772024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
4782024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4792024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
4802024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
4812024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
4822024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4832024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
4842024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
4852024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4862024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4872024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4882024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
4892024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4902024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
4912024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4922024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
4932024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
4942024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
4952024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
4962024-11-02T06:30:47.945ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4972024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4982024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4992024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5002024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
5012024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5022024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5032024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
5042024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5052024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
5062024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5072024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5082024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
5092024-11-02T06:30:47.945ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 06:20:47.945579604 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
5102024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
5112024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
5122024-11-02T06:30:47.945ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951
5132024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.31\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951"}
5142024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
5152024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
5162024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5172024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5182024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
5192024-11-02T06:30:47.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5202024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5212024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5222024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
5232024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
5242024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.261\u{b5}s iteration = 23 status = {"errors":[],"records_set_to_done":[]}
5252024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
5262024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.45\u{b5}s iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
5272024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.02\u{b5}s iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
5282024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
5292024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
5302024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5312024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
5322024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
5332024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5342024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.361\u{b5}s iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
5352024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5362024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5372024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5382024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5392024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5402024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5412024-11-02T06:30:47.946ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6a4687d5-e6b4-4540-a2ca-427f283410f7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de7d1832-5e65-4ea7-84c0-45f357940eaf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("de7d1832-5e65-4ea7-84c0-45f357940eaf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 5424, tv_nsec: 535596633 } })
5422024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5432024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5442024-11-02T06:30:47.946ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2def50a1-21d3-4363-95dd-e7ace3ea6072.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5bb4c3ff-dfd1-48bb-9ff6-2d960161c3ff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94cf380a-9b0f-4dd7-bbb4-ea455975d533.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("94cf380a-9b0f-4dd7-bbb4-ea455975d533.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 5424, tv_nsec: 535630714 } })
5452024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5462024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5472024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5482024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5492024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5502024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5512024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5522024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5532024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
5542024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.421576ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
5552024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
5562024-11-02T06:30:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.360596ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5572024-11-02T06:30:47.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5582024-11-02T06:30:47.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5592024-11-02T06:30:47.948ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602024-11-02T06:30:47.949ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5612024-11-02T06:30:47.949ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.952233ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5622024-11-02T06:30:47.949ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5632024-11-02T06:30:47.950ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5642024-11-02T06:30:47.950ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5652024-11-02T06:30:47.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5662024-11-02T06:30:47.950ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5424, tv_nsec: 540445163 } })
5672024-11-02T06:30:47.951ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
5682024-11-02T06:30:47.951ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5692024-11-02T06:30:47.951ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5702024-11-02T06:30:47.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5712024-11-02T06:30:47.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5722024-11-02T06:30:47.952ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5732024-11-02T06:30:47.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5742024-11-02T06:30:47.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5752024-11-02T06:30:47.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5762024-11-02T06:30:47.957ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5772024-11-02T06:30:47.959ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5424, tv_nsec: 549245197 } })
5782024-11-02T06:30:47.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5792024-11-02T06:30:47.959ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5802024-11-02T06:30:47.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5812024-11-02T06:30:47.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5822024-11-02T06:30:47.960ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
5832024-11-02T06:30:47.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5842024-11-02T06:30:47.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5852024-11-02T06:30:47.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5862024-11-02T06:30:47.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5872024-11-02T06:30:47.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5882024-11-02T06:30:47.964ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5892024-11-02T06:30:47.964ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5902024-11-02T06:30:47.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5912024-11-02T06:30:47.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5922024-11-02T06:30:47.965ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5932024-11-02T06:30:47.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5942024-11-02T06:30:47.971ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 06:20:47.945579604 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5952024-11-02T06:30:47.971ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 26.221926ms iteration = 12 status = {"expiration":"2024-11-02T06:20:47.945579604Z","pruned":[]}
5962024-11-02T06:30:47.972ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.532362ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
5972024-11-02T06:30:47.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982024-11-02T06:30:47.982ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5992024-11-02T06:30:47.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6002024-11-02T06:30:47.983ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6012024-11-02T06:30:47.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6022024-11-02T06:30:47.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6032024-11-02T06:30:47.984ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6042024-11-02T06:30:47.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6052024-11-02T06:30:47.986ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6062024-11-02T06:30:47.986ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6072024-11-02T06:30:47.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6082024-11-02T06:30:47.987ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5424, tv_nsec: 577350878 } })
6092024-11-02T06:30:47.988ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6102024-11-02T06:30:47.988ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
6112024-11-02T06:30:47.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6122024-11-02T06:30:47.988ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6132024-11-02T06:30:47.988ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6142024-11-02T06:30:47.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6152024-11-02T06:30:47.990ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6162024-11-02T06:30:47.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6172024-11-02T06:30:47.992ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6182024-11-02T06:30:47.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6192024-11-02T06:30:47.995ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6202024-11-02T06:30:47.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6212024-11-02T06:30:47.998ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6222024-11-02T06:30:47.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6232024-11-02T06:30:48.019ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6242024-11-02T06:30:48.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6252024-11-02T06:30:48.022ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6262024-11-02T06:30:48.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6272024-11-02T06:30:48.024ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6282024-11-02T06:30:48.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6292024-11-02T06:30:48.027ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6302024-11-02T06:30:48.027ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6312024-11-02T06:30:48.027ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6322024-11-02T06:30:48.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6332024-11-02T06:30:48.032ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6342024-11-02T06:30:48.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6352024-11-02T06:30:48.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6362024-11-02T06:30:48.033ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6372024-11-02T06:30:48.033ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6382024-11-02T06:30:48.033ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 88.3568ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6392024-11-02T06:30:48.034ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.779817ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6402024-11-02T06:30:48.038ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6412024-11-02T06:30:48.038ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6422024-11-02T06:30:48.038ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 92.276642ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6432024-11-02T06:30:48.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6442024-11-02T06:30:48.051ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6452024-11-02T06:30:48.051ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6462024-11-02T06:30:48.051ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6472024-11-02T06:30:48.051ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6482024-11-02T06:30:48.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6492024-11-02T06:30:48.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6502024-11-02T06:30:48.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6512024-11-02T06:30:48.054ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6522024-11-02T06:30:48.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6532024-11-02T06:30:48.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6542024-11-02T06:30:48.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
6552024-11-02T06:30:48.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6562024-11-02T06:30:48.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6572024-11-02T06:30:48.066ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6582024-11-02T06:30:48.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6592024-11-02T06:30:48.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6602024-11-02T06:30:48.068ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6612024-11-02T06:30:48.068ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6622024-11-02T06:30:48.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6632024-11-02T06:30:48.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
6642024-11-02T06:30:48.080ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 134.481165ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
6652024-11-02T06:30:48.082ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6662024-11-02T06:30:48.082ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6672024-11-02T06:30:48.082ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6682024-11-02T06:30:48.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6692024-11-02T06:30:48.082ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6702024-11-02T06:30:48.082ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 137.205006ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6712024-11-02T06:30:48.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6722024-11-02T06:30:48.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6732024-11-02T06:30:48.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 145.040082ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6742024-11-02T06:30:48.092ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6752024-11-02T06:30:48.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6762024-11-02T06:30:48.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6772024-11-02T06:30:48.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6782024-11-02T06:30:48.098ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6792024-11-02T06:30:48.098ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6802024-11-02T06:30:48.098ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6812024-11-02T06:30:48.098ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6822024-11-02T06:30:48.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6832024-11-02T06:30:48.100ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
6842024-11-02T06:30:48.100ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3492129c-7012-4d01-9997-b73cc054da28 dns_zone_name = oxide.test found_so_far = 0 version = 2
6852024-11-02T06:30:48.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6862024-11-02T06:30:48.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6872024-11-02T06:30:48.102ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6882024-11-02T06:30:48.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6892024-11-02T06:30:48.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6902024-11-02T06:30:48.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6912024-11-02T06:30:48.117ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
6922024-11-02T06:30:48.117ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6932024-11-02T06:30:48.117ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7c89310-c4b8-4d7d-b6ad-430dc11a79bb", "content-length": "26", "date": "Sat, 02 Nov 2024 06:30:48 GMT"} })
6942024-11-02T06:30:48.117ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6952024-11-02T06:30:48.119ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6962024-11-02T06:30:48.119ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T06:19:46.120247Z, time_modified: 2024-11-02T06:19:46.120247Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 59403eed-26d3-491e-a214-3ec0c7b10fb5, db_silo: Silo { identity: SiloIdentity { id: 59403eed-26d3-491e-a214-3ec0c7b10fb5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T06:20:14.941312Z, time_modified: 2024-11-02T06:20:14.941312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a5838a91006fb28d0b2bb1e66d2941fc0e90d5e4733e0b81cfebd701af94c573" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 59403eed-26d3-491e-a214-3ec0c7b10fb5, db_silo: Silo { identity: SiloIdentity { id: 59403eed-26d3-491e-a214-3ec0c7b10fb5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T06:20:14.941312Z, time_modified: 2024-11-02T06:20:14.941312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a5838a91006fb28d0b2bb1e66d2941fc0e90d5e4733e0b81cfebd701af94c573" }] }) }
6972024-11-02T06:30:48.119ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 174.502038ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"59403eed-26d3-491e-a214-3ec0c7b10fb5","tls_certs":["a5838a91006fb28d0b2bb1e66d2941fc0e90d5e4733e0b81cfebd701af94c573"]}},"default_endpoint":{"silo_id":"59403eed-26d3-491e-a214-3ec0c7b10fb5","tls_certs":["a5838a91006fb28d0b2bb1e66d2941fc0e90d5e4733e0b81cfebd701af94c573"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
6982024-11-02T06:30:48.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6992024-11-02T06:30:48.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e910c408-e8f8-499f-81a3-43816eb138fc, lookup_type: ById(e910c408-e8f8-499f-81a3-43816eb138fc) } result = Ok(())
7002024-11-02T06:30:48.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7012024-11-02T06:30:48.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7022024-11-02T06:30:48.126ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7032024-11-02T06:30:48.126ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7042024-11-02T06:30:48.126ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 180.839626ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7052024-11-02T06:30:48.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7062024-11-02T06:30:48.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7072024-11-02T06:30:48.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7082024-11-02T06:30:48.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7092024-11-02T06:30:48.137ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
7102024-11-02T06:30:48.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7112024-11-02T06:30:48.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7122024-11-02T06:30:48.160ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 215.259824ms iteration = 27 status = {"physical_disks_added":0}
7132024-11-02T06:30:48.192ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7142024-11-02T06:30:48.192ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 246.87157ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7152024-11-02T06:30:48.200ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 zone_address = fd00:1122:3344:101::2
7162024-11-02T06:30:48.201ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7172024-11-02T06:30:48.201ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c9eefbb-f11f-4ee2-ae5a-a2545a9156da", "content-length": "26", "date": "Sat, 02 Nov 2024 06:30:48 GMT"} })
7182024-11-02T06:30:48.201ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7192024-11-02T06:30:48.202ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
7202024-11-02T06:30:48.212ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
7212024-11-02T06:30:48.212ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7222024-11-02T06:30:48.212ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "884bb31a-693b-4bb6-9852-d900bb1bd6b8", "content-length": "26", "date": "Sat, 02 Nov 2024 06:30:48 GMT"} })
7232024-11-02T06:30:48.212ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7242024-11-02T06:30:48.214ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7252024-11-02T06:30:48.232ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7262024-11-02T06:30:48.283ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 337.883689ms iteration = 23 status = {}
7272024-11-02T06:30:48.352ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7282024-11-02T06:30:48.353ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "89515267-8f07-4d1f-9788-cd28539a3ec4", "content-length": "1", "date": "Sat, 02 Nov 2024 06:30:47 GMT"} })
7292024-11-02T06:30:48.354ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7302024-11-02T06:30:48.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7312024-11-02T06:30:48.355ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7322024-11-02T06:30:48.388ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7332024-11-02T06:30:48.388ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7342024-11-02T06:30:48.388ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "346d5e75-24c4-4dff-8734-a6410e417aac", "content-length": "372", "date": "Sat, 02 Nov 2024 06:30:47 GMT"} })
7352024-11-02T06:30:48.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7362024-11-02T06:30:48.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7372024-11-02T06:30:48.390ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3492129c-7012-4d01-9997-b73cc054da28 dns_zone_name = oxide.test found_so_far = 1 version = 2
7382024-11-02T06:30:48.390ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7392024-11-02T06:30:48.390ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 06:20:14.983012 UTC dns_group = external generation = 2
7402024-11-02T06:30:48.390ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 445.284082ms iteration = 13 status = {"generation":2}
7412024-11-02T06:30:48.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7422024-11-02T06:30:48.391ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 446.097237ms iteration = 23 status = 0
7432024-11-02T06:30:48.392ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 447.381601ms iteration = 23 status = null
7442024-11-02T06:30:48.394ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7452024-11-02T06:30:48.394ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7462024-11-02T06:30:48.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7472024-11-02T06:30:48.395ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7482024-11-02T06:30:48.395ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "22e344f4-8adf-4ba9-9f2a-904a0e74049e", "date": "Sat, 02 Nov 2024 06:30:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7492024-11-02T06:30:48.395ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7502024-11-02T06:30:48.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7512024-11-02T06:30:48.397ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9040c70b-e48e-4af8-aec7-d13eff1f0bb5", "date": "Sat, 02 Nov 2024 06:30:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7522024-11-02T06:30:48.397ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7532024-11-02T06:30:48.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7542024-11-02T06:30:48.398ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7552024-11-02T06:30:48.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7562024-11-02T06:30:48.399ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7572024-11-02T06:30:48.399ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 454.564344ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7582024-11-02T06:30:48.418ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7592024-11-02T06:30:48.418ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ebec6ef1-d036-4e17-8eb7-453f158dbe5b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7602024-11-02T06:30:48.418ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7612024-11-02T06:30:48.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7622024-11-02T06:30:48.420ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7632024-11-02T06:30:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7642024-11-02T06:30:48.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7652024-11-02T06:30:48.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7662024-11-02T06:30:48.426ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ebec6ef1-d036-4e17-8eb7-453f158dbe5b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7672024-11-02T06:30:48.426ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7682024-11-02T06:30:48.426ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 06:20:14.397898 UTC dns_group = internal generation = 1
7692024-11-02T06:30:48.426ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 481.035975ms iteration = 13 status = {"generation":1}
7702024-11-02T06:30:48.432ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7712024-11-02T06:30:48.432ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7722024-11-02T06:30:48.432ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7732024-11-02T06:30:48.432ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b42d8613-42ca-4e24-be81-be95d18cd9bf", "date": "Sat, 02 Nov 2024 06:30:47 GMT"} })
7742024-11-02T06:30:48.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7752024-11-02T06:30:48.432ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b5406400-ddeb-4ef0-9ebc-aa85c382593a", "date": "Sat, 02 Nov 2024 06:30:48 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7762024-11-02T06:30:48.432ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7772024-11-02T06:30:48.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7782024-11-02T06:30:48.434ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bfc65935-3b3f-4fb8-b76c-290320624915", "date": "Sat, 02 Nov 2024 06:30:48 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7792024-11-02T06:30:48.434ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7802024-11-02T06:30:48.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7812024-11-02T06:30:48.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7822024-11-02T06:30:48.436ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3a8748cc-34c3-493c-ad5a-fd29a5d19f60", "date": "Sat, 02 Nov 2024 06:30:48 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7832024-11-02T06:30:48.436ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7842024-11-02T06:30:48.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7852024-11-02T06:30:48.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7862024-11-02T06:30:48.438ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
7872024-11-02T06:30:48.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 492.863385ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7882024-11-02T06:30:48.441ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7892024-11-02T06:30:48.441ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7902024-11-02T06:30:48.441ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8bef26de-ecc1-4283-a5b8-3dd1303c40e8", "date": "Sat, 02 Nov 2024 06:30:47 GMT"} })
7912024-11-02T06:30:48.443ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 498.354636ms iteration = 24 status = {}
7922024-11-02T06:30:48.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7932024-11-02T06:30:48.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7942024-11-02T06:30:48.464ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 29c3f6a1-2034-455b-bc3b-3fbebec1d7c1, rack_id: a9cb4975-e69e-4875-af6f-759c07abd8a8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(72902c82-00a8-446a-b727-41c9c8c92f9b) } rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0
7952024-11-02T06:30:48.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7962024-11-02T06:30:48.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7972024-11-02T06:30:48.470ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7982024-11-02T06:30:48.471ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a210e0a-304a-4ca1-bed5-9ddf28357ae3", "content-length": "134", "date": "Sat, 02 Nov 2024 06:30:47 GMT"} })
7992024-11-02T06:30:48.471ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8002024-11-02T06:30:48.471ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 72902c82-00a8-446a-b727-41c9c8c92f9b
8012024-11-02T06:30:48.471ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8022024-11-02T06:30:48.471ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8032024-11-02T06:30:48.471ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8042024-11-02T06:30:48.471ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8052024-11-02T06:30:48.471ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8062024-11-02T06:30:48.471ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8072024-11-02T06:30:48.471ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8082024-11-02T06:30:48.471ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8092024-11-02T06:30:48.471ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
8102024-11-02T06:30:48.471ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8112024-11-02T06:30:48.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8122024-11-02T06:30:48.474ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8132024-11-02T06:30:48.474ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cce19d32-cb9c-49f7-bf3d-27397fba1344", "content-length": "2", "date": "Sat, 02 Nov 2024 06:30:47 GMT"} })
8142024-11-02T06:30:48.474ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8152024-11-02T06:30:48.474ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5387b8a1-8f16-46f7-b37e-ce710d2a6431", "content-length": "52", "date": "Sat, 02 Nov 2024 06:30:47 GMT"} })
8162024-11-02T06:30:48.474ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0
8172024-11-02T06:30:48.474ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8182024-11-02T06:30:48.487ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8192024-11-02T06:30:48.582ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "622d7591-f8c1-4a71-ae16-22449d40b09d", "date": "Sat, 02 Nov 2024 06:30:47 GMT"} })
8202024-11-02T06:30:48.582ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch = Switch0
8212024-11-02T06:30:48.582ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8222024-11-02T06:30:48.587ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a759749a-b3c7-41be-9caa-a7742f8a51f1", "content-length": "691", "date": "Sat, 02 Nov 2024 06:30:47 GMT"} })
8232024-11-02T06:30:48.587ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8242024-11-02T06:30:48.587ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8252024-11-02T06:30:48.587ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8262024-11-02T06:30:48.587ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1e671b1-45e6-4f23-bded-92c161ef30ce", "content-length": "682", "date": "Sat, 02 Nov 2024 06:30:48 GMT"} })
8272024-11-02T06:30:48.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8282024-11-02T06:30:48.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8292024-11-02T06:30:48.588ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 643.010961ms iteration = 23 status = {}
8302024-11-02T06:30:48.590ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8312024-11-02T06:30:48.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8322024-11-02T06:30:48.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8332024-11-02T06:30:48.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8342024-11-02T06:30:48.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8352024-11-02T06:30:48.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8362024-11-02T06:30:48.602ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 656.4759ms iteration = 23 status = {}
8372024-11-02T06:30:48.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 87563878-f7b9-4d34-a6cf-55ab9fa5c028 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8382024-11-02T06:30:48.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 87563878-f7b9-4d34-a6cf-55ab9fa5c028 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8392024-11-02T06:30:48.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 87563878-f7b9-4d34-a6cf-55ab9fa5c028 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8402024-11-02T06:30:49.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = cbf32aee-6e6e-4e74-ad20-58421fcd9ca5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8412024-11-02T06:30:49.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = cbf32aee-6e6e-4e74-ad20-58421fcd9ca5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8422024-11-02T06:30:49.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = cbf32aee-6e6e-4e74-ad20-58421fcd9ca5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8432024-11-02T06:30:49.399ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1343 local_addr = [fd00:1122:3344:101::c]:45423 method = GET remote_addr = [fd00:1122:3344:101::d]:54698 req_id = 31b3626a-698f-43b9-999d-118a3b0cac84 response_code = 200 uri = /0b0286d1-4696-4dd6-a80e-495d344ae645
8442024-11-02T06:30:49.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c4cd5202-6324-4803-8dee-40d9eac169a1 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8452024-11-02T06:30:49.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c4cd5202-6324-4803-8dee-40d9eac169a1 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8462024-11-02T06:30:49.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c4cd5202-6324-4803-8dee-40d9eac169a1 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8472024-11-02T06:30:50.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d0c9b9bd-fcd6-4d2a-8657-b84228f23425 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8482024-11-02T06:30:50.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d0c9b9bd-fcd6-4d2a-8657-b84228f23425 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8492024-11-02T06:30:50.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d0c9b9bd-fcd6-4d2a-8657-b84228f23425 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8502024-11-02T06:30:51.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b5a85e80-b974-4ded-bcb0-8368fdba94e5 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8512024-11-02T06:30:51.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b5a85e80-b974-4ded-bcb0-8368fdba94e5 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8522024-11-02T06:30:51.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b5a85e80-b974-4ded-bcb0-8368fdba94e5 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8532024-11-02T06:30:52.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 46d55469-d79d-4784-89f5-7794a4161512 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8542024-11-02T06:30:52.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 46d55469-d79d-4784-89f5-7794a4161512 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8552024-11-02T06:30:52.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 46d55469-d79d-4784-89f5-7794a4161512 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8562024-11-02T06:30:53.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b11feca3-54f1-4f60-a714-bb80e3af64f4 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8572024-11-02T06:30:53.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b11feca3-54f1-4f60-a714-bb80e3af64f4 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8582024-11-02T06:30:53.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b11feca3-54f1-4f60-a714-bb80e3af64f4 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8592024-11-02T06:30:54.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d9df910a-0a35-4b7c-aa42-5866a4443c6b roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8602024-11-02T06:30:54.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d9df910a-0a35-4b7c-aa42-5866a4443c6b resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8612024-11-02T06:30:54.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d9df910a-0a35-4b7c-aa42-5866a4443c6b response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8622024-11-02T06:30:55.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = efa309c5-760c-4595-84e8-3cac95d663b0 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8632024-11-02T06:30:55.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = efa309c5-760c-4595-84e8-3cac95d663b0 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8642024-11-02T06:30:55.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = efa309c5-760c-4595-84e8-3cac95d663b0 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8652024-11-02T06:30:56.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0b7e2373-9283-4d93-8c97-2e01d793bd5f roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8662024-11-02T06:30:56.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0b7e2373-9283-4d93-8c97-2e01d793bd5f resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8672024-11-02T06:30:56.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0b7e2373-9283-4d93-8c97-2e01d793bd5f response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8682024-11-02T06:30:57.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 8770b5b5-e68c-49ff-a077-56c609d48a5e roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8692024-11-02T06:30:57.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 8770b5b5-e68c-49ff-a077-56c609d48a5e resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8702024-11-02T06:30:57.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 8770b5b5-e68c-49ff-a077-56c609d48a5e response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8712024-11-02T06:30:57.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
8722024-11-02T06:30:57.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8732024-11-02T06:30:57.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
8742024-11-02T06:30:57.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8752024-11-02T06:30:57.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8762024-11-02T06:30:57.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8772024-11-02T06:30:57.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8782024-11-02T06:30:57.974ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8792024-11-02T06:30:57.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8802024-11-02T06:30:57.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8812024-11-02T06:30:57.976ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8822024-11-02T06:30:57.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8832024-11-02T06:30:57.978ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8842024-11-02T06:30:57.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8852024-11-02T06:30:57.980ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8862024-11-02T06:30:57.982ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
8872024-11-02T06:30:57.982ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8882024-11-02T06:30:57.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8892024-11-02T06:30:57.990ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
8902024-11-02T06:30:57.990ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.947934ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
8912024-11-02T06:30:58.003ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.502007ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8922024-11-02T06:30:58.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3965541f-3671-4a24-bd2c-045f4f323623 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8932024-11-02T06:30:58.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3965541f-3671-4a24-bd2c-045f4f323623 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8942024-11-02T06:30:58.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3965541f-3671-4a24-bd2c-045f4f323623 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8952024-11-02T06:30:59.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d710ca2f-6a2e-490c-bc5a-cf87308d687f roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8962024-11-02T06:30:59.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d710ca2f-6a2e-490c-bc5a-cf87308d687f resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8972024-11-02T06:30:59.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d710ca2f-6a2e-490c-bc5a-cf87308d687f response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8982024-11-02T06:31:01.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a3a5bb83-8564-4ac4-a722-189e216d53bb roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
8992024-11-02T06:31:01.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a3a5bb83-8564-4ac4-a722-189e216d53bb resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9002024-11-02T06:31:01.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a3a5bb83-8564-4ac4-a722-189e216d53bb response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9012024-11-02T06:31:02.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1a000151-6899-4505-9da1-90a47c52f648 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9022024-11-02T06:31:02.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1a000151-6899-4505-9da1-90a47c52f648 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9032024-11-02T06:31:02.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2015 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1a000151-6899-4505-9da1-90a47c52f648 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9042024-11-02T06:31:03.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 12691271-b16f-42c4-81cf-00e406f1fb1e roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9052024-11-02T06:31:03.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 12691271-b16f-42c4-81cf-00e406f1fb1e resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9062024-11-02T06:31:03.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2693 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 12691271-b16f-42c4-81cf-00e406f1fb1e response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9072024-11-02T06:31:04.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 97ce732e-dad5-40c5-94e0-e0cd66c250e8 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9082024-11-02T06:31:04.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 97ce732e-dad5-40c5-94e0-e0cd66c250e8 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9092024-11-02T06:31:04.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 97ce732e-dad5-40c5-94e0-e0cd66c250e8 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9102024-11-02T06:31:04.400ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:45423 method = GET remote_addr = [fd00:1122:3344:101::d]:54698 req_id = 8bc29971-c86d-4677-ad30-8029aa9d6a0d response_code = 200 uri = /0b0286d1-4696-4dd6-a80e-495d344ae645
9112024-11-02T06:31:05.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = dd0b3264-db04-428a-94c5-a80ac926d313 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9122024-11-02T06:31:05.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = dd0b3264-db04-428a-94c5-a80ac926d313 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9132024-11-02T06:31:05.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = dd0b3264-db04-428a-94c5-a80ac926d313 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9142024-11-02T06:31:06.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 587a336c-6162-4eb4-88e8-0da5a527248e roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9152024-11-02T06:31:06.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 587a336c-6162-4eb4-88e8-0da5a527248e resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9162024-11-02T06:31:06.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 587a336c-6162-4eb4-88e8-0da5a527248e response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9172024-11-02T06:31:07.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fd063c4c-6de8-4e1e-87e0-04bad6b949d8 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9182024-11-02T06:31:07.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fd063c4c-6de8-4e1e-87e0-04bad6b949d8 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9192024-11-02T06:31:07.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fd063c4c-6de8-4e1e-87e0-04bad6b949d8 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9202024-11-02T06:31:07.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
9212024-11-02T06:31:07.946ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9222024-11-02T06:31:07.946ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
9232024-11-02T06:31:07.946ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9242024-11-02T06:31:07.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9252024-11-02T06:31:07.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9262024-11-02T06:31:07.947ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9272024-11-02T06:31:07.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9282024-11-02T06:31:07.947ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9292024-11-02T06:31:07.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.170659ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9302024-11-02T06:31:07.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9312024-11-02T06:31:07.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9322024-11-02T06:31:07.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9332024-11-02T06:31:07.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9342024-11-02T06:31:07.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9352024-11-02T06:31:07.953ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9362024-11-02T06:31:07.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
9372024-11-02T06:31:07.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9382024-11-02T06:31:07.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9392024-11-02T06:31:07.964ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
9402024-11-02T06:31:07.964ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.344821ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
9412024-11-02T06:31:08.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1a45412b-4af7-4a66-9106-da20036bf870 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9422024-11-02T06:31:08.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1a45412b-4af7-4a66-9106-da20036bf870 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9432024-11-02T06:31:08.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1a45412b-4af7-4a66-9106-da20036bf870 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9442024-11-02T06:31:09.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 72604268-861e-48ee-84f5-e8eddd2b2a07 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9452024-11-02T06:31:09.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 72604268-861e-48ee-84f5-e8eddd2b2a07 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9462024-11-02T06:31:09.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 72604268-861e-48ee-84f5-e8eddd2b2a07 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9472024-11-02T06:31:10.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3806d5fb-86f8-4506-8b2b-bc6b8615ddaf roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9482024-11-02T06:31:10.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3806d5fb-86f8-4506-8b2b-bc6b8615ddaf resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9492024-11-02T06:31:10.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3806d5fb-86f8-4506-8b2b-bc6b8615ddaf response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9502024-11-02T06:31:11.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cba7c36e-2ac5-4591-9006-711bb6cd7e25 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9512024-11-02T06:31:11.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cba7c36e-2ac5-4591-9006-711bb6cd7e25 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9522024-11-02T06:31:11.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cba7c36e-2ac5-4591-9006-711bb6cd7e25 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9532024-11-02T06:31:12.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 642c7f6b-8529-4acb-94ce-5774df2daf77 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9542024-11-02T06:31:12.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 642c7f6b-8529-4acb-94ce-5774df2daf77 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9552024-11-02T06:31:12.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 642c7f6b-8529-4acb-94ce-5774df2daf77 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9562024-11-02T06:31:13.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 82120e0f-97d0-420f-bbf3-2e2c83e792fe roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9572024-11-02T06:31:13.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 82120e0f-97d0-420f-bbf3-2e2c83e792fe resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9582024-11-02T06:31:13.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 82120e0f-97d0-420f-bbf3-2e2c83e792fe response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9592024-11-02T06:31:14.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 62c7c6b1-b4e9-4718-8273-8044541d4fd6 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9602024-11-02T06:31:14.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 62c7c6b1-b4e9-4718-8273-8044541d4fd6 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9612024-11-02T06:31:14.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4936 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 62c7c6b1-b4e9-4718-8273-8044541d4fd6 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9622024-11-02T06:31:15.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 574ef010-a16c-4952-9427-684420645681 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9632024-11-02T06:31:15.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 574ef010-a16c-4952-9427-684420645681 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9642024-11-02T06:31:15.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 574ef010-a16c-4952-9427-684420645681 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9652024-11-02T06:31:16.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1a61ece8-0043-440a-a0ed-731ffb732416 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9662024-11-02T06:31:16.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1a61ece8-0043-440a-a0ed-731ffb732416 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9672024-11-02T06:31:16.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1a61ece8-0043-440a-a0ed-731ffb732416 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9682024-11-02T06:31:17.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7e5b625a-c6f5-499d-bf9e-38276b6c39c0 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9692024-11-02T06:31:17.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7e5b625a-c6f5-499d-bf9e-38276b6c39c0 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9702024-11-02T06:31:17.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7e5b625a-c6f5-499d-bf9e-38276b6c39c0 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
9712024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
9722024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
9732024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9742024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9752024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
9762024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
9772024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9782024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9792024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9802024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
9812024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
9822024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
9832024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9842024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
9852024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9862024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9872024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
9882024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
9892024-11-02T06:31:17.945ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9902024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9912024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9922024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
9932024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9942024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
9952024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9962024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
9972024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9982024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9992024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10002024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10012024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10022024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10032024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10042024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10052024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10062024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10072024-11-02T06:31:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10082024-11-02T06:31:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10092024-11-02T06:31:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10102024-11-02T06:31:17.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
10112024-11-02T06:31:17.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
10122024-11-02T06:31:17.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
10132024-11-02T06:31:17.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.74\u{b5}s iteration = 24 status = {"errors":[],"records_set_to_done":[]}
10142024-11-02T06:31:17.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.43\u{b5}s iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
10152024-11-02T06:31:17.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.94\u{b5}s iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
10162024-11-02T06:31:17.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
10172024-11-02T06:31:17.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.99\u{b5}s iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
10182024-11-02T06:31:17.947ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10192024-11-02T06:31:17.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10202024-11-02T06:31:17.948ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10212024-11-02T06:31:17.948ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5454, tv_nsec: 538276853 } })
10222024-11-02T06:31:17.948ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10232024-11-02T06:31:17.949ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
10242024-11-02T06:31:17.949ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.74449ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10252024-11-02T06:31:17.949ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10262024-11-02T06:31:17.950ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10272024-11-02T06:31:17.952ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10282024-11-02T06:31:17.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10292024-11-02T06:31:17.952ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10302024-11-02T06:31:17.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10312024-11-02T06:31:17.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10322024-11-02T06:31:17.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10332024-11-02T06:31:17.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10342024-11-02T06:31:17.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10352024-11-02T06:31:17.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10362024-11-02T06:31:17.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10372024-11-02T06:31:17.953ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10382024-11-02T06:31:17.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10392024-11-02T06:31:17.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10402024-11-02T06:31:17.955ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5454, tv_nsec: 544914116 } })
10412024-11-02T06:31:17.955ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10422024-11-02T06:31:17.955ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
10432024-11-02T06:31:17.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10442024-11-02T06:31:17.958ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10452024-11-02T06:31:17.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10462024-11-02T06:31:17.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10472024-11-02T06:31:17.959ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10482024-11-02T06:31:17.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10492024-11-02T06:31:17.964ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10502024-11-02T06:31:17.964ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10512024-11-02T06:31:17.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10522024-11-02T06:31:17.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10532024-11-02T06:31:17.965ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5454, tv_nsec: 554832821 } })
10542024-11-02T06:31:17.965ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
10552024-11-02T06:31:17.967ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 21.772944ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10562024-11-02T06:31:17.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10572024-11-02T06:31:17.969ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
10582024-11-02T06:31:17.969ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.718489ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
10592024-11-02T06:31:17.969ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10602024-11-02T06:31:17.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10612024-11-02T06:31:17.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10622024-11-02T06:31:17.970ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10632024-11-02T06:31:17.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10642024-11-02T06:31:17.971ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10652024-11-02T06:31:17.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10662024-11-02T06:31:17.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10672024-11-02T06:31:17.973ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10682024-11-02T06:31:17.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10692024-11-02T06:31:17.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
10702024-11-02T06:31:17.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10712024-11-02T06:31:17.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10722024-11-02T06:31:17.990ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10732024-11-02T06:31:17.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10742024-11-02T06:31:17.992ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10752024-11-02T06:31:17.992ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10762024-11-02T06:31:17.992ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10772024-11-02T06:31:17.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10782024-11-02T06:31:17.992ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10792024-11-02T06:31:17.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10802024-11-02T06:31:17.994ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10812024-11-02T06:31:17.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e910c408-e8f8-499f-81a3-43816eb138fc, lookup_type: ById(e910c408-e8f8-499f-81a3-43816eb138fc) } result = Ok(())
10822024-11-02T06:31:17.997ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10832024-11-02T06:31:17.998ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
10842024-11-02T06:31:17.998ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.629866ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
10852024-11-02T06:31:17.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10862024-11-02T06:31:17.999ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 54.403299ms iteration = 24 status = 0
10872024-11-02T06:31:18.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10882024-11-02T06:31:18.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10892024-11-02T06:31:18.006ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.001252ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10902024-11-02T06:31:18.010ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 64.68434ms iteration = 28 status = {"physical_disks_added":0}
10912024-11-02T06:31:18.015ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
10922024-11-02T06:31:18.015ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10932024-11-02T06:31:18.015ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b58ddbca-b3a8-401e-8241-9ca0d11c6d0a", "content-length": "26", "date": "Sat, 02 Nov 2024 06:31:18 GMT"} })
10942024-11-02T06:31:18.015ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10952024-11-02T06:31:18.018ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10962024-11-02T06:31:18.030ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
10972024-11-02T06:31:18.030ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10982024-11-02T06:31:18.030ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4f15a9a-0402-4e98-849b-1c9d872da40e", "content-length": "26", "date": "Sat, 02 Nov 2024 06:31:18 GMT"} })
10992024-11-02T06:31:18.030ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11002024-11-02T06:31:18.031ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11012024-11-02T06:31:18.031ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11022024-11-02T06:31:18.031ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11032024-11-02T06:31:18.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11042024-11-02T06:31:18.031ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11052024-11-02T06:31:18.040ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 zone_address = fd00:1122:3344:101::2
11062024-11-02T06:31:18.040ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11072024-11-02T06:31:18.040ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "206d2d53-19e4-495b-b948-4bf12824fa5d", "content-length": "26", "date": "Sat, 02 Nov 2024 06:31:18 GMT"} })
11082024-11-02T06:31:18.040ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11092024-11-02T06:31:18.042ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
11102024-11-02T06:31:18.065ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11112024-11-02T06:31:18.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11122024-11-02T06:31:18.067ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11132024-11-02T06:31:18.067ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11142024-11-02T06:31:18.067ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.706978ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11152024-11-02T06:31:18.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11162024-11-02T06:31:18.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11172024-11-02T06:31:18.108ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11182024-11-02T06:31:18.111ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11192024-11-02T06:31:18.111ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11202024-11-02T06:31:18.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11212024-11-02T06:31:18.117ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 172.211195ms iteration = 24 status = {}
11222024-11-02T06:31:18.127ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11232024-11-02T06:31:18.128ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae9c80b6-40cb-4a38-be1e-a7c757af3199", "content-length": "1", "date": "Sat, 02 Nov 2024 06:31:17 GMT"} })
11242024-11-02T06:31:18.129ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11252024-11-02T06:31:18.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11262024-11-02T06:31:18.133ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11272024-11-02T06:31:18.133ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11282024-11-02T06:31:18.134ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1623d6c-1dca-4953-b821-ad7becb8edf4", "content-length": "372", "date": "Sat, 02 Nov 2024 06:31:17 GMT"} })
11292024-11-02T06:31:18.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11302024-11-02T06:31:18.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11312024-11-02T06:31:18.135ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11322024-11-02T06:31:18.135ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 190.495335ms iteration = 24 status = null
11332024-11-02T06:31:18.137ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11342024-11-02T06:31:18.137ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11352024-11-02T06:31:18.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11362024-11-02T06:31:18.148ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
11372024-11-02T06:31:18.148ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11382024-11-02T06:31:18.148ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "596bc6f9-0f2e-4fb4-aa47-1502c13f1de9", "date": "Sat, 02 Nov 2024 06:31:17 GMT"} })
11392024-11-02T06:31:18.148ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11402024-11-02T06:31:18.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11412024-11-02T06:31:18.151ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11422024-11-02T06:31:18.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11432024-11-02T06:31:18.155ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11442024-11-02T06:31:18.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11452024-11-02T06:31:18.157ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11462024-11-02T06:31:18.157ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11472024-11-02T06:31:18.158ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9a6a450a-3270-4445-b241-2e8c85b56c06", "date": "Sat, 02 Nov 2024 06:31:17 GMT"} })
11482024-11-02T06:31:18.159ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 213.923169ms iteration = 25 status = {}
11492024-11-02T06:31:18.180ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11502024-11-02T06:31:18.180ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbf0faa7-f897-48bf-8919-86ca9b95983d", "content-length": "691", "date": "Sat, 02 Nov 2024 06:31:17 GMT"} })
11512024-11-02T06:31:18.180ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
11522024-11-02T06:31:18.180ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
11532024-11-02T06:31:18.180ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
11542024-11-02T06:31:18.183ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 237.559358ms iteration = 24 status = {}
11552024-11-02T06:31:18.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11562024-11-02T06:31:18.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11572024-11-02T06:31:18.202ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 29c3f6a1-2034-455b-bc3b-3fbebec1d7c1, rack_id: a9cb4975-e69e-4875-af6f-759c07abd8a8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(72902c82-00a8-446a-b727-41c9c8c92f9b) } rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0
11582024-11-02T06:31:18.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11592024-11-02T06:31:18.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11602024-11-02T06:31:18.211ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
11612024-11-02T06:31:18.212ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8028f48a-2a79-43ea-a93d-30e169e0f2bc", "content-length": "134", "date": "Sat, 02 Nov 2024 06:31:17 GMT"} })
11622024-11-02T06:31:18.212ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
11632024-11-02T06:31:18.212ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 72902c82-00a8-446a-b727-41c9c8c92f9b
11642024-11-02T06:31:18.212ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
11652024-11-02T06:31:18.212ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
11662024-11-02T06:31:18.212ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11672024-11-02T06:31:18.212ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11682024-11-02T06:31:18.212ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11692024-11-02T06:31:18.212ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11702024-11-02T06:31:18.212ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
11712024-11-02T06:31:18.212ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
11722024-11-02T06:31:18.212ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
11732024-11-02T06:31:18.212ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11742024-11-02T06:31:18.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11752024-11-02T06:31:18.214ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
11762024-11-02T06:31:18.214ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bc8f102-3a0c-4c10-9cce-e1f1e017503b", "content-length": "2", "date": "Sat, 02 Nov 2024 06:31:17 GMT"} })
11772024-11-02T06:31:18.214ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
11782024-11-02T06:31:18.214ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b29e999c-0e3a-427f-9665-ce43a69fa5c2", "content-length": "52", "date": "Sat, 02 Nov 2024 06:31:17 GMT"} })
11792024-11-02T06:31:18.214ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0
11802024-11-02T06:31:18.214ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
11812024-11-02T06:31:18.317ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a2abd7c1-01dd-413b-a0f4-b212c8375c79", "date": "Sat, 02 Nov 2024 06:31:17 GMT"} })
11822024-11-02T06:31:18.317ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch = Switch0
11832024-11-02T06:31:18.317ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
11842024-11-02T06:31:18.322ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebe8a605-fc6c-4594-89e0-5b6c80eb824c", "content-length": "682", "date": "Sat, 02 Nov 2024 06:31:17 GMT"} })
11852024-11-02T06:31:18.322ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11862024-11-02T06:31:18.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11872024-11-02T06:31:18.326ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11882024-11-02T06:31:18.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11892024-11-02T06:31:18.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11902024-11-02T06:31:18.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11912024-11-02T06:31:18.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11922024-11-02T06:31:18.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11932024-11-02T06:31:18.338ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 393.288477ms iteration = 24 status = {}
11942024-11-02T06:31:18.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0bf3c546-8434-4a28-b7f5-51590bb9ac18 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
11952024-11-02T06:31:18.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0bf3c546-8434-4a28-b7f5-51590bb9ac18 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
11962024-11-02T06:31:18.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1959 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0bf3c546-8434-4a28-b7f5-51590bb9ac18 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
11972024-11-02T06:31:19.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 36be3368-339e-475e-9158-e8f7ad46a8d7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
11982024-11-02T06:31:19.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 36be3368-339e-475e-9158-e8f7ad46a8d7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
11992024-11-02T06:31:19.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 36be3368-339e-475e-9158-e8f7ad46a8d7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
12002024-11-02T06:31:19.399ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1509 local_addr = [fd00:1122:3344:101::c]:45423 method = GET remote_addr = [fd00:1122:3344:101::d]:54698 req_id = 1facdffd-3de4-443b-9956-17918ead30af response_code = 200 uri = /0b0286d1-4696-4dd6-a80e-495d344ae645
12012024-11-02T06:31:19.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 16f379ed-cb2a-49b3-b362-1b81b853d0f9 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12022024-11-02T06:31:19.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 16f379ed-cb2a-49b3-b362-1b81b853d0f9 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12032024-11-02T06:31:19.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 16f379ed-cb2a-49b3-b362-1b81b853d0f9 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12042024-11-02T06:31:20.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 25281979-3a46-4275-8050-f64cf277227b roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12052024-11-02T06:31:20.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 25281979-3a46-4275-8050-f64cf277227b resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12062024-11-02T06:31:20.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 25281979-3a46-4275-8050-f64cf277227b response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12072024-11-02T06:31:21.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4fe9e795-f1b0-4dcb-9ec7-1c53db53ffa1 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12082024-11-02T06:31:21.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4fe9e795-f1b0-4dcb-9ec7-1c53db53ffa1 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12092024-11-02T06:31:21.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4fe9e795-f1b0-4dcb-9ec7-1c53db53ffa1 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12102024-11-02T06:31:22.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 54cd11a6-9cbf-4a4c-b023-f6871145d2bc roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12112024-11-02T06:31:22.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 54cd11a6-9cbf-4a4c-b023-f6871145d2bc resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12122024-11-02T06:31:22.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 54cd11a6-9cbf-4a4c-b023-f6871145d2bc response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12132024-11-02T06:31:23.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cbc9387c-81e5-4941-879e-a449c9552be6 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12142024-11-02T06:31:23.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cbc9387c-81e5-4941-879e-a449c9552be6 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12152024-11-02T06:31:23.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cbc9387c-81e5-4941-879e-a449c9552be6 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12162024-11-02T06:31:24.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d9745195-28d7-4ea6-96af-934f244a5ef8 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12172024-11-02T06:31:24.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d9745195-28d7-4ea6-96af-934f244a5ef8 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12182024-11-02T06:31:24.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d9745195-28d7-4ea6-96af-934f244a5ef8 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12192024-11-02T06:31:25.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 2bb889df-546f-4e7c-a9fd-1a9a6cbd74c3 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12202024-11-02T06:31:25.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 2bb889df-546f-4e7c-a9fd-1a9a6cbd74c3 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12212024-11-02T06:31:25.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 2bb889df-546f-4e7c-a9fd-1a9a6cbd74c3 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12222024-11-02T06:31:26.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7537bae4-147e-49da-9e4a-6be3fa6bca8c roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12232024-11-02T06:31:26.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7537bae4-147e-49da-9e4a-6be3fa6bca8c resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12242024-11-02T06:31:26.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7537bae4-147e-49da-9e4a-6be3fa6bca8c response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12252024-11-02T06:31:27.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 43776de6-7901-4623-8cba-544e921a645e roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12262024-11-02T06:31:27.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 43776de6-7901-4623-8cba-544e921a645e resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12272024-11-02T06:31:27.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 43776de6-7901-4623-8cba-544e921a645e response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12282024-11-02T06:31:27.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
12292024-11-02T06:31:27.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
12302024-11-02T06:31:27.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12312024-11-02T06:31:27.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12322024-11-02T06:31:27.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12332024-11-02T06:31:27.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12342024-11-02T06:31:27.947ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12352024-11-02T06:31:27.948ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12362024-11-02T06:31:27.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12372024-11-02T06:31:27.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.850431ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12382024-11-02T06:31:27.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12392024-11-02T06:31:27.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12402024-11-02T06:31:27.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12412024-11-02T06:31:27.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12422024-11-02T06:31:27.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12432024-11-02T06:31:27.953ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12442024-11-02T06:31:27.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
12452024-11-02T06:31:27.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12462024-11-02T06:31:27.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12472024-11-02T06:31:27.967ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
12482024-11-02T06:31:27.967ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.922927ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
12492024-11-02T06:31:28.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9d7e200b-8a37-4445-99fc-e1914cb16160 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12502024-11-02T06:31:28.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9d7e200b-8a37-4445-99fc-e1914cb16160 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12512024-11-02T06:31:28.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9d7e200b-8a37-4445-99fc-e1914cb16160 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12522024-11-02T06:31:29.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9a2b4d22-082d-4e7c-8ac6-5a16c2d08734 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12532024-11-02T06:31:29.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9a2b4d22-082d-4e7c-8ac6-5a16c2d08734 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12542024-11-02T06:31:29.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9a2b4d22-082d-4e7c-8ac6-5a16c2d08734 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12552024-11-02T06:31:30.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1db8a912-1181-46bd-a87e-2bc04f4d9c33 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12562024-11-02T06:31:30.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1db8a912-1181-46bd-a87e-2bc04f4d9c33 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12572024-11-02T06:31:30.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1db8a912-1181-46bd-a87e-2bc04f4d9c33 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12582024-11-02T06:31:31.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 105454b9-9e9f-45ef-9f4f-d4196b47c442 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12592024-11-02T06:31:31.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 105454b9-9e9f-45ef-9f4f-d4196b47c442 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12602024-11-02T06:31:31.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 105454b9-9e9f-45ef-9f4f-d4196b47c442 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12612024-11-02T06:31:32.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 14de016d-6255-4cb7-8c70-eef591389d25 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12622024-11-02T06:31:32.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 14de016d-6255-4cb7-8c70-eef591389d25 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12632024-11-02T06:31:32.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 14de016d-6255-4cb7-8c70-eef591389d25 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12642024-11-02T06:31:33.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d7a3538e-eca2-4cde-b893-aef38ab3034e roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12652024-11-02T06:31:33.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d7a3538e-eca2-4cde-b893-aef38ab3034e resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12662024-11-02T06:31:33.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d7a3538e-eca2-4cde-b893-aef38ab3034e response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12672024-11-02T06:31:34.398ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1513 local_addr = [fd00:1122:3344:101::c]:45423 method = GET remote_addr = [fd00:1122:3344:101::d]:54698 req_id = 40ee6dd8-eca8-4f05-a364-224ae36f7f33 response_code = 200 uri = /0b0286d1-4696-4dd6-a80e-495d344ae645
12682024-11-02T06:31:34.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cf6b5e70-9729-4057-8fd3-63f309dcb811 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12692024-11-02T06:31:34.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cf6b5e70-9729-4057-8fd3-63f309dcb811 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12702024-11-02T06:31:34.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cf6b5e70-9729-4057-8fd3-63f309dcb811 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12712024-11-02T06:31:35.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 81124035-5c86-49cd-9466-8cfde24e48d8 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12722024-11-02T06:31:35.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 81124035-5c86-49cd-9466-8cfde24e48d8 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12732024-11-02T06:31:35.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 81124035-5c86-49cd-9466-8cfde24e48d8 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12742024-11-02T06:31:36.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ac0e7734-c748-49e2-a185-10ae71a7c7be roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12752024-11-02T06:31:36.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ac0e7734-c748-49e2-a185-10ae71a7c7be resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12762024-11-02T06:31:36.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ac0e7734-c748-49e2-a185-10ae71a7c7be response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12772024-11-02T06:31:37.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 887317ea-6d9c-4b2e-b4d0-e31a954dd6dd roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12782024-11-02T06:31:37.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 887317ea-6d9c-4b2e-b4d0-e31a954dd6dd resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12792024-11-02T06:31:37.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 887317ea-6d9c-4b2e-b4d0-e31a954dd6dd response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
12802024-11-02T06:31:37.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
12812024-11-02T06:31:37.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
12822024-11-02T06:31:37.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12832024-11-02T06:31:37.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12842024-11-02T06:31:37.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12852024-11-02T06:31:37.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12862024-11-02T06:31:37.947ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12872024-11-02T06:31:37.947ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12882024-11-02T06:31:37.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12892024-11-02T06:31:37.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.546836ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12902024-11-02T06:31:37.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12912024-11-02T06:31:37.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12922024-11-02T06:31:37.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12932024-11-02T06:31:37.951ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12942024-11-02T06:31:37.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12952024-11-02T06:31:37.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12962024-11-02T06:31:37.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
12972024-11-02T06:31:37.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12982024-11-02T06:31:37.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12992024-11-02T06:31:37.963ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
13002024-11-02T06:31:37.963ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.81615ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
13012024-11-02T06:31:38.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 2d30949d-aeda-40ab-9c58-bbde3ebed9f0 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13022024-11-02T06:31:38.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 2d30949d-aeda-40ab-9c58-bbde3ebed9f0 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13032024-11-02T06:31:38.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 2d30949d-aeda-40ab-9c58-bbde3ebed9f0 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13042024-11-02T06:31:39.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = ce19b0f9-f59c-4ff2-a879-83f31f59311f roles = RoleSet { roles: {} } uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
13052024-11-02T06:31:39.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = ce19b0f9-f59c-4ff2-a879-83f31f59311f resource = Database result = Ok(()) uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
13062024-11-02T06:31:39.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = ce19b0f9-f59c-4ff2-a879-83f31f59311f response_code = 200 uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
13072024-11-02T06:31:39.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 8d36c630-2fb2-4e19-8d37-8c753218e668 roles = RoleSet { roles: {} } uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
13082024-11-02T06:31:39.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 8d36c630-2fb2-4e19-8d37-8c753218e668 resource = Database result = Ok(()) uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
13092024-11-02T06:31:39.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 8d36c630-2fb2-4e19-8d37-8c753218e668 response_code = 200 uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
13102024-11-02T06:31:39.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = aabeb267-d347-4338-87a3-b256279ec9ba roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13112024-11-02T06:31:39.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = aabeb267-d347-4338-87a3-b256279ec9ba resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13122024-11-02T06:31:39.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = aabeb267-d347-4338-87a3-b256279ec9ba response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13132024-11-02T06:31:40.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7b911bc8-623f-4639-9d3f-2363f2c07751 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13142024-11-02T06:31:40.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7b911bc8-623f-4639-9d3f-2363f2c07751 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13152024-11-02T06:31:40.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7b911bc8-623f-4639-9d3f-2363f2c07751 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13162024-11-02T06:31:41.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 16cb4349-1524-46af-bf94-fbb61106d919 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13172024-11-02T06:31:41.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 16cb4349-1524-46af-bf94-fbb61106d919 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13182024-11-02T06:31:41.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2363 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 16cb4349-1524-46af-bf94-fbb61106d919 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13192024-11-02T06:31:42.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5c35a5be-ff61-4b8f-8d5b-12d7209bd7a3 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13202024-11-02T06:31:43.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5c35a5be-ff61-4b8f-8d5b-12d7209bd7a3 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13212024-11-02T06:31:43.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5c35a5be-ff61-4b8f-8d5b-12d7209bd7a3 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13222024-11-02T06:31:44.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9949e0a8-36f5-4bdd-8ea3-362129a044c0 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13232024-11-02T06:31:44.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9949e0a8-36f5-4bdd-8ea3-362129a044c0 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13242024-11-02T06:31:44.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9949e0a8-36f5-4bdd-8ea3-362129a044c0 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13252024-11-02T06:31:45.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 88e0a71b-993b-4690-8dc8-c5f40b40d1aa roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13262024-11-02T06:31:45.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 88e0a71b-993b-4690-8dc8-c5f40b40d1aa resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13272024-11-02T06:31:45.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 88e0a71b-993b-4690-8dc8-c5f40b40d1aa response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13282024-11-02T06:31:46.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 77da5dda-0f41-4c88-a5c3-3ec2d0f26b6f roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13292024-11-02T06:31:46.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 77da5dda-0f41-4c88-a5c3-3ec2d0f26b6f resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13302024-11-02T06:31:46.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 77da5dda-0f41-4c88-a5c3-3ec2d0f26b6f response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13312024-11-02T06:31:47.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 39895d14-ee71-4451-97da-4ff24f388981 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13322024-11-02T06:31:47.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 39895d14-ee71-4451-97da-4ff24f388981 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13332024-11-02T06:31:47.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 39895d14-ee71-4451-97da-4ff24f388981 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
13342024-11-02T06:31:47.945ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
13352024-11-02T06:31:47.945ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13362024-11-02T06:31:47.945ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
13372024-11-02T06:31:47.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13382024-11-02T06:31:47.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
13392024-11-02T06:31:47.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
13402024-11-02T06:31:47.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13412024-11-02T06:31:47.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
13422024-11-02T06:31:47.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13432024-11-02T06:31:47.945ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951
13442024-11-02T06:31:47.945ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
13452024-11-02T06:31:47.945ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.92\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951"}
13462024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
13472024-11-02T06:31:47.946ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13482024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
13492024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13502024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13512024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
13522024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
13532024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
13542024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13552024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
13562024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
13572024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13582024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
13592024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13602024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
13612024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13622024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
13632024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
13642024-11-02T06:31:47.946ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 06:21:47.946002041 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13652024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13662024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13672024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
13682024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
13692024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
13702024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
13712024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
13722024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
13732024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13742024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13752024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
13762024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13772024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
13782024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13792024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
13802024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13812024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
13822024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
13832024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13842024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13852024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13862024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
13872024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.231\u{b5}s iteration = 25 status = {"errors":[],"records_set_to_done":[]}
13882024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
13892024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
13902024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.35\u{b5}s iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
13912024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
13922024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
13932024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.65\u{b5}s iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13942024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
13952024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 13.63\u{b5}s iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
13962024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
13972024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
13982024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13992024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14002024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14012024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14022024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14032024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14042024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14052024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14062024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14072024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
14082024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14092024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14102024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14112024-11-02T06:31:47.946ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2def50a1-21d3-4363-95dd-e7ace3ea6072.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5bb4c3ff-dfd1-48bb-9ff6-2d960161c3ff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94cf380a-9b0f-4dd7-bbb4-ea455975d533.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("94cf380a-9b0f-4dd7-bbb4-ea455975d533.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 5484, tv_nsec: 536086233 } })
14122024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14132024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14142024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14152024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14162024-11-02T06:31:47.946ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6a4687d5-e6b4-4540-a2ca-427f283410f7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de7d1832-5e65-4ea7-84c0-45f357940eaf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("de7d1832-5e65-4ea7-84c0-45f357940eaf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 5484, tv_nsec: 536242696 } })
14172024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14182024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14192024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14202024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14212024-11-02T06:31:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14222024-11-02T06:31:47.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14232024-11-02T06:31:47.947ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14242024-11-02T06:31:47.947ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
14252024-11-02T06:31:47.947ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.369815ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
14262024-11-02T06:31:47.947ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
14272024-11-02T06:31:47.947ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.430227ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
14282024-11-02T06:31:47.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14292024-11-02T06:31:47.947ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14302024-11-02T06:31:47.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14312024-11-02T06:31:47.947ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14322024-11-02T06:31:47.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14332024-11-02T06:31:47.948ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.432485ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14342024-11-02T06:31:47.948ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14352024-11-02T06:31:47.949ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14362024-11-02T06:31:47.949ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14372024-11-02T06:31:47.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14382024-11-02T06:31:47.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14392024-11-02T06:31:47.950ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14402024-11-02T06:31:47.953ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14412024-11-02T06:31:47.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14422024-11-02T06:31:47.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14432024-11-02T06:31:47.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14442024-11-02T06:31:47.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14452024-11-02T06:31:47.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14462024-11-02T06:31:47.954ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14472024-11-02T06:31:47.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14482024-11-02T06:31:47.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14492024-11-02T06:31:47.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14502024-11-02T06:31:47.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14512024-11-02T06:31:47.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14522024-11-02T06:31:47.964ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14532024-11-02T06:31:47.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14542024-11-02T06:31:47.967ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 06:21:47.946002041 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14552024-11-02T06:31:47.967ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 21.211244ms iteration = 13 status = {"expiration":"2024-11-02T06:21:47.946002041Z","pruned":[]}
14562024-11-02T06:31:47.967ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14572024-11-02T06:31:47.970ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14582024-11-02T06:31:47.970ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14592024-11-02T06:31:47.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14602024-11-02T06:31:47.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14612024-11-02T06:31:47.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14622024-11-02T06:31:47.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14632024-11-02T06:31:47.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14642024-11-02T06:31:47.973ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5484, tv_nsec: 562542404 } })
14652024-11-02T06:31:47.973ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
14662024-11-02T06:31:47.973ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14672024-11-02T06:31:47.973ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14682024-11-02T06:31:47.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14692024-11-02T06:31:47.975ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14702024-11-02T06:31:47.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14712024-11-02T06:31:47.976ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14722024-11-02T06:31:47.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14732024-11-02T06:31:47.977ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14742024-11-02T06:31:47.977ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14752024-11-02T06:31:47.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14762024-11-02T06:31:47.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14772024-11-02T06:31:47.979ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14782024-11-02T06:31:47.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14792024-11-02T06:31:47.979ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14802024-11-02T06:31:47.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14812024-11-02T06:31:47.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14822024-11-02T06:31:47.985ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
14832024-11-02T06:31:47.985ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
14842024-11-02T06:31:47.985ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 39.632205ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
14852024-11-02T06:31:47.989ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5484, tv_nsec: 578690493 } })
14862024-11-02T06:31:47.989ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
14872024-11-02T06:31:47.990ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14882024-11-02T06:31:47.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14892024-11-02T06:31:47.995ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14902024-11-02T06:31:47.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14912024-11-02T06:31:47.997ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14922024-11-02T06:31:47.997ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14932024-11-02T06:31:47.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14942024-11-02T06:31:47.999ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 53.018583ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
14952024-11-02T06:31:48.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14962024-11-02T06:31:48.000ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14972024-11-02T06:31:48.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14982024-11-02T06:31:48.003ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14992024-11-02T06:31:48.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15002024-11-02T06:31:48.004ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15012024-11-02T06:31:48.005ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15022024-11-02T06:31:48.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15032024-11-02T06:31:48.006ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15042024-11-02T06:31:48.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15052024-11-02T06:31:48.008ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15062024-11-02T06:31:48.010ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15072024-11-02T06:31:48.010ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15082024-11-02T06:31:48.010ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15092024-11-02T06:31:48.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15102024-11-02T06:31:48.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15112024-11-02T06:31:48.011ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5484, tv_nsec: 601403465 } })
15122024-11-02T06:31:48.012ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
15132024-11-02T06:31:48.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15142024-11-02T06:31:48.013ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15152024-11-02T06:31:48.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
15162024-11-02T06:31:48.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15172024-11-02T06:31:48.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15182024-11-02T06:31:48.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15192024-11-02T06:31:48.017ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15202024-11-02T06:31:48.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15212024-11-02T06:31:48.031ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
15222024-11-02T06:31:48.031ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.025446ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
15232024-11-02T06:31:48.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15242024-11-02T06:31:48.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15252024-11-02T06:31:48.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 92.132909ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15262024-11-02T06:31:48.038ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15272024-11-02T06:31:48.038ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15282024-11-02T06:31:48.038ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15292024-11-02T06:31:48.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15302024-11-02T06:31:48.038ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15312024-11-02T06:31:48.039ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15322024-11-02T06:31:48.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15332024-11-02T06:31:48.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15342024-11-02T06:31:48.041ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15352024-11-02T06:31:48.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15362024-11-02T06:31:48.042ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15372024-11-02T06:31:48.042ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15382024-11-02T06:31:48.042ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15392024-11-02T06:31:48.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15402024-11-02T06:31:48.044ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15412024-11-02T06:31:48.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15422024-11-02T06:31:48.046ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15432024-11-02T06:31:48.046ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15442024-11-02T06:31:48.046ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15452024-11-02T06:31:48.046ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15462024-11-02T06:31:48.046ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 100.7979ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15472024-11-02T06:31:48.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15482024-11-02T06:31:48.047ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15492024-11-02T06:31:48.047ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 100.997683ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15502024-11-02T06:31:48.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15512024-11-02T06:31:48.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e910c408-e8f8-499f-81a3-43816eb138fc, lookup_type: ById(e910c408-e8f8-499f-81a3-43816eb138fc) } result = Ok(())
15522024-11-02T06:31:48.049ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15532024-11-02T06:31:48.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15542024-11-02T06:31:48.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15552024-11-02T06:31:48.050ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15562024-11-02T06:31:48.050ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15572024-11-02T06:31:48.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15582024-11-02T06:31:48.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15592024-11-02T06:31:48.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15602024-11-02T06:31:48.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15612024-11-02T06:31:48.053ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15622024-11-02T06:31:48.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15632024-11-02T06:31:48.054ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 108.540304ms iteration = 25 status = 0
15642024-11-02T06:31:48.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15652024-11-02T06:31:48.055ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15662024-11-02T06:31:48.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15672024-11-02T06:31:48.056ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 110.005461ms iteration = 6 status = {"nsuccess":5}
15682024-11-02T06:31:48.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15692024-11-02T06:31:48.059ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15702024-11-02T06:31:48.059ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ebec6ef1-d036-4e17-8eb7-453f158dbe5b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15712024-11-02T06:31:48.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15722024-11-02T06:31:48.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15732024-11-02T06:31:48.060ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15742024-11-02T06:31:48.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15752024-11-02T06:31:48.062ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15762024-11-02T06:31:48.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15772024-11-02T06:31:48.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15782024-11-02T06:31:48.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15792024-11-02T06:31:48.079ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 133.944045ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15802024-11-02T06:31:48.086ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15812024-11-02T06:31:48.086ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15822024-11-02T06:31:48.086ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.310833ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15832024-11-02T06:31:48.097ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15842024-11-02T06:31:48.097ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15852024-11-02T06:31:48.097ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15862024-11-02T06:31:48.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15872024-11-02T06:31:48.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15882024-11-02T06:31:48.104ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
15892024-11-02T06:31:48.104ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15902024-11-02T06:31:48.105ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81511f48-19d5-4bd9-85c9-fda106a3e39a", "content-length": "26", "date": "Sat, 02 Nov 2024 06:31:48 GMT"} })
15912024-11-02T06:31:48.105ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15922024-11-02T06:31:48.106ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15932024-11-02T06:31:48.110ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15942024-11-02T06:31:48.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15952024-11-02T06:31:48.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15962024-11-02T06:31:48.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a501e7f2-2a2f-480d-a2f1-d40540c10f01 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
15972024-11-02T06:31:48.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a501e7f2-2a2f-480d-a2f1-d40540c10f01 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
15982024-11-02T06:31:48.149ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
15992024-11-02T06:31:48.172ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
16002024-11-02T06:31:48.172ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16012024-11-02T06:31:48.172ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e0850e3-63f3-44c3-a596-1307dcca8a4e", "content-length": "26", "date": "Sat, 02 Nov 2024 06:31:48 GMT"} })
16022024-11-02T06:31:48.172ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16032024-11-02T06:31:48.175ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16042024-11-02T06:31:48.286ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16052024-11-02T06:31:48.287ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2f9d1d5-7ef8-4757-973d-03e4a3e7d2b2", "content-length": "1", "date": "Sat, 02 Nov 2024 06:31:47 GMT"} })
16062024-11-02T06:31:48.289ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16072024-11-02T06:31:48.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16082024-11-02T06:31:48.309ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 zone_address = fd00:1122:3344:101::2
16092024-11-02T06:31:48.309ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16102024-11-02T06:31:48.309ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ab92a06-76e1-4a89-9bc6-ac9a89325077", "content-length": "26", "date": "Sat, 02 Nov 2024 06:31:48 GMT"} })
16112024-11-02T06:31:48.309ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16122024-11-02T06:31:48.311ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
16132024-11-02T06:31:48.338ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16142024-11-02T06:31:48.338ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16152024-11-02T06:31:48.339ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab9b5e67-e3a5-45be-a723-bfb6eee176ef", "content-length": "372", "date": "Sat, 02 Nov 2024 06:31:47 GMT"} })
16162024-11-02T06:31:48.339ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16172024-11-02T06:31:48.339ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 393.280757ms iteration = 25 status = {}
16182024-11-02T06:31:48.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16192024-11-02T06:31:48.342ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16202024-11-02T06:31:48.345ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16212024-11-02T06:31:48.345ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16222024-11-02T06:31:48.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16232024-11-02T06:31:48.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 224695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a501e7f2-2a2f-480d-a2f1-d40540c10f01 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
16242024-11-02T06:31:48.348ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 402.06533ms iteration = 25 status = null
16252024-11-02T06:31:48.354ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ebec6ef1-d036-4e17-8eb7-453f158dbe5b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
16262024-11-02T06:31:48.354ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
16272024-11-02T06:31:48.354ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 06:20:14.397898 UTC dns_group = internal generation = 1
16282024-11-02T06:31:48.354ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 408.382928ms iteration = 14 status = {"generation":1}
16292024-11-02T06:31:48.362ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
16302024-11-02T06:31:48.362ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b4512d38-a655-4e8b-85ad-414bb0315ffa", "date": "Sat, 02 Nov 2024 06:31:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16312024-11-02T06:31:48.362ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16322024-11-02T06:31:48.364ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5d223f57-ad56-4972-aa12-6feb18710c7f", "date": "Sat, 02 Nov 2024 06:31:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16332024-11-02T06:31:48.364ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16342024-11-02T06:31:48.366ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16352024-11-02T06:31:48.366ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 420.351329ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16362024-11-02T06:31:48.371ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
16372024-11-02T06:31:48.372ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
16382024-11-02T06:31:48.372ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16392024-11-02T06:31:48.372ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "84848f74-a5a8-47f0-9692-1d8ee0fa62c2", "date": "Sat, 02 Nov 2024 06:31:47 GMT"} })
16402024-11-02T06:31:48.372ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16412024-11-02T06:31:48.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16422024-11-02T06:31:48.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16432024-11-02T06:31:48.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16442024-11-02T06:31:48.380ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16452024-11-02T06:31:48.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16462024-11-02T06:31:48.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16472024-11-02T06:31:48.382ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16482024-11-02T06:31:48.382ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16492024-11-02T06:31:48.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16502024-11-02T06:31:48.384ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16512024-11-02T06:31:48.385ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16522024-11-02T06:31:48.385ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16532024-11-02T06:31:48.385ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1f264a35-9113-46eb-8159-0745efe5b9e9", "date": "Sat, 02 Nov 2024 06:31:47 GMT"} })
16542024-11-02T06:31:48.386ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16552024-11-02T06:31:48.386ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16562024-11-02T06:31:48.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16572024-11-02T06:31:48.387ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 442.065872ms iteration = 26 status = {}
16582024-11-02T06:31:48.388ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16592024-11-02T06:31:48.390ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16602024-11-02T06:31:48.390ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16612024-11-02T06:31:48.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16622024-11-02T06:31:48.398ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16632024-11-02T06:31:48.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16642024-11-02T06:31:48.401ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16652024-11-02T06:31:48.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16662024-11-02T06:31:48.421ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16672024-11-02T06:31:48.421ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "11aaa5b4-7036-483c-af99-b4bcbd8c9d8d", "date": "Sat, 02 Nov 2024 06:31:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16682024-11-02T06:31:48.421ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16692024-11-02T06:31:48.423ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d2728481-1078-431d-9525-877805f92f72", "date": "Sat, 02 Nov 2024 06:31:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16702024-11-02T06:31:48.423ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16712024-11-02T06:31:48.426ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "765f7b55-ccf1-4486-b603-7725f6744d2a", "date": "Sat, 02 Nov 2024 06:31:48 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16722024-11-02T06:31:48.426ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16732024-11-02T06:31:48.428ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16742024-11-02T06:31:48.428ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 482.677695ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16752024-11-02T06:31:48.430ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T06:19:46.120247Z, time_modified: 2024-11-02T06:19:46.120247Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 59403eed-26d3-491e-a214-3ec0c7b10fb5, db_silo: Silo { identity: SiloIdentity { id: 59403eed-26d3-491e-a214-3ec0c7b10fb5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T06:20:14.941312Z, time_modified: 2024-11-02T06:20:14.941312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a5838a91006fb28d0b2bb1e66d2941fc0e90d5e4733e0b81cfebd701af94c573" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 59403eed-26d3-491e-a214-3ec0c7b10fb5, db_silo: Silo { identity: SiloIdentity { id: 59403eed-26d3-491e-a214-3ec0c7b10fb5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T06:20:14.941312Z, time_modified: 2024-11-02T06:20:14.941312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a5838a91006fb28d0b2bb1e66d2941fc0e90d5e4733e0b81cfebd701af94c573" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
16762024-11-02T06:31:48.430ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 484.723764ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"59403eed-26d3-491e-a214-3ec0c7b10fb5","tls_certs":["a5838a91006fb28d0b2bb1e66d2941fc0e90d5e4733e0b81cfebd701af94c573"]}},"default_endpoint":{"silo_id":"59403eed-26d3-491e-a214-3ec0c7b10fb5","tls_certs":["a5838a91006fb28d0b2bb1e66d2941fc0e90d5e4733e0b81cfebd701af94c573"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
16772024-11-02T06:31:48.439ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16782024-11-02T06:31:48.439ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3492129c-7012-4d01-9997-b73cc054da28 dns_zone_name = oxide.test found_so_far = 0 version = 2
16792024-11-02T06:31:48.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16802024-11-02T06:31:48.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16812024-11-02T06:31:48.456ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 510.758696ms iteration = 29 status = {"physical_disks_added":0}
16822024-11-02T06:31:48.470ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
16832024-11-02T06:31:48.470ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 524.082944ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
16842024-11-02T06:31:48.484ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16852024-11-02T06:31:48.488ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16862024-11-02T06:31:48.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16872024-11-02T06:31:48.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16882024-11-02T06:31:48.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16892024-11-02T06:31:48.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16902024-11-02T06:31:48.527ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16912024-11-02T06:31:48.529ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3492129c-7012-4d01-9997-b73cc054da28 dns_zone_name = oxide.test found_so_far = 1 version = 2
16922024-11-02T06:31:48.529ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16932024-11-02T06:31:48.529ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 06:20:14.983012 UTC dns_group = external generation = 2
16942024-11-02T06:31:48.529ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 583.572238ms iteration = 14 status = {"generation":2}
16952024-11-02T06:31:48.529ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 29c3f6a1-2034-455b-bc3b-3fbebec1d7c1, rack_id: a9cb4975-e69e-4875-af6f-759c07abd8a8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(72902c82-00a8-446a-b727-41c9c8c92f9b) } rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0
16962024-11-02T06:31:48.529ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16972024-11-02T06:31:48.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16982024-11-02T06:31:48.538ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16992024-11-02T06:31:48.538ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ef74102-ad11-41e5-aea7-1e80c76293b1", "content-length": "134", "date": "Sat, 02 Nov 2024 06:31:47 GMT"} })
17002024-11-02T06:31:48.538ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17012024-11-02T06:31:48.538ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 72902c82-00a8-446a-b727-41c9c8c92f9b
17022024-11-02T06:31:48.538ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17032024-11-02T06:31:48.538ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17042024-11-02T06:31:48.538ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17052024-11-02T06:31:48.538ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17062024-11-02T06:31:48.538ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17072024-11-02T06:31:48.538ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17082024-11-02T06:31:48.539ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17092024-11-02T06:31:48.539ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17102024-11-02T06:31:48.539ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
17112024-11-02T06:31:48.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17122024-11-02T06:31:48.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17132024-11-02T06:31:48.541ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17142024-11-02T06:31:48.541ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3fe9ece-71e5-40b2-8345-58c3f0018448", "content-length": "2", "date": "Sat, 02 Nov 2024 06:31:47 GMT"} })
17152024-11-02T06:31:48.541ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17162024-11-02T06:31:48.541ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "764eb0da-763d-4dc1-a3e4-aaf54bbd185e", "content-length": "52", "date": "Sat, 02 Nov 2024 06:31:47 GMT"} })
17172024-11-02T06:31:48.541ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0
17182024-11-02T06:31:48.541ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17192024-11-02T06:31:48.644ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4a464d7-1f21-4bf4-9288-ab2531cdde58", "content-length": "691", "date": "Sat, 02 Nov 2024 06:31:47 GMT"} })
17202024-11-02T06:31:48.644ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
17212024-11-02T06:31:48.644ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
17222024-11-02T06:31:48.644ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
17232024-11-02T06:31:48.646ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 700.381535ms iteration = 25 status = {}
17242024-11-02T06:31:48.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "602b0ebf-eed0-4d94-8724-8470c329e62e", "date": "Sat, 02 Nov 2024 06:31:47 GMT"} })
17252024-11-02T06:31:48.755ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch = Switch0
17262024-11-02T06:31:48.755ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17272024-11-02T06:31:48.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a7dd23b-a98d-447e-a47e-58483d8025ca", "content-length": "682", "date": "Sat, 02 Nov 2024 06:31:47 GMT"} })
17282024-11-02T06:31:48.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17292024-11-02T06:31:48.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17302024-11-02T06:31:48.760ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17312024-11-02T06:31:48.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17322024-11-02T06:31:48.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17332024-11-02T06:31:48.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17342024-11-02T06:31:48.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17352024-11-02T06:31:48.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17362024-11-02T06:31:48.772ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 826.356423ms iteration = 25 status = {}
17372024-11-02T06:31:49.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 420616b9-f7b3-44f4-ba7b-8409b8b90cbd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17382024-11-02T06:31:49.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 420616b9-f7b3-44f4-ba7b-8409b8b90cbd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17392024-11-02T06:31:49.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 420616b9-f7b3-44f4-ba7b-8409b8b90cbd response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17402024-11-02T06:31:49.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fe1a95f9-0677-44ba-bab7-2212a8cb6bc7 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17412024-11-02T06:31:49.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fe1a95f9-0677-44ba-bab7-2212a8cb6bc7 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17422024-11-02T06:31:49.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fe1a95f9-0677-44ba-bab7-2212a8cb6bc7 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17432024-11-02T06:31:49.398ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1838 local_addr = [fd00:1122:3344:101::c]:45423 method = GET remote_addr = [fd00:1122:3344:101::d]:54698 req_id = 191dc261-f58a-4999-98ca-4e54b447ea2d response_code = 200 uri = /0b0286d1-4696-4dd6-a80e-495d344ae645
17442024-11-02T06:31:50.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 92bfd2f3-0c41-446d-89ca-dc7a8c31c031 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17452024-11-02T06:31:50.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 92bfd2f3-0c41-446d-89ca-dc7a8c31c031 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17462024-11-02T06:31:50.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 92bfd2f3-0c41-446d-89ca-dc7a8c31c031 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17472024-11-02T06:31:51.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d24fca51-b2e6-49b6-83db-2c158e8b6f73 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17482024-11-02T06:31:51.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d24fca51-b2e6-49b6-83db-2c158e8b6f73 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17492024-11-02T06:31:51.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d24fca51-b2e6-49b6-83db-2c158e8b6f73 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17502024-11-02T06:31:52.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = bd35b246-3314-40f9-bf97-ba50611a7350 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
17512024-11-02T06:31:52.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = bd35b246-3314-40f9-bf97-ba50611a7350 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
17522024-11-02T06:31:52.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 5950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = bd35b246-3314-40f9-bf97-ba50611a7350 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
17532024-11-02T06:31:52.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 1f8c57d0-9480-4ad4-a4b3-9cf4b0e98cef roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
17542024-11-02T06:31:52.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 1f8c57d0-9480-4ad4-a4b3-9cf4b0e98cef resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
17552024-11-02T06:31:52.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 4884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 1f8c57d0-9480-4ad4-a4b3-9cf4b0e98cef response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
17562024-11-02T06:31:52.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5b73d624-c08f-429a-beba-880dc29c461d roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17572024-11-02T06:31:52.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5b73d624-c08f-429a-beba-880dc29c461d resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17582024-11-02T06:31:52.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5b73d624-c08f-429a-beba-880dc29c461d response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17592024-11-02T06:31:53.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 506512d1-4314-495c-9092-3bd707c818ab roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17602024-11-02T06:31:53.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 506512d1-4314-495c-9092-3bd707c818ab resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17612024-11-02T06:31:53.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 506512d1-4314-495c-9092-3bd707c818ab response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17622024-11-02T06:31:54.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 194f0bf5-ec91-47f9-b2e1-e056583fcc3b roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17632024-11-02T06:31:54.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 194f0bf5-ec91-47f9-b2e1-e056583fcc3b resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17642024-11-02T06:31:54.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 194f0bf5-ec91-47f9-b2e1-e056583fcc3b response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17652024-11-02T06:31:55.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e6ca81c0-cfa7-4840-9bc8-99af25d84844 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17662024-11-02T06:31:55.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e6ca81c0-cfa7-4840-9bc8-99af25d84844 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17672024-11-02T06:31:55.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e6ca81c0-cfa7-4840-9bc8-99af25d84844 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17682024-11-02T06:31:56.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9e9bc8bd-230a-4db9-a55d-3d536ad24e2f roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17692024-11-02T06:31:56.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9e9bc8bd-230a-4db9-a55d-3d536ad24e2f resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17702024-11-02T06:31:56.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9e9bc8bd-230a-4db9-a55d-3d536ad24e2f response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17712024-11-02T06:31:57.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4a5d5983-3a75-4236-b7f4-9081c273553e roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17722024-11-02T06:31:57.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4a5d5983-3a75-4236-b7f4-9081c273553e resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17732024-11-02T06:31:57.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4a5d5983-3a75-4236-b7f4-9081c273553e response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17742024-11-02T06:31:57.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
17752024-11-02T06:31:57.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
17762024-11-02T06:31:57.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17772024-11-02T06:31:57.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17782024-11-02T06:31:57.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17792024-11-02T06:31:57.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17802024-11-02T06:31:57.947ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17812024-11-02T06:31:57.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17822024-11-02T06:31:57.948ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17832024-11-02T06:31:57.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17842024-11-02T06:31:57.951ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17852024-11-02T06:31:57.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17862024-11-02T06:31:57.953ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17872024-11-02T06:31:57.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17882024-11-02T06:31:57.954ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17892024-11-02T06:31:57.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
17902024-11-02T06:31:57.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17912024-11-02T06:31:57.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17922024-11-02T06:31:57.964ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
17932024-11-02T06:31:57.964ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.770099ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
17942024-11-02T06:31:57.977ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.27994ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17952024-11-02T06:31:58.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = bde867bf-6ec1-4b11-935e-0aebe506725b roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17962024-11-02T06:31:58.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = bde867bf-6ec1-4b11-935e-0aebe506725b resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17972024-11-02T06:31:58.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = bde867bf-6ec1-4b11-935e-0aebe506725b response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
17982024-11-02T06:31:58.950ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c8b6477e-662b-47a0-ae13-e369c00a8395 remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 725735ff-e560-42a2-8686-226ee2e3efdc uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-02T06:31:58.945311302Z }
17992024-11-02T06:31:58.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 725735ff-e560-42a2-8686-226ee2e3efdc roles = RoleSet { roles: {} } uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18002024-11-02T06:31:58.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 725735ff-e560-42a2-8686-226ee2e3efdc resource = Database result = Ok(()) uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18012024-11-02T06:31:58.977ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:51315
18022024-11-02T06:31:58.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:51315 req_id = c2cc1786-1f1b-47b2-9fbd-b521b08fd7ba roles = RoleSet { roles: {} } uri = /metrics/producers
18032024-11-02T06:31:58.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:51315 req_id = c2cc1786-1f1b-47b2-9fbd-b521b08fd7ba resource = Database result = Ok(()) uri = /metrics/producers
18042024-11-02T06:31:58.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43923 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 725735ff-e560-42a2-8686-226ee2e3efdc response_code = 204 uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18052024-11-02T06:31:58.990ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c8b6477e-662b-47a0-ae13-e369c00a8395 remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 01e6312c-47e6-4ce8-9701-2adc84896469 uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-02T06:31:58.989845949Z }
18062024-11-02T06:31:58.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 01e6312c-47e6-4ce8-9701-2adc84896469 roles = RoleSet { roles: {} } uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18072024-11-02T06:31:58.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 01e6312c-47e6-4ce8-9701-2adc84896469 resource = Database result = Ok(()) uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18082024-11-02T06:31:58.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8276 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 01e6312c-47e6-4ce8-9701-2adc84896469 response_code = 204 uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18092024-11-02T06:31:59.013ZINFOnexus: assigned collector to new producer collector_id = 13175a5b-eed9-4b10-bbf4-9e75d4d6ef03 file = nexus/src/app/oximeter.rs:76 producer_id = f5b46622-8c46-4c9d-89de-c83240f68643
18102024-11-02T06:31:59.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35631 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:51315 req_id = c2cc1786-1f1b-47b2-9fbd-b521b08fd7ba response_code = 201 uri = /metrics/producers
18112024-11-02T06:31:59.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1f19f773-3f7e-4893-92be-ac6a4aab31b2 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18122024-11-02T06:31:59.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1f19f773-3f7e-4893-92be-ac6a4aab31b2 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18132024-11-02T06:31:59.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1f19f773-3f7e-4893-92be-ac6a4aab31b2 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18142024-11-02T06:32:00.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d5456bb5-cfaa-43a7-8d5b-9318819e47b5 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18152024-11-02T06:32:00.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d5456bb5-cfaa-43a7-8d5b-9318819e47b5 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18162024-11-02T06:32:00.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d5456bb5-cfaa-43a7-8d5b-9318819e47b5 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18172024-11-02T06:32:01.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d8e16e20-4fad-4f1c-8cb9-03f0f3513c2b roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18182024-11-02T06:32:01.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d8e16e20-4fad-4f1c-8cb9-03f0f3513c2b resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18192024-11-02T06:32:01.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d8e16e20-4fad-4f1c-8cb9-03f0f3513c2b response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18202024-11-02T06:32:02.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0f2b01af-33be-4e2e-9129-8a4b3489fbfc roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18212024-11-02T06:32:02.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0f2b01af-33be-4e2e-9129-8a4b3489fbfc resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18222024-11-02T06:32:02.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0f2b01af-33be-4e2e-9129-8a4b3489fbfc response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18232024-11-02T06:32:03.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b4e366cc-f3e2-4df6-9b64-4f9981d55077 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18242024-11-02T06:32:03.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b4e366cc-f3e2-4df6-9b64-4f9981d55077 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18252024-11-02T06:32:03.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b4e366cc-f3e2-4df6-9b64-4f9981d55077 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18262024-11-02T06:32:04.399ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1724 local_addr = [fd00:1122:3344:101::c]:45423 method = GET remote_addr = [fd00:1122:3344:101::d]:54698 req_id = 17229268-78b9-44c7-b3cf-c592f18942ee response_code = 200 uri = /0b0286d1-4696-4dd6-a80e-495d344ae645
18272024-11-02T06:32:04.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = bdb3d92c-7be6-4ce5-9864-6ab309e8fbb6 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18282024-11-02T06:32:04.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = bdb3d92c-7be6-4ce5-9864-6ab309e8fbb6 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18292024-11-02T06:32:04.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = bdb3d92c-7be6-4ce5-9864-6ab309e8fbb6 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18302024-11-02T06:32:05.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d156ca17-56c7-4e42-81ae-8f166a56fab3 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18312024-11-02T06:32:05.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d156ca17-56c7-4e42-81ae-8f166a56fab3 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18322024-11-02T06:32:05.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d156ca17-56c7-4e42-81ae-8f166a56fab3 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18332024-11-02T06:32:06.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1f083b79-e133-49de-88c2-df26fef0eb67 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18342024-11-02T06:32:06.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1f083b79-e133-49de-88c2-df26fef0eb67 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18352024-11-02T06:32:06.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1f083b79-e133-49de-88c2-df26fef0eb67 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18362024-11-02T06:32:07.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e64a7712-9de4-44f2-b930-1a65ea20329f roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18372024-11-02T06:32:07.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e64a7712-9de4-44f2-b930-1a65ea20329f resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18382024-11-02T06:32:07.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1793 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e64a7712-9de4-44f2-b930-1a65ea20329f response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18392024-11-02T06:32:07.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
18402024-11-02T06:32:07.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
18412024-11-02T06:32:07.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18422024-11-02T06:32:07.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18432024-11-02T06:32:07.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18442024-11-02T06:32:07.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18452024-11-02T06:32:07.947ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18462024-11-02T06:32:07.949ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18472024-11-02T06:32:07.949ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18482024-11-02T06:32:07.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18492024-11-02T06:32:07.951ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18502024-11-02T06:32:07.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18512024-11-02T06:32:07.953ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18522024-11-02T06:32:07.955ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
18532024-11-02T06:32:07.955ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18542024-11-02T06:32:07.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18552024-11-02T06:32:07.967ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
18562024-11-02T06:32:07.967ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.752943ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
18572024-11-02T06:32:07.974ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18582024-11-02T06:32:07.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18592024-11-02T06:32:08.001ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.354616ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18602024-11-02T06:32:08.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = eb9a0420-6a0c-4e6e-84ea-712bcc5f5e8a roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18612024-11-02T06:32:08.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = eb9a0420-6a0c-4e6e-84ea-712bcc5f5e8a resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18622024-11-02T06:32:08.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = eb9a0420-6a0c-4e6e-84ea-712bcc5f5e8a response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18632024-11-02T06:32:09.270ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c8b6477e-662b-47a0-ae13-e369c00a8395 remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ad28dc2d-63c2-4cfc-a405-cdd435f61678 uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-02T06:32:09.270621098Z }
18642024-11-02T06:32:09.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ad28dc2d-63c2-4cfc-a405-cdd435f61678 roles = RoleSet { roles: {} } uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18652024-11-02T06:32:09.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ad28dc2d-63c2-4cfc-a405-cdd435f61678 resource = Database result = Ok(()) uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18662024-11-02T06:32:09.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36033 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ad28dc2d-63c2-4cfc-a405-cdd435f61678 response_code = 204 uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18672024-11-02T06:32:09.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 196fa062-e998-4576-ad6a-e12bb3b9156f roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18682024-11-02T06:32:09.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 196fa062-e998-4576-ad6a-e12bb3b9156f resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18692024-11-02T06:32:09.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 196fa062-e998-4576-ad6a-e12bb3b9156f response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18702024-11-02T06:32:10.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 7caa3e89-635b-46ea-9a36-37a468468c65 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
18712024-11-02T06:32:10.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 7caa3e89-635b-46ea-9a36-37a468468c65 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
18722024-11-02T06:32:10.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 7caa3e89-635b-46ea-9a36-37a468468c65 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
18732024-11-02T06:32:10.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 9ef79129-808b-49fe-a655-7f5c9c9e7ecf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
18742024-11-02T06:32:10.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 9ef79129-808b-49fe-a655-7f5c9c9e7ecf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
18752024-11-02T06:32:10.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 9ef79129-808b-49fe-a655-7f5c9c9e7ecf response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
18762024-11-02T06:32:10.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4c070f5e-4958-4bc6-9226-0b6f6b9253d0 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18772024-11-02T06:32:10.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4c070f5e-4958-4bc6-9226-0b6f6b9253d0 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18782024-11-02T06:32:10.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4c070f5e-4958-4bc6-9226-0b6f6b9253d0 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
18792024-11-02T06:32:11.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 458a6b4d-9b84-4a8c-8752-c1f249a01eea roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
18802024-11-02T06:32:11.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 458a6b4d-9b84-4a8c-8752-c1f249a01eea resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
18812024-11-02T06:32:11.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 458a6b4d-9b84-4a8c-8752-c1f249a01eea response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
18822024-11-02T06:32:11.753ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c8b6477e-662b-47a0-ae13-e369c00a8395 remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-02T06:32:11.753205430Z }
18832024-11-02T06:32:11.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d roles = RoleSet { roles: {} } uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18842024-11-02T06:32:11.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d resource = Database result = Ok(()) uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18852024-11-02T06:32:11.765ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = c8b6477e-662b-47a0-ae13-e369c00a8395 remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395 vmm_needs_update = true
18862024-11-02T06:32:11.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d roles = RoleSet { roles: {} } uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18872024-11-02T06:32:11.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d resource = Database result = Ok(()) uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18882024-11-02T06:32:11.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d roles = RoleSet { roles: {} } uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18892024-11-02T06:32:11.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d resource = Database result = Ok(()) uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18902024-11-02T06:32:11.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d roles = RoleSet { roles: {} } uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18912024-11-02T06:32:11.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d resource = Database result = Ok(()) uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18922024-11-02T06:32:11.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d roles = RoleSet { roles: {} } uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18932024-11-02T06:32:11.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d resource = Database result = Ok(()) uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18942024-11-02T06:32:11.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d roles = RoleSet { roles: {} } uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18952024-11-02T06:32:11.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d resource = Database result = Ok(()) uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18962024-11-02T06:32:11.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d roles = RoleSet { roles: {} } uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18972024-11-02T06:32:11.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d resource = Database result = Ok(()) uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18982024-11-02T06:32:11.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
18992024-11-02T06:32:11.781ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 59403eed-26d3-491e-a214-3ec0c7b10fb5, lookup_type: ById(59403eed-26d3-491e-a214-3ec0c7b10fb5) }, key: 574f74f1-759f-449e-8cb7-cbd42019766e, lookup_type: ById(574f74f1-759f-449e-8cb7-cbd42019766e) }, key: f5b46622-8c46-4c9d-89de-c83240f68643, lookup_type: ById(f5b46622-8c46-4c9d-89de-c83240f68643) } result = Ok(()) uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
19002024-11-02T06:32:11.781ZINFOnexus (dropshot_internal): starting update saga for f5b46622-8c46-4c9d-89de-c83240f68643 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1618 instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-02T06:32:11.753205430Z }
19012024-11-02T06:32:11.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 27603 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d response_code = 204 uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
19022024-11-02T06:32:11.781ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = c8b6477e-662b-47a0-ae13-e369c00a8395 remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 2e116834-c2c8-4e2a-b4d9-706f620e0bef uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-02T06:32:11.753205430Z }
19032024-11-02T06:32:11.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 2e116834-c2c8-4e2a-b4d9-706f620e0bef roles = RoleSet { roles: {} } uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
19042024-11-02T06:32:11.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 2e116834-c2c8-4e2a-b4d9-706f620e0bef resource = Database result = Ok(()) uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
19052024-11-02T06:32:11.783ZDEBGnexus (dropshot_internal): preparing instance-update saga for f5b46622-8c46-4c9d-89de-c83240f68643... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c8f1ac52-3c97-499c-9374-2e3f5471b43d uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
19062024-11-02T06:32:11.783ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update
19072024-11-02T06:32:11.783ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"f5b46622-8c46-4c9d-89de-c83240f68643","lookup_type":{"ById":"f5b46622-8c46-4c9d-89de-c83240f68643"},"parent":{"key":"574f74f1-759f-449e-8cb7-cbd42019766e","lookup_type":{"ById":"574f74f1-759f-449e-8cb7-cbd42019766e"},"parent":{"key":"59403eed-26d3-491e-a214-3ec0c7b10fb5","lookup_type":{"ById":"59403eed-26d3-491e-a214-3ec0c7b10fb5"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19082024-11-02T06:32:11.783ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update
19092024-11-02T06:32:11.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31930 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 2e116834-c2c8-4e2a-b4d9-706f620e0bef response_code = 204 uri = /vmms/c8b6477e-662b-47a0-ae13-e369c00a8395
19102024-11-02T06:32:11.815ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update
19112024-11-02T06:32:11.815ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19122024-11-02T06:32:11.815ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19132024-11-02T06:32:11.815ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0
19142024-11-02T06:32:11.821ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19152024-11-02T06:32:11.821ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0
19162024-11-02T06:32:11.826ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19172024-11-02T06:32:11.826ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0
19182024-11-02T06:32:11.831ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19192024-11-02T06:32:11.831ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("78b00013-859c-4685-9202-6b6eb9da01ac")) node_id = 0 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0
19202024-11-02T06:32:11.835ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19212024-11-02T06:32:11.835ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0
19222024-11-02T06:32:11.845ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update
19232024-11-02T06:32:11.845ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19242024-11-02T06:32:11.845ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19252024-11-02T06:32:11.849ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19262024-11-02T06:32:11.849ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19272024-11-02T06:32:11.851ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19282024-11-02T06:32:11.851ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19292024-11-02T06:32:11.855ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19302024-11-02T06:32:11.855ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19312024-11-02T06:32:11.857ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19322024-11-02T06:32:11.857ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19332024-11-02T06:32:11.858ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19342024-11-02T06:32:11.858ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19352024-11-02T06:32:11.860ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19362024-11-02T06:32:11.863ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 59403eed-26d3-491e-a214-3ec0c7b10fb5, lookup_type: ById(59403eed-26d3-491e-a214-3ec0c7b10fb5) }, key: 574f74f1-759f-449e-8cb7-cbd42019766e, lookup_type: ById(574f74f1-759f-449e-8cb7-cbd42019766e) }, key: f5b46622-8c46-4c9d-89de-c83240f68643, lookup_type: ById(f5b46622-8c46-4c9d-89de-c83240f68643) } result = Ok(()) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19372024-11-02T06:32:11.863ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance updater_id = 78b00013-859c-4685-9202-6b6eb9da01ac
19382024-11-02T06:32:11.863ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19392024-11-02T06:32:11.863ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19402024-11-02T06:32:11.875ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance updater_id = 78b00013-859c-4685-9202-6b6eb9da01ac
19412024-11-02T06:32:11.875ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19422024-11-02T06:32:11.875ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance
19432024-11-02T06:32:11.882ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 locked_gen = Generation(Generation(2)) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = LockInstance updater_id = 78b00013-859c-4685-9202-6b6eb9da01ac
19442024-11-02T06:32:11.882ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19452024-11-02T06:32:11.882ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("78b00013-859c-4685-9202-6b6eb9da01ac")}) node_id = 1 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0
19462024-11-02T06:32:11.885ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19472024-11-02T06:32:11.885ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0
19482024-11-02T06:32:11.891ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19492024-11-02T06:32:11.891ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19502024-11-02T06:32:11.893ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19512024-11-02T06:32:11.893ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19522024-11-02T06:32:11.894ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19532024-11-02T06:32:11.894ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19542024-11-02T06:32:11.895ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19552024-11-02T06:32:11.898ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 59403eed-26d3-491e-a214-3ec0c7b10fb5, lookup_type: ById(59403eed-26d3-491e-a214-3ec0c7b10fb5) }, key: 574f74f1-759f-449e-8cb7-cbd42019766e, lookup_type: ById(574f74f1-759f-449e-8cb7-cbd42019766e) }, key: f5b46622-8c46-4c9d-89de-c83240f68643, lookup_type: ById(f5b46622-8c46-4c9d-89de-c83240f68643) } result = Ok(()) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19562024-11-02T06:32:11.898ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19572024-11-02T06:32:11.899ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
19582024-11-02T06:32:11.906ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: c8b6477e-662b-47a0-ae13-e369c00a8395, time_created: 2024-11-02T06:31:51.106905Z, time_deleted: None, instance_id: f5b46622-8c46-4c9d-89de-c83240f68643, sled_id: e910c408-e8f8-499f-81a3-43816eb138fc, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-02T06:32:11.753205Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-02T06:31:48.807397Z, gen: Generation(Generation(3)), propolis_id: Some(c8b6477e-662b-47a0-ae13-e369c00a8395), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(c8b6477e-662b-47a0-ae13-e369c00a8395 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-02T06:32:11.906196379Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
19592024-11-02T06:32:11.906ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
19602024-11-02T06:32:11.906ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"f5b46622-8c46-4c9d-89de-c83240f68643","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"c8b6477e-662b-47a0-ae13-e369c00a8395"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"f5b46622-8c46-4c9d-89de-c83240f68643","lookup_type":{"ById":"f5b46622-8c46-4c9d-89de-c83240f68643"},"parent":{"key":"574f74f1-759f-449e-8cb7-cbd42019766e","lookup_type":{"ById":"574f74f1-759f-449e-8cb7-cbd42019766e"},"parent":{"key":"59403eed-26d3-491e-a214-3ec0c7b10fb5","lookup_type":{"ById":"59403eed-26d3-491e-a214-3ec0c7b10fb5"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"78b00013-859c-4685-9202-6b6eb9da01ac"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"574f74f1-759f-449e-8cb7-cbd42019766e","ram_diff":1073741824},"destroy_active_vmm":"c8b6477e-662b-47a0-ae13-e369c00a8395","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-02T06:32:11.906196379Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19612024-11-02T06:32:11.906ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
19622024-11-02T06:32:11.909ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
19632024-11-02T06:32:11.909ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19642024-11-02T06:32:11.909ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19652024-11-02T06:32:11.909ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
19662024-11-02T06:32:11.913ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19672024-11-02T06:32:11.913ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
19682024-11-02T06:32:11.917ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19692024-11-02T06:32:11.917ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
19702024-11-02T06:32:11.920ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19712024-11-02T06:32:11.920ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("564d7119-8add-4130-8a55-791c4aeed1fc")) node_id = 0 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
19722024-11-02T06:32:11.923ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19732024-11-02T06:32:11.923ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
19742024-11-02T06:32:11.942ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 parent_lock = UpdaterLock { updater_id: 78b00013-859c-4685-9202-6b6eb9da01ac, locked_gen: Generation(Generation(2)) } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
19752024-11-02T06:32:11.942ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = BecomeUpdater
19762024-11-02T06:32:11.942ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = BecomeUpdater
19772024-11-02T06:32:11.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e6409d44-3d77-4a52-8f91-a6b9ad30aa57 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
19782024-11-02T06:32:11.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e6409d44-3d77-4a52-8f91-a6b9ad30aa57 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
19792024-11-02T06:32:11.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e6409d44-3d77-4a52-8f91-a6b9ad30aa57 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
19802024-11-02T06:32:11.964ZDEBGnexus (SagaExecutor): inherited lock from 78b00013-859c-4685-9202-6b6eb9da01ac to 564d7119-8add-4130-8a55-791c4aeed1fc actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 78b00013-859c-4685-9202-6b6eb9da01ac saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = BecomeUpdater updater_id = 564d7119-8add-4130-8a55-791c4aeed1fc
19812024-11-02T06:32:11.964ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
19822024-11-02T06:32:11.964ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19832024-11-02T06:32:11.964ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("564d7119-8add-4130-8a55-791c4aeed1fc")}) node_id = 1 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
19842024-11-02T06:32:11.969ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19852024-11-02T06:32:11.969ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
19862024-11-02T06:32:11.974ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19872024-11-02T06:32:11.974ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
19882024-11-02T06:32:11.979ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
19892024-11-02T06:32:11.979ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
19902024-11-02T06:32:11.987ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
19912024-11-02T06:32:11.989ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = f5b46622-8c46-4c9d-89de-c83240f68643
19922024-11-02T06:32:11.992ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = UpdateNetworkConfig
19932024-11-02T06:32:11.992ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = UpdateNetworkConfig
19942024-11-02T06:32:11.995ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = UpdateNetworkConfig
19952024-11-02T06:32:11.995ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = UpdateNetworkConfig
19962024-11-02T06:32:11.997ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
19972024-11-02T06:32:11.997ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = UpdateNetworkConfig
19982024-11-02T06:32:11.997ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = UpdateNetworkConfig
19992024-11-02T06:32:11.999ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
20002024-11-02T06:32:11.999ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
20012024-11-02T06:32:11.999ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
20022024-11-02T06:32:12.000ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
20032024-11-02T06:32:12.001ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
20042024-11-02T06:32:12.001ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
20052024-11-02T06:32:12.002ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
20062024-11-02T06:32:12.005ZDEBGnexus: notifying dendrite of updates instance_id = Some(f5b46622-8c46-4c9d-89de-c83240f68643 (instance)) switch = switch0
20072024-11-02T06:32:12.006ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5508, tv_nsec: 595625363 } })
20082024-11-02T06:32:12.006ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
20092024-11-02T06:32:12.037ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
20102024-11-02T06:32:12.037ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20112024-11-02T06:32:12.037ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de13878f-70cb-45c9-a036-33bf6b4fa60b", "content-length": "26", "date": "Sat, 02 Nov 2024 06:32:12 GMT"} })
20122024-11-02T06:32:12.037ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20132024-11-02T06:32:12.038ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20142024-11-02T06:32:12.067ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
20152024-11-02T06:32:12.067ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "68d9ddd7-683e-4d96-98e0-4f8284dc9334", "content-length": "4", "date": "Sat, 02 Nov 2024 06:32:11 GMT"} })
20162024-11-02T06:32:12.069ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20172024-11-02T06:32:12.069ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20182024-11-02T06:32:12.075ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20192024-11-02T06:32:12.075ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20202024-11-02T06:32:12.080ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = ReleaseVirtualProvisioning
20212024-11-02T06:32:12.080ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = ReleaseVirtualProvisioning
20222024-11-02T06:32:12.099ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-02T06:32:12.083619Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 574f74f1-759f-449e-8cb7-cbd42019766e, time_modified: Some(2024-11-02T06:32:12.083619Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 59403eed-26d3-491e-a214-3ec0c7b10fb5, time_modified: Some(2024-11-02T06:32:12.083619Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
20232024-11-02T06:32:12.099ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20242024-11-02T06:32:12.099ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20252024-11-02T06:32:12.103ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20262024-11-02T06:32:12.103ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20272024-11-02T06:32:12.106ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
20282024-11-02T06:32:12.106ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = UnassignOximeterProducer
20292024-11-02T06:32:12.107ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = UnassignOximeterProducer
20302024-11-02T06:32:12.113ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 13175a5b-eed9-4b10-bbf4-9e75d4d6ef03 producer_id = f5b46622-8c46-4c9d-89de-c83240f68643 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
20312024-11-02T06:32:12.113ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = UnassignOximeterProducer
20322024-11-02T06:32:12.113ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = UnassignOximeterProducer
20332024-11-02T06:32:12.148ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:261 id = f5b46622-8c46-4c9d-89de-c83240f68643 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
20342024-11-02T06:32:12.151ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = f5b46622-8c46-4c9d-89de-c83240f68643 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/f5b46622-8c46-4c9d-89de-c83240f68643
20352024-11-02T06:32:12.170ZDEBGnexus (SagaExecutor): client response oximeter-collector = f5b46622-8c46-4c9d-89de-c83240f68643 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/f5b46622-8c46-4c9d-89de-c83240f68643", status: 204, headers: {"x-request-id": "88ec029b-36e7-4c56-88c2-c9d530c267fb", "date": "Sat, 02 Nov 2024 06:32:12 GMT"} }) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
20362024-11-02T06:32:12.170ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 13175a5b-eed9-4b10-bbf4-9e75d4d6ef03 producer_id = f5b46622-8c46-4c9d-89de-c83240f68643 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
20372024-11-02T06:32:12.172ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20382024-11-02T06:32:12.172ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20392024-11-02T06:32:12.176ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20402024-11-02T06:32:12.176ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20412024-11-02T06:32:12.180ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 lock = UpdaterLock { updater_id: 564d7119-8add-4130-8a55-791c4aeed1fc, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-02T06:32:11.906196379Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
20422024-11-02T06:32:12.180ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = CommitInstanceUpdates
20432024-11-02T06:32:12.180ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = CommitInstanceUpdates
20442024-11-02T06:32:12.216ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 new_runtime = InstanceRuntimeState { time_updated: 2024-11-02T06:32:11.906196379Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
20452024-11-02T06:32:12.216ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20462024-11-02T06:32:12.216ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20472024-11-02T06:32:12.216ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
20482024-11-02T06:32:12.216ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20492024-11-02T06:32:12.216ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
20502024-11-02T06:32:12.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20512024-11-02T06:32:12.216ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20522024-11-02T06:32:12.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20532024-11-02T06:32:12.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20542024-11-02T06:32:12.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20552024-11-02T06:32:12.220ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20562024-11-02T06:32:12.220ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20572024-11-02T06:32:12.221ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20582024-11-02T06:32:12.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20592024-11-02T06:32:12.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20602024-11-02T06:32:12.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20612024-11-02T06:32:12.223ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20622024-11-02T06:32:12.223ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("f5b46622-8c46-4c9d-89de-c83240f68643"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c8b6477e-662b-47a0-ae13-e369c00a8395")}) node_id = 7 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20632024-11-02T06:32:12.224ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20642024-11-02T06:32:12.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20652024-11-02T06:32:12.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20662024-11-02T06:32:12.227ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20672024-11-02T06:32:12.227ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20682024-11-02T06:32:12.230ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20692024-11-02T06:32:12.230ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20702024-11-02T06:32:12.236ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20712024-11-02T06:32:12.236ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20722024-11-02T06:32:12.242ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 propolis_id = c8b6477e-662b-47a0-ae13-e369c00a8395 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
20732024-11-02T06:32:12.242ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = ReleaseSledResources
20742024-11-02T06:32:12.242ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = ReleaseSledResources
20752024-11-02T06:32:12.247ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20762024-11-02T06:32:12.247ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20772024-11-02T06:32:12.250ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20782024-11-02T06:32:12.250ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20792024-11-02T06:32:12.253ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 propolis_id = c8b6477e-662b-47a0-ae13-e369c00a8395 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
20802024-11-02T06:32:12.253ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = MarkVmmDeleted
20812024-11-02T06:32:12.254ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = MarkVmmDeleted
20822024-11-02T06:32:12.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 31e3abea-1860-4bdb-9aca-4df4d67ceef3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
20832024-11-02T06:32:12.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 31e3abea-1860-4bdb-9aca-4df4d67ceef3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
20842024-11-02T06:32:12.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 31e3abea-1860-4bdb-9aca-4df4d67ceef3 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
20852024-11-02T06:32:12.291ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20862024-11-02T06:32:12.291ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20872024-11-02T06:32:12.295ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20882024-11-02T06:32:12.295ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20892024-11-02T06:32:12.298ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20902024-11-02T06:32:12.298ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
20912024-11-02T06:32:12.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20922024-11-02T06:32:12.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20932024-11-02T06:32:12.309ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
20942024-11-02T06:32:12.309ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20952024-11-02T06:32:12.310ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "21b10020-6aff-4be3-b8fd-8a55167a64c9", "content-length": "372", "date": "Sat, 02 Nov 2024 06:32:12 GMT"} })
20962024-11-02T06:32:12.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20972024-11-02T06:32:12.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20982024-11-02T06:32:12.313ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
20992024-11-02T06:32:12.313ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
21002024-11-02T06:32:12.317ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = ChainSuccessorSaga
21012024-11-02T06:32:12.317ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = ChainSuccessorSaga
21022024-11-02T06:32:12.317ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21032024-11-02T06:32:12.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21042024-11-02T06:32:12.318ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = ChainSuccessorSaga
21052024-11-02T06:32:12.318ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = ChainSuccessorSaga
21062024-11-02T06:32:12.319ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21072024-11-02T06:32:12.320ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = ChainSuccessorSaga
21082024-11-02T06:32:12.320ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = ChainSuccessorSaga
21092024-11-02T06:32:12.321ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21102024-11-02T06:32:12.321ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21112024-11-02T06:32:12.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21122024-11-02T06:32:12.321ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = ChainSuccessorSaga
21132024-11-02T06:32:12.325ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21142024-11-02T06:32:12.327ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21152024-11-02T06:32:12.327ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21162024-11-02T06:32:12.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21172024-11-02T06:32:12.328ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 59403eed-26d3-491e-a214-3ec0c7b10fb5, lookup_type: ById(59403eed-26d3-491e-a214-3ec0c7b10fb5) }, key: 574f74f1-759f-449e-8cb7-cbd42019766e, lookup_type: ById(574f74f1-759f-449e-8cb7-cbd42019766e) }, key: f5b46622-8c46-4c9d-89de-c83240f68643, lookup_type: ById(f5b46622-8c46-4c9d-89de-c83240f68643) } result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = ChainSuccessorSaga
21182024-11-02T06:32:12.328ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = ChainSuccessorSaga
21192024-11-02T06:32:12.328ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_node = ChainSuccessorSaga
21202024-11-02T06:32:12.334ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update
21212024-11-02T06:32:12.334ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
21222024-11-02T06:32:12.334ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
21232024-11-02T06:32:12.337ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
21242024-11-02T06:32:12.337ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
21252024-11-02T06:32:12.341ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
21262024-11-02T06:32:12.341ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
21272024-11-02T06:32:12.345ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
21282024-11-02T06:32:12.345ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa
21292024-11-02T06:32:12.356ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
21302024-11-02T06:32:12.356ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21312024-11-02T06:32:12.356ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d02235d0-93f3-4e6d-96eb-578aa63865ee", "date": "Sat, 02 Nov 2024 06:32:12 GMT"} })
21322024-11-02T06:32:12.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21332024-11-02T06:32:12.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21342024-11-02T06:32:12.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21352024-11-02T06:32:12.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21362024-11-02T06:32:12.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21372024-11-02T06:32:12.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21382024-11-02T06:32:12.364ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
21392024-11-02T06:32:12.364ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21402024-11-02T06:32:12.365ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8047cca8-9429-4028-9473-ab7fe8191d08", "date": "Sat, 02 Nov 2024 06:32:12 GMT"} })
21412024-11-02T06:32:12.367ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 150.549693ms iteration = 27 status = {}
21422024-11-02T06:32:12.392ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
21432024-11-02T06:32:12.392ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa saga_name = instance-update saga_result = SagaResult { saga_id: 3b799b30-e9aa-44fc-a127-6b56043ed4aa, saga_log: SagaLog { saga_id: 3b799b30-e9aa-44fc-a127-6b56043ed4aa, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("564d7119-8add-4130-8a55-791c4aeed1fc")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("564d7119-8add-4130-8a55-791c4aeed1fc")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("f5b46622-8c46-4c9d-89de-c83240f68643"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c8b6477e-662b-47a0-ae13-e369c00a8395")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("f5b46622-8c46-4c9d-89de-c83240f68643"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("c8b6477e-662b-47a0-ae13-e369c00a8395")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("564d7119-8add-4130-8a55-791c4aeed1fc"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("564d7119-8add-4130-8a55-791c4aeed1fc")}} }) }
21442024-11-02T06:32:12.392ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 3b799b30-e9aa-44fc-a127-6b56043ed4aa instance_id = f5b46622-8c46-4c9d-89de-c83240f68643 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update
21452024-11-02T06:32:12.392ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
21462024-11-02T06:32:12.392ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0
21472024-11-02T06:32:12.400ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
21482024-11-02T06:32:12.400ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0
21492024-11-02T06:32:12.417ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21502024-11-02T06:32:12.417ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae126b8c-6768-418d-bdca-d545e1f05a52", "content-length": "691", "date": "Sat, 02 Nov 2024 06:32:12 GMT"} })
21512024-11-02T06:32:12.417ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
21522024-11-02T06:32:12.417ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
21532024-11-02T06:32:12.417ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
21542024-11-02T06:32:12.419ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 202.485637ms iteration = 26 status = {}
21552024-11-02T06:32:12.424ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
21562024-11-02T06:32:12.424ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0
21572024-11-02T06:32:12.430ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
21582024-11-02T06:32:12.430ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0
21592024-11-02T06:32:12.440ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update sec_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
21602024-11-02T06:32:12.440ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = adda180d-61b4-4f58-bcd9-34b3021eddb0 saga_name = start-instance-update saga_result = SagaResult { saga_id: adda180d-61b4-4f58-bcd9-34b3021eddb0, saga_log: SagaLog { saga_id: adda180d-61b4-4f58-bcd9-34b3021eddb0, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("78b00013-859c-4685-9202-6b6eb9da01ac")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("78b00013-859c-4685-9202-6b6eb9da01ac")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("78b00013-859c-4685-9202-6b6eb9da01ac"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("78b00013-859c-4685-9202-6b6eb9da01ac")}} }) }
21612024-11-02T06:32:12.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b05f07d7-9495-4481-b47f-7b007bdd2e13 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21622024-11-02T06:32:12.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b05f07d7-9495-4481-b47f-7b007bdd2e13 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21632024-11-02T06:32:12.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b05f07d7-9495-4481-b47f-7b007bdd2e13 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21642024-11-02T06:32:14.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 31eda0d0-4c46-40ce-9019-b65e7ef6a9dc roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21652024-11-02T06:32:14.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 31eda0d0-4c46-40ce-9019-b65e7ef6a9dc resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21662024-11-02T06:32:14.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 31eda0d0-4c46-40ce-9019-b65e7ef6a9dc response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21672024-11-02T06:32:14.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 9e29d68b-ef10-4def-8272-818830dd85c9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
21682024-11-02T06:32:14.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 9e29d68b-ef10-4def-8272-818830dd85c9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
21692024-11-02T06:32:14.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 9e29d68b-ef10-4def-8272-818830dd85c9 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
21702024-11-02T06:32:15.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5c6399ff-e9a8-4833-977d-10878404c559 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21712024-11-02T06:32:15.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5c6399ff-e9a8-4833-977d-10878404c559 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21722024-11-02T06:32:15.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5c6399ff-e9a8-4833-977d-10878404c559 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21732024-11-02T06:32:16.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b2416dd2-d9d9-4a43-addb-f78af661347d roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21742024-11-02T06:32:16.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b2416dd2-d9d9-4a43-addb-f78af661347d resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21752024-11-02T06:32:16.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2318 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b2416dd2-d9d9-4a43-addb-f78af661347d response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21762024-11-02T06:32:17.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ff8a898f-c01e-4b38-83eb-099bf85c1784 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21772024-11-02T06:32:17.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ff8a898f-c01e-4b38-83eb-099bf85c1784 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21782024-11-02T06:32:17.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ff8a898f-c01e-4b38-83eb-099bf85c1784 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
21792024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
21802024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21812024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
21822024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21832024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
21842024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
21852024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21862024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
21872024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
21882024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
21892024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21902024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
21912024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21922024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21932024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
21942024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
21952024-11-02T06:32:17.945ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
21962024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21972024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
21982024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21992024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
22002024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22012024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22022024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
22032024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22042024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
22052024-11-02T06:32:17.945ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22062024-11-02T06:32:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22072024-11-02T06:32:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22082024-11-02T06:32:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22092024-11-02T06:32:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22102024-11-02T06:32:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22112024-11-02T06:32:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22122024-11-02T06:32:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22132024-11-02T06:32:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22142024-11-02T06:32:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22152024-11-02T06:32:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22162024-11-02T06:32:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22172024-11-02T06:32:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22182024-11-02T06:32:17.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
22192024-11-02T06:32:17.947ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
22202024-11-02T06:32:17.947ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
22212024-11-02T06:32:17.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.961\u{b5}s iteration = 26 status = {"errors":[],"records_set_to_done":[]}
22222024-11-02T06:32:17.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.67\u{b5}s iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
22232024-11-02T06:32:17.947ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
22242024-11-02T06:32:17.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.42\u{b5}s iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
22252024-11-02T06:32:17.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.02\u{b5}s iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
22262024-11-02T06:32:17.949ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22272024-11-02T06:32:17.954ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22282024-11-02T06:32:17.954ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22292024-11-02T06:32:17.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22302024-11-02T06:32:17.959ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 13.282616ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22312024-11-02T06:32:17.959ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5514, tv_nsec: 548752868 } })
22322024-11-02T06:32:17.959ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
22332024-11-02T06:32:17.960ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5514, tv_nsec: 549747606 } })
22342024-11-02T06:32:17.960ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22352024-11-02T06:32:17.960ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
22362024-11-02T06:32:17.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22372024-11-02T06:32:17.988ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22382024-11-02T06:32:17.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22392024-11-02T06:32:17.992ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22402024-11-02T06:32:17.995ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22412024-11-02T06:32:17.995ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22422024-11-02T06:32:17.995ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22432024-11-02T06:32:17.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22442024-11-02T06:32:17.996ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22452024-11-02T06:32:17.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22462024-11-02T06:32:17.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22472024-11-02T06:32:17.997ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22482024-11-02T06:32:17.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
22492024-11-02T06:32:17.997ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22502024-11-02T06:32:17.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22512024-11-02T06:32:17.998ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22522024-11-02T06:32:17.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22532024-11-02T06:32:17.998ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22542024-11-02T06:32:17.998ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22552024-11-02T06:32:17.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22562024-11-02T06:32:18.000ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22572024-11-02T06:32:18.000ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22582024-11-02T06:32:18.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22592024-11-02T06:32:18.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22602024-11-02T06:32:18.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22612024-11-02T06:32:18.002ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22622024-11-02T06:32:18.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22632024-11-02T06:32:18.003ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22642024-11-02T06:32:18.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22652024-11-02T06:32:18.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22662024-11-02T06:32:18.003ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22672024-11-02T06:32:18.003ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22682024-11-02T06:32:18.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22692024-11-02T06:32:18.005ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22702024-11-02T06:32:18.005ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
22712024-11-02T06:32:18.005ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22722024-11-02T06:32:18.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22732024-11-02T06:32:18.006ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5514, tv_nsec: 595741500 } })
22742024-11-02T06:32:18.006ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
22752024-11-02T06:32:18.006ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22762024-11-02T06:32:18.006ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
22772024-11-02T06:32:18.006ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "acf7c248-5e41-4fde-8bb3-73f238274240", "content-length": "26", "date": "Sat, 02 Nov 2024 06:32:18 GMT"} })
22782024-11-02T06:32:18.006ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22792024-11-02T06:32:18.008ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22802024-11-02T06:32:18.010ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
22812024-11-02T06:32:18.010ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22822024-11-02T06:32:18.010ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "28a5e0be-f72d-404d-b305-f1034a3af354", "content-length": "26", "date": "Sat, 02 Nov 2024 06:32:18 GMT"} })
22832024-11-02T06:32:18.010ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22842024-11-02T06:32:18.012ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22852024-11-02T06:32:18.014ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22862024-11-02T06:32:18.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22872024-11-02T06:32:18.017ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22882024-11-02T06:32:18.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22892024-11-02T06:32:18.021ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22902024-11-02T06:32:18.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22912024-11-02T06:32:18.024ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.345103ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22922024-11-02T06:32:18.024ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22932024-11-02T06:32:18.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22942024-11-02T06:32:18.026ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22952024-11-02T06:32:18.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e910c408-e8f8-499f-81a3-43816eb138fc, lookup_type: ById(e910c408-e8f8-499f-81a3-43816eb138fc) } result = Ok(())
22962024-11-02T06:32:18.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22972024-11-02T06:32:18.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22982024-11-02T06:32:18.031ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 85.139989ms iteration = 26 status = 0
22992024-11-02T06:32:18.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23002024-11-02T06:32:18.035ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.057631ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23012024-11-02T06:32:18.037ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23022024-11-02T06:32:18.037ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23032024-11-02T06:32:18.037ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23042024-11-02T06:32:18.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23052024-11-02T06:32:18.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
23062024-11-02T06:32:18.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23072024-11-02T06:32:18.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23082024-11-02T06:32:18.047ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23092024-11-02T06:32:18.047ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 101.954842ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23102024-11-02T06:32:18.058ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 zone_address = fd00:1122:3344:101::2
23112024-11-02T06:32:18.058ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23122024-11-02T06:32:18.058ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a09b00e-7d06-4472-bf6f-93544783a108", "content-length": "26", "date": "Sat, 02 Nov 2024 06:32:18 GMT"} })
23132024-11-02T06:32:18.058ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23142024-11-02T06:32:18.060ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
23152024-11-02T06:32:18.060ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
23162024-11-02T06:32:18.060ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 114.895232ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
23172024-11-02T06:32:18.064ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23182024-11-02T06:32:18.064ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ade284e5-d3eb-438c-9400-2da4942f0e72", "content-length": "2", "date": "Sat, 02 Nov 2024 06:32:17 GMT"} })
23192024-11-02T06:32:18.065ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23202024-11-02T06:32:18.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23212024-11-02T06:32:18.067ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 121.919582ms iteration = 26 status = null
23222024-11-02T06:32:18.077ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23232024-11-02T06:32:18.077ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
23242024-11-02T06:32:18.077ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 132.019929ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
23252024-11-02T06:32:18.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23262024-11-02T06:32:18.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23272024-11-02T06:32:18.095ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 150.059604ms iteration = 26 status = {}
23282024-11-02T06:32:18.100ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23292024-11-02T06:32:18.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23302024-11-02T06:32:18.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4bae6e0e-0abc-4a23-85a3-b00b577c60a1 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
23312024-11-02T06:32:18.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4bae6e0e-0abc-4a23-85a3-b00b577c60a1 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
23322024-11-02T06:32:18.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 4bae6e0e-0abc-4a23-85a3-b00b577c60a1 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
23332024-11-02T06:32:18.126ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 180.316465ms iteration = 30 status = {"physical_disks_added":0}
23342024-11-02T06:32:18.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23352024-11-02T06:32:18.132ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23362024-11-02T06:32:18.132ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23372024-11-02T06:32:18.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23382024-11-02T06:32:18.134ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
23392024-11-02T06:32:18.134ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23402024-11-02T06:32:18.135ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "153e3b92-61a1-44aa-b0b7-0b9e849340a8", "content-length": "372", "date": "Sat, 02 Nov 2024 06:32:17 GMT"} })
23412024-11-02T06:32:18.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23422024-11-02T06:32:18.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23432024-11-02T06:32:18.136ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23442024-11-02T06:32:18.138ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23452024-11-02T06:32:18.138ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23462024-11-02T06:32:18.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23472024-11-02T06:32:18.180ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
23482024-11-02T06:32:18.180ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
23492024-11-02T06:32:18.181ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "70d4c06f-eea7-4a84-913b-949d0901ca94", "date": "Sat, 02 Nov 2024 06:32:17 GMT"} })
23502024-11-02T06:32:18.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23512024-11-02T06:32:18.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23522024-11-02T06:32:18.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23532024-11-02T06:32:18.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23542024-11-02T06:32:18.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23552024-11-02T06:32:18.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23562024-11-02T06:32:18.192ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
23572024-11-02T06:32:18.192ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23582024-11-02T06:32:18.192ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "50fa5c10-026e-4d92-8bf2-8d621e60a005", "date": "Sat, 02 Nov 2024 06:32:17 GMT"} })
23592024-11-02T06:32:18.194ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 248.279656ms iteration = 28 status = {}
23602024-11-02T06:32:18.209ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23612024-11-02T06:32:18.210ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "89bbc90e-b7ff-4e91-b850-03cc044fa10c", "content-length": "691", "date": "Sat, 02 Nov 2024 06:32:17 GMT"} })
23622024-11-02T06:32:18.210ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
23632024-11-02T06:32:18.210ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
23642024-11-02T06:32:18.210ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
23652024-11-02T06:32:18.212ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 266.608467ms iteration = 27 status = {}
23662024-11-02T06:32:18.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23672024-11-02T06:32:18.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23682024-11-02T06:32:18.229ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 29c3f6a1-2034-455b-bc3b-3fbebec1d7c1, rack_id: a9cb4975-e69e-4875-af6f-759c07abd8a8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(72902c82-00a8-446a-b727-41c9c8c92f9b) } rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0
23692024-11-02T06:32:18.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23702024-11-02T06:32:18.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23712024-11-02T06:32:18.240ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
23722024-11-02T06:32:18.240ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "01370b0b-c79d-4507-ad86-357077b8d125", "content-length": "134", "date": "Sat, 02 Nov 2024 06:32:17 GMT"} })
23732024-11-02T06:32:18.240ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
23742024-11-02T06:32:18.240ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 72902c82-00a8-446a-b727-41c9c8c92f9b
23752024-11-02T06:32:18.240ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
23762024-11-02T06:32:18.240ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
23772024-11-02T06:32:18.240ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23782024-11-02T06:32:18.240ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23792024-11-02T06:32:18.240ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23802024-11-02T06:32:18.240ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
23812024-11-02T06:32:18.241ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23822024-11-02T06:32:18.241ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
23832024-11-02T06:32:18.241ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
23842024-11-02T06:32:18.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23852024-11-02T06:32:18.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23862024-11-02T06:32:18.243ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
23872024-11-02T06:32:18.243ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2dd7084-e4a6-4eb6-b4d7-b3a8cd69d606", "content-length": "2", "date": "Sat, 02 Nov 2024 06:32:17 GMT"} })
23882024-11-02T06:32:18.243ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
23892024-11-02T06:32:18.243ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa41ecf9-ba33-43f1-9675-fec5d964b4ac", "content-length": "52", "date": "Sat, 02 Nov 2024 06:32:17 GMT"} })
23902024-11-02T06:32:18.243ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0
23912024-11-02T06:32:18.243ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
23922024-11-02T06:32:18.350ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cbb2053c-b14f-4188-b079-87c99a3d6ba0", "date": "Sat, 02 Nov 2024 06:32:17 GMT"} })
23932024-11-02T06:32:18.350ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch = Switch0
23942024-11-02T06:32:18.350ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
23952024-11-02T06:32:18.355ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8aa1700a-8a19-4144-8f45-a4666e7fc4b1", "content-length": "682", "date": "Sat, 02 Nov 2024 06:32:17 GMT"} })
23962024-11-02T06:32:18.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23972024-11-02T06:32:18.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23982024-11-02T06:32:18.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23992024-11-02T06:32:18.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24002024-11-02T06:32:18.362ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24012024-11-02T06:32:18.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24022024-11-02T06:32:18.364ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24032024-11-02T06:32:18.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24042024-11-02T06:32:18.371ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 426.099046ms iteration = 26 status = {}
24052024-11-02T06:32:19.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 50000307-ee51-4888-9a57-cdd27e38f422 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24062024-11-02T06:32:19.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 50000307-ee51-4888-9a57-cdd27e38f422 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24072024-11-02T06:32:19.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 50000307-ee51-4888-9a57-cdd27e38f422 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24082024-11-02T06:32:19.397ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1477 local_addr = [fd00:1122:3344:101::c]:45423 method = GET remote_addr = [fd00:1122:3344:101::d]:54698 req_id = 00d5f30c-ec37-4ccc-bcec-d799079bd6e5 response_code = 200 uri = /0b0286d1-4696-4dd6-a80e-495d344ae645
24092024-11-02T06:32:20.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 581ea5c7-4672-4463-b378-eb7a98fa5ac9 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24102024-11-02T06:32:20.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 581ea5c7-4672-4463-b378-eb7a98fa5ac9 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24112024-11-02T06:32:20.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 581ea5c7-4672-4463-b378-eb7a98fa5ac9 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24122024-11-02T06:32:21.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 48537f80-fc52-43ea-8c19-886dcfcf7d32 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24132024-11-02T06:32:21.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 48537f80-fc52-43ea-8c19-886dcfcf7d32 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24142024-11-02T06:32:21.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 48537f80-fc52-43ea-8c19-886dcfcf7d32 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24152024-11-02T06:32:22.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ac7e89fe-353d-4380-837f-f646bbb49e49 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24162024-11-02T06:32:22.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ac7e89fe-353d-4380-837f-f646bbb49e49 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24172024-11-02T06:32:22.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ac7e89fe-353d-4380-837f-f646bbb49e49 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24182024-11-02T06:32:23.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3c419324-e67c-4c66-855b-cd0ec8c560f7 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24192024-11-02T06:32:23.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3c419324-e67c-4c66-855b-cd0ec8c560f7 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24202024-11-02T06:32:23.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3c419324-e67c-4c66-855b-cd0ec8c560f7 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24212024-11-02T06:32:24.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 13996b42-2906-4dd2-8d0c-3113c2ae432e roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24222024-11-02T06:32:24.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 13996b42-2906-4dd2-8d0c-3113c2ae432e resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24232024-11-02T06:32:24.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 13996b42-2906-4dd2-8d0c-3113c2ae432e response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24242024-11-02T06:32:25.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e6909f98-63bb-4f4b-a230-c4c7ed20ec2e roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24252024-11-02T06:32:25.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e6909f98-63bb-4f4b-a230-c4c7ed20ec2e resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24262024-11-02T06:32:25.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e6909f98-63bb-4f4b-a230-c4c7ed20ec2e response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24272024-11-02T06:32:25.617ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:54191
24282024-11-02T06:32:25.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54191 req_id = c585fd1d-739b-419c-8046-331165666944 roles = RoleSet { roles: {} } uri = /metrics/producers
24292024-11-02T06:32:25.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54191 req_id = c585fd1d-739b-419c-8046-331165666944 resource = Database result = Ok(()) uri = /metrics/producers
24302024-11-02T06:32:25.653ZINFOnexus: assigned collector to new producer collector_id = 13175a5b-eed9-4b10-bbf4-9e75d4d6ef03 file = nexus/src/app/oximeter.rs:76 producer_id = 3518bc48-608c-417c-a101-6ef2d0177974
24312024-11-02T06:32:25.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 36076 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54191 req_id = c585fd1d-739b-419c-8046-331165666944 response_code = 201 uri = /metrics/producers
24322024-11-02T06:32:26.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a12e2b88-e749-4fd6-afb4-dacd28af2a07 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24332024-11-02T06:32:26.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a12e2b88-e749-4fd6-afb4-dacd28af2a07 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24342024-11-02T06:32:26.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1875 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a12e2b88-e749-4fd6-afb4-dacd28af2a07 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24352024-11-02T06:32:27.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 686393bf-39d4-4a62-853e-4752637a577a roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24362024-11-02T06:32:27.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 686393bf-39d4-4a62-853e-4752637a577a resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24372024-11-02T06:32:27.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 686393bf-39d4-4a62-853e-4752637a577a response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24382024-11-02T06:32:27.856ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:49059
24392024-11-02T06:32:27.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49059 req_id = 4b63d9c1-b417-4294-84c0-8bda438d41d5 roles = RoleSet { roles: {} } uri = /metrics/producers
24402024-11-02T06:32:27.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49059 req_id = 4b63d9c1-b417-4294-84c0-8bda438d41d5 resource = Database result = Ok(()) uri = /metrics/producers
24412024-11-02T06:32:27.892ZINFOnexus: assigned collector to new producer collector_id = 13175a5b-eed9-4b10-bbf4-9e75d4d6ef03 file = nexus/src/app/oximeter.rs:76 producer_id = f2169c06-ecfd-48b1-98b9-71ad125368e0
24422024-11-02T06:32:27.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35874 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49059 req_id = 4b63d9c1-b417-4294-84c0-8bda438d41d5 response_code = 201 uri = /metrics/producers
24432024-11-02T06:32:27.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
24442024-11-02T06:32:27.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
24452024-11-02T06:32:27.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24462024-11-02T06:32:27.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24472024-11-02T06:32:27.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24482024-11-02T06:32:27.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24492024-11-02T06:32:27.971ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24502024-11-02T06:32:27.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24512024-11-02T06:32:27.973ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.937698ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24522024-11-02T06:32:27.974ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24532024-11-02T06:32:27.977ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24542024-11-02T06:32:27.977ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24552024-11-02T06:32:27.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24562024-11-02T06:32:27.979ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24572024-11-02T06:32:27.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24582024-11-02T06:32:27.980ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24592024-11-02T06:32:27.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
24602024-11-02T06:32:27.983ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24612024-11-02T06:32:27.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24622024-11-02T06:32:27.993ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
24632024-11-02T06:32:27.993ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.710703ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
24642024-11-02T06:32:28.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d4f52aa4-1e03-45ba-b9f1-0944a9f9ead3 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24652024-11-02T06:32:28.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d4f52aa4-1e03-45ba-b9f1-0944a9f9ead3 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24662024-11-02T06:32:28.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d4f52aa4-1e03-45ba-b9f1-0944a9f9ead3 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24672024-11-02T06:32:29.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ea99ef26-ffb4-487e-8ac3-455aa9834e2f roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24682024-11-02T06:32:29.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ea99ef26-ffb4-487e-8ac3-455aa9834e2f resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24692024-11-02T06:32:29.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ea99ef26-ffb4-487e-8ac3-455aa9834e2f response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24702024-11-02T06:32:30.228ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:58487
24712024-11-02T06:32:30.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58487 req_id = 10c9b5d7-7d8a-4ecf-93a2-7fc94ee9e8e0 roles = RoleSet { roles: {} } uri = /metrics/producers
24722024-11-02T06:32:30.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58487 req_id = 10c9b5d7-7d8a-4ecf-93a2-7fc94ee9e8e0 resource = Database result = Ok(()) uri = /metrics/producers
24732024-11-02T06:32:30.265ZINFOnexus: assigned collector to new producer collector_id = 13175a5b-eed9-4b10-bbf4-9e75d4d6ef03 file = nexus/src/app/oximeter.rs:76 producer_id = 0daabeb2-b72c-4ff1-b7b4-375e18ba7a71
24742024-11-02T06:32:30.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37094 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58487 req_id = 10c9b5d7-7d8a-4ecf-93a2-7fc94ee9e8e0 response_code = 201 uri = /metrics/producers
24752024-11-02T06:32:30.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cd49e3a1-ec3c-44aa-b87e-e170738439c7 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24762024-11-02T06:32:30.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cd49e3a1-ec3c-44aa-b87e-e170738439c7 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24772024-11-02T06:32:30.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cd49e3a1-ec3c-44aa-b87e-e170738439c7 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24782024-11-02T06:32:31.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0a9d010e-f6fd-428b-be7e-caf7f93fc1bc roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24792024-11-02T06:32:31.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0a9d010e-f6fd-428b-be7e-caf7f93fc1bc resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24802024-11-02T06:32:31.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 0a9d010e-f6fd-428b-be7e-caf7f93fc1bc response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24812024-11-02T06:32:31.439ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:39084
24822024-11-02T06:32:31.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39084 req_id = cf15702c-49a1-49ce-83ff-2d38c983c530 roles = RoleSet { roles: {} } uri = /metrics/producers
24832024-11-02T06:32:31.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39084 req_id = cf15702c-49a1-49ce-83ff-2d38c983c530 resource = Database result = Ok(()) uri = /metrics/producers
24842024-11-02T06:32:31.452ZINFOnexus: assigned collector to new producer collector_id = 13175a5b-eed9-4b10-bbf4-9e75d4d6ef03 file = nexus/src/app/oximeter.rs:76 producer_id = e910c408-e8f8-499f-81a3-43816eb138fc
24852024-11-02T06:32:31.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 12910 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39084 req_id = cf15702c-49a1-49ce-83ff-2d38c983c530 response_code = 201 uri = /metrics/producers
24862024-11-02T06:32:32.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 322228fe-52c1-4903-9b7c-bf1ce202b5e4 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24872024-11-02T06:32:32.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 322228fe-52c1-4903-9b7c-bf1ce202b5e4 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24882024-11-02T06:32:32.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 322228fe-52c1-4903-9b7c-bf1ce202b5e4 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24892024-11-02T06:32:33.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = deb2b790-3425-462f-90f2-6625181edd92 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24902024-11-02T06:32:33.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = deb2b790-3425-462f-90f2-6625181edd92 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24912024-11-02T06:32:33.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = deb2b790-3425-462f-90f2-6625181edd92 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24922024-11-02T06:32:34.398ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1686 local_addr = [fd00:1122:3344:101::c]:45423 method = GET remote_addr = [fd00:1122:3344:101::d]:54698 req_id = 968e8ec7-f107-45ed-960e-12bb15b30681 response_code = 200 uri = /0b0286d1-4696-4dd6-a80e-495d344ae645
24932024-11-02T06:32:34.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9e1e3cf6-cfaf-421c-b272-a4d40e1beb7e roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24942024-11-02T06:32:34.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9e1e3cf6-cfaf-421c-b272-a4d40e1beb7e resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24952024-11-02T06:32:34.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9e1e3cf6-cfaf-421c-b272-a4d40e1beb7e response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24962024-11-02T06:32:35.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 83960fd4-c128-4d78-99e6-154c18be0c83 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24972024-11-02T06:32:35.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 83960fd4-c128-4d78-99e6-154c18be0c83 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24982024-11-02T06:32:35.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 83960fd4-c128-4d78-99e6-154c18be0c83 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
24992024-11-02T06:32:36.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c450ff0a-0277-475b-a7db-3f10b10a53ba roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25002024-11-02T06:32:36.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c450ff0a-0277-475b-a7db-3f10b10a53ba resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25012024-11-02T06:32:36.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = c450ff0a-0277-475b-a7db-3f10b10a53ba response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25022024-11-02T06:32:37.399ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:56545
25032024-11-02T06:32:37.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56545 req_id = 18bea9d1-b801-43c9-a054-e9e9e2bf2f24 roles = RoleSet { roles: {} } uri = /metrics/producers
25042024-11-02T06:32:37.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56545 req_id = 18bea9d1-b801-43c9-a054-e9e9e2bf2f24 resource = Database result = Ok(()) uri = /metrics/producers
25052024-11-02T06:32:37.434ZINFOnexus: assigned collector to new producer collector_id = 13175a5b-eed9-4b10-bbf4-9e75d4d6ef03 file = nexus/src/app/oximeter.rs:76 producer_id = 7ec6024f-066f-429f-b518-73983b940c39
25062024-11-02T06:32:37.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35554 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56545 req_id = 18bea9d1-b801-43c9-a054-e9e9e2bf2f24 response_code = 201 uri = /metrics/producers
25072024-11-02T06:32:37.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = eab28d28-c7e5-491f-a7f9-85c452870ba0 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25082024-11-02T06:32:37.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = eab28d28-c7e5-491f-a7f9-85c452870ba0 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25092024-11-02T06:32:37.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = eab28d28-c7e5-491f-a7f9-85c452870ba0 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25102024-11-02T06:32:37.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
25112024-11-02T06:32:37.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
25122024-11-02T06:32:37.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25132024-11-02T06:32:37.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25142024-11-02T06:32:37.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25152024-11-02T06:32:37.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25162024-11-02T06:32:37.947ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25172024-11-02T06:32:37.947ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25182024-11-02T06:32:37.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25192024-11-02T06:32:37.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.24584ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25202024-11-02T06:32:37.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25212024-11-02T06:32:37.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25222024-11-02T06:32:37.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25232024-11-02T06:32:37.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25242024-11-02T06:32:37.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25252024-11-02T06:32:37.953ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25262024-11-02T06:32:37.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
25272024-11-02T06:32:37.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25282024-11-02T06:32:37.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25292024-11-02T06:32:37.966ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
25302024-11-02T06:32:37.966ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.892657ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
25312024-11-02T06:32:38.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1de0fa0c-26a4-4ac0-b6ff-737b33f51e90 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25322024-11-02T06:32:38.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1de0fa0c-26a4-4ac0-b6ff-737b33f51e90 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25332024-11-02T06:32:38.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1de0fa0c-26a4-4ac0-b6ff-737b33f51e90 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25342024-11-02T06:32:39.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = d13d9761-018a-4f83-9d4b-69df676ca8fa roles = RoleSet { roles: {} } uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
25352024-11-02T06:32:39.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = d13d9761-018a-4f83-9d4b-69df676ca8fa resource = Database result = Ok(()) uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
25362024-11-02T06:32:39.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = d13d9761-018a-4f83-9d4b-69df676ca8fa response_code = 200 uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
25372024-11-02T06:32:39.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 0a103e40-f70b-4a48-bf08-8ecaaa1789d9 roles = RoleSet { roles: {} } uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
25382024-11-02T06:32:39.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 0a103e40-f70b-4a48-bf08-8ecaaa1789d9 resource = Database result = Ok(()) uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
25392024-11-02T06:32:39.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = 0a103e40-f70b-4a48-bf08-8ecaaa1789d9 response_code = 200 uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
25402024-11-02T06:32:39.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f1a15df9-3847-4719-addc-9c53a2697fe0 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25412024-11-02T06:32:39.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f1a15df9-3847-4719-addc-9c53a2697fe0 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25422024-11-02T06:32:39.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f1a15df9-3847-4719-addc-9c53a2697fe0 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25432024-11-02T06:32:40.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3ededfb7-832a-4019-b650-e66a58eaa94a roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25442024-11-02T06:32:40.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3ededfb7-832a-4019-b650-e66a58eaa94a resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25452024-11-02T06:32:40.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3ededfb7-832a-4019-b650-e66a58eaa94a response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25462024-11-02T06:32:41.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 84a4d678-5083-4ea3-85a2-994f1b4ffdcb roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25472024-11-02T06:32:41.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 84a4d678-5083-4ea3-85a2-994f1b4ffdcb resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25482024-11-02T06:32:41.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 84a4d678-5083-4ea3-85a2-994f1b4ffdcb response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25492024-11-02T06:32:42.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1410e719-08e0-4525-ac88-1044dbb8826f roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25502024-11-02T06:32:42.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1410e719-08e0-4525-ac88-1044dbb8826f resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25512024-11-02T06:32:42.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1410e719-08e0-4525-ac88-1044dbb8826f response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25522024-11-02T06:32:43.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 63e6680b-22ce-410a-8953-a7bfc15a0c3f roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25532024-11-02T06:32:43.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 63e6680b-22ce-410a-8953-a7bfc15a0c3f resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25542024-11-02T06:32:43.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 63e6680b-22ce-410a-8953-a7bfc15a0c3f response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25552024-11-02T06:32:44.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = f0d50ab4-5388-443b-894c-f7f10939ba83 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
25562024-11-02T06:32:44.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = f0d50ab4-5388-443b-894c-f7f10939ba83 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
25572024-11-02T06:32:44.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = f0d50ab4-5388-443b-894c-f7f10939ba83 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
25582024-11-02T06:32:44.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 8b5d84f6-e80f-4dcf-8483-5df7b66a9dd0 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25592024-11-02T06:32:44.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 8b5d84f6-e80f-4dcf-8483-5df7b66a9dd0 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25602024-11-02T06:32:44.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 8b5d84f6-e80f-4dcf-8483-5df7b66a9dd0 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25612024-11-02T06:32:45.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f3ffddc0-ad52-45e8-9425-b461a8e2e42b roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25622024-11-02T06:32:45.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f3ffddc0-ad52-45e8-9425-b461a8e2e42b resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25632024-11-02T06:32:45.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f3ffddc0-ad52-45e8-9425-b461a8e2e42b response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25642024-11-02T06:32:46.356ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
25652024-11-02T06:32:46.356ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
25662024-11-02T06:32:46.387ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
25672024-11-02T06:32:46.387ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:44491
25682024-11-02T06:32:46.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:44491 req_id = f6d0b793-77fd-40a3-a911-76feb764c906 roles = RoleSet { roles: {} } uri = /metrics/producers
25692024-11-02T06:32:46.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:44491 req_id = f6d0b793-77fd-40a3-a911-76feb764c906 resource = Database result = Ok(()) uri = /metrics/producers
25702024-11-02T06:32:46.399ZINFOnexus: assigned collector to new producer collector_id = 13175a5b-eed9-4b10-bbf4-9e75d4d6ef03 file = nexus/src/app/oximeter.rs:76 producer_id = 0b0286d1-4696-4dd6-a80e-495d344ae645
25712024-11-02T06:32:46.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11739 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:44491 req_id = f6d0b793-77fd-40a3-a911-76feb764c906 response_code = 201 uri = /metrics/producers
25722024-11-02T06:32:46.399ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "f6d0b793-77fd-40a3-a911-76feb764c906", "content-length": "41", "date": "Sat, 02 Nov 2024 06:32:46 GMT"} })
25732024-11-02T06:32:46.400ZDEBGnexus (producer-registration-task): registered with nexus successfully
25742024-11-02T06:32:46.400ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
25752024-11-02T06:32:46.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 21db1354-b1d7-46a7-996a-288bd7baeec6 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25762024-11-02T06:32:46.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 21db1354-b1d7-46a7-996a-288bd7baeec6 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25772024-11-02T06:32:46.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 21db1354-b1d7-46a7-996a-288bd7baeec6 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25782024-11-02T06:32:47.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cfcc3fba-1c9e-4cec-a0bd-fa2c9fe1d1a3 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25792024-11-02T06:32:47.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cfcc3fba-1c9e-4cec-a0bd-fa2c9fe1d1a3 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25802024-11-02T06:32:47.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = cfcc3fba-1c9e-4cec-a0bd-fa2c9fe1d1a3 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
25812024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
25822024-11-02T06:32:47.945ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
25832024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
25842024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25852024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25862024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
25872024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
25882024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25892024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
25902024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25912024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
25922024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
25932024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25942024-11-02T06:32:47.945ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-02 06:22:47.945896889 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
25952024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
25962024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
25972024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
25982024-11-02T06:32:47.945ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
25992024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
26002024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
26012024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26022024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26032024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
26042024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26052024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
26062024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
26072024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26082024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
26092024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
26102024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
26112024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26122024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
26132024-11-02T06:32:47.946ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951
26142024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.28\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951"}
26152024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
26162024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
26172024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
26182024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26192024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26202024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
26212024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
26222024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26232024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
26242024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
26252024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26262024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
26272024-11-02T06:32:47.946ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
26282024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
26292024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26302024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
26312024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
26322024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.5\u{b5}s iteration = 27 status = {"errors":[],"records_set_to_done":[]}
26332024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
26342024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
26352024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.99\u{b5}s iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26362024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.421\u{b5}s iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26372024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
26382024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
26392024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
26402024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
26412024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
26422024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.191\u{b5}s iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
26432024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
26442024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26452024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26462024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26472024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26482024-11-02T06:32:47.946ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6a4687d5-e6b4-4540-a2ca-427f283410f7.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("de7d1832-5e65-4ea7-84c0-45f357940eaf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("de7d1832-5e65-4ea7-84c0-45f357940eaf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 5544, tv_nsec: 535931040 } })
26492024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
26502024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26512024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
26522024-11-02T06:32:47.946ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2def50a1-21d3-4363-95dd-e7ace3ea6072.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5bb4c3ff-dfd1-48bb-9ff6-2d960161c3ff.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("94cf380a-9b0f-4dd7-bbb4-ea455975d533.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("94cf380a-9b0f-4dd7-bbb4-ea455975d533.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 5544, tv_nsec: 536008011 } })
26532024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26542024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26552024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26562024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26572024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26582024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
26592024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26602024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26612024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26622024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26632024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
26642024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
26652024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
26662024-11-02T06:32:47.946ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 909.416\u{b5}s iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
26672024-11-02T06:32:47.947ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
26682024-11-02T06:32:47.947ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.393335ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
26692024-11-02T06:32:47.948ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26702024-11-02T06:32:47.949ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.438054ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
26712024-11-02T06:32:47.949ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26722024-11-02T06:32:47.951ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5544, tv_nsec: 541164397 } })
26732024-11-02T06:32:47.951ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26742024-11-02T06:32:47.951ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26752024-11-02T06:32:47.952ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
26762024-11-02T06:32:47.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26772024-11-02T06:32:47.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26782024-11-02T06:32:47.952ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26792024-11-02T06:32:47.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26802024-11-02T06:32:47.954ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26812024-11-02T06:32:47.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26822024-11-02T06:32:47.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26832024-11-02T06:32:47.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26842024-11-02T06:32:47.955ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5544, tv_nsec: 545248873 } })
26852024-11-02T06:32:47.955ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-02 06:22:47.945896889 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
26862024-11-02T06:32:47.956ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 10.061106ms iteration = 14 status = {"expiration":"2024-11-02T06:22:47.945896889Z","pruned":[]}
26872024-11-02T06:32:47.956ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
26882024-11-02T06:32:47.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26892024-11-02T06:32:47.962ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26902024-11-02T06:32:47.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26912024-11-02T06:32:47.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26922024-11-02T06:32:47.966ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.217655ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
26932024-11-02T06:32:47.967ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26942024-11-02T06:32:47.967ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26952024-11-02T06:32:47.968ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26962024-11-02T06:32:47.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26972024-11-02T06:32:47.969ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5544, tv_nsec: 558845435 } })
26982024-11-02T06:32:47.970ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
26992024-11-02T06:32:47.971ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
27002024-11-02T06:32:47.971ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27012024-11-02T06:32:47.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27022024-11-02T06:32:47.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27032024-11-02T06:32:47.974ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27042024-11-02T06:32:47.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27052024-11-02T06:32:48.003ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27062024-11-02T06:32:48.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27072024-11-02T06:32:48.004ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27082024-11-02T06:32:48.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27092024-11-02T06:32:48.006ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27102024-11-02T06:32:48.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27112024-11-02T06:32:48.011ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27122024-11-02T06:32:48.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27132024-11-02T06:32:48.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27142024-11-02T06:32:48.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27152024-11-02T06:32:48.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27162024-11-02T06:32:48.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27172024-11-02T06:32:48.015ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27182024-11-02T06:32:48.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27192024-11-02T06:32:48.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27202024-11-02T06:32:48.019ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
27212024-11-02T06:32:48.020ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
27222024-11-02T06:32:48.020ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.772668ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
27232024-11-02T06:32:48.021ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27242024-11-02T06:32:48.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27252024-11-02T06:32:48.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
27262024-11-02T06:32:48.024ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27272024-11-02T06:32:48.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27282024-11-02T06:32:48.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27292024-11-02T06:32:48.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27302024-11-02T06:32:48.027ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
27312024-11-02T06:32:48.027ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
27322024-11-02T06:32:48.028ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
27332024-11-02T06:32:48.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27342024-11-02T06:32:48.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27352024-11-02T06:32:48.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27362024-11-02T06:32:48.029ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27372024-11-02T06:32:48.029ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
27382024-11-02T06:32:48.029ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27392024-11-02T06:32:48.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27402024-11-02T06:32:48.029ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27412024-11-02T06:32:48.030ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
27422024-11-02T06:32:48.030ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
27432024-11-02T06:32:48.030ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
27442024-11-02T06:32:48.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27452024-11-02T06:32:48.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27462024-11-02T06:32:48.031ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27472024-11-02T06:32:48.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27482024-11-02T06:32:48.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27492024-11-02T06:32:48.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
27502024-11-02T06:32:48.032ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
27512024-11-02T06:32:48.032ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
27522024-11-02T06:32:48.032ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 86.81004ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
27532024-11-02T06:32:48.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27542024-11-02T06:32:48.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
27552024-11-02T06:32:48.034ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27562024-11-02T06:32:48.034ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
27572024-11-02T06:32:48.034ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27582024-11-02T06:32:48.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27592024-11-02T06:32:48.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27602024-11-02T06:32:48.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
27612024-11-02T06:32:48.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27622024-11-02T06:32:48.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27632024-11-02T06:32:48.037ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27642024-11-02T06:32:48.040ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27652024-11-02T06:32:48.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
27662024-11-02T06:32:48.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27672024-11-02T06:32:48.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27682024-11-02T06:32:48.040ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27692024-11-02T06:32:48.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27702024-11-02T06:32:48.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27712024-11-02T06:32:48.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27722024-11-02T06:32:48.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27732024-11-02T06:32:48.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
27742024-11-02T06:32:48.043ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27752024-11-02T06:32:48.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27762024-11-02T06:32:48.046ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27772024-11-02T06:32:48.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27782024-11-02T06:32:48.048ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 102.171156ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27792024-11-02T06:32:48.048ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27802024-11-02T06:32:48.050ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
27812024-11-02T06:32:48.050ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27822024-11-02T06:32:48.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27832024-11-02T06:32:48.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
27842024-11-02T06:32:48.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
27852024-11-02T06:32:48.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 113.931214ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
27862024-11-02T06:32:48.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27872024-11-02T06:32:48.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27882024-11-02T06:32:48.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27892024-11-02T06:32:48.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27902024-11-02T06:32:48.069ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27912024-11-02T06:32:48.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e910c408-e8f8-499f-81a3-43816eb138fc, lookup_type: ById(e910c408-e8f8-499f-81a3-43816eb138fc) } result = Ok(())
27922024-11-02T06:32:48.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27932024-11-02T06:32:48.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27942024-11-02T06:32:48.075ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 128.902512ms iteration = 27 status = 0
27952024-11-02T06:32:48.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27962024-11-02T06:32:48.077ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
27972024-11-02T06:32:48.077ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3492129c-7012-4d01-9997-b73cc054da28 dns_zone_name = oxide.test found_so_far = 0 version = 2
27982024-11-02T06:32:48.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27992024-11-02T06:32:48.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28002024-11-02T06:32:48.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
28012024-11-02T06:32:48.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28022024-11-02T06:32:48.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28032024-11-02T06:32:48.079ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28042024-11-02T06:32:48.079ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28052024-11-02T06:32:48.079ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28062024-11-02T06:32:48.079ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 133.557488ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28072024-11-02T06:32:48.082ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
28082024-11-02T06:32:48.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28092024-11-02T06:32:48.082ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ebec6ef1-d036-4e17-8eb7-453f158dbe5b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
28102024-11-02T06:32:48.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28112024-11-02T06:32:48.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28122024-11-02T06:32:48.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28132024-11-02T06:32:48.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28142024-11-02T06:32:48.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28152024-11-02T06:32:48.084ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3492129c-7012-4d01-9997-b73cc054da28 dns_zone_name = oxide.test found_so_far = 1 version = 2
28162024-11-02T06:32:48.084ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
28172024-11-02T06:32:48.084ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-02 06:20:14.983012 UTC dns_group = external generation = 2
28182024-11-02T06:32:48.084ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 138.610402ms iteration = 15 status = {"generation":2}
28192024-11-02T06:32:48.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
28202024-11-02T06:32:48.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28212024-11-02T06:32:48.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28222024-11-02T06:32:48.090ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
28232024-11-02T06:32:48.090ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
28242024-11-02T06:32:48.090ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 144.158155ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
28252024-11-02T06:32:48.090ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ebec6ef1-d036-4e17-8eb7-453f158dbe5b dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
28262024-11-02T06:32:48.090ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
28272024-11-02T06:32:48.090ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-02 06:20:14.397898 UTC dns_group = internal generation = 1
28282024-11-02T06:32:48.090ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 144.752686ms iteration = 15 status = {"generation":1}
28292024-11-02T06:32:48.090ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
28302024-11-02T06:32:48.090ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28312024-11-02T06:32:48.091ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f74888b4-a43b-4a72-b16b-5e02db52fef1", "content-length": "26", "date": "Sat, 02 Nov 2024 06:32:47 GMT"} })
28322024-11-02T06:32:48.091ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28332024-11-02T06:32:48.093ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28342024-11-02T06:32:48.095ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
28352024-11-02T06:32:48.096ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 150.127446ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
28362024-11-02T06:32:48.102ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
28372024-11-02T06:32:48.104ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-02T06:19:46.120247Z, time_modified: 2024-11-02T06:19:46.120247Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 59403eed-26d3-491e-a214-3ec0c7b10fb5, db_silo: Silo { identity: SiloIdentity { id: 59403eed-26d3-491e-a214-3ec0c7b10fb5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T06:20:14.941312Z, time_modified: 2024-11-02T06:20:14.941312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a5838a91006fb28d0b2bb1e66d2941fc0e90d5e4733e0b81cfebd701af94c573" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 59403eed-26d3-491e-a214-3ec0c7b10fb5, db_silo: Silo { identity: SiloIdentity { id: 59403eed-26d3-491e-a214-3ec0c7b10fb5, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-02T06:20:14.941312Z, time_modified: 2024-11-02T06:20:14.941312Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a5838a91006fb28d0b2bb1e66d2941fc0e90d5e4733e0b81cfebd701af94c573" }] }) }
28382024-11-02T06:32:48.104ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 158.45654ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"59403eed-26d3-491e-a214-3ec0c7b10fb5","tls_certs":["a5838a91006fb28d0b2bb1e66d2941fc0e90d5e4733e0b81cfebd701af94c573"]}},"default_endpoint":{"silo_id":"59403eed-26d3-491e-a214-3ec0c7b10fb5","tls_certs":["a5838a91006fb28d0b2bb1e66d2941fc0e90d5e4733e0b81cfebd701af94c573"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
28392024-11-02T06:32:48.104ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
28402024-11-02T06:32:48.108ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
28412024-11-02T06:32:48.108ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28422024-11-02T06:32:48.108ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ed7f0cb-9785-4d97-943d-17aebd004e78", "content-length": "26", "date": "Sat, 02 Nov 2024 06:32:47 GMT"} })
28432024-11-02T06:32:48.108ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28442024-11-02T06:32:48.110ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28452024-11-02T06:32:48.126ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 zone_address = fd00:1122:3344:101::2
28462024-11-02T06:32:48.126ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28472024-11-02T06:32:48.126ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "be0fe4ce-1d55-4b54-a7a0-4898b55555a0", "content-length": "26", "date": "Sat, 02 Nov 2024 06:32:47 GMT"} })
28482024-11-02T06:32:48.126ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28492024-11-02T06:32:48.128ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
28502024-11-02T06:32:48.151ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 205.566714ms iteration = 31 status = {"physical_disks_added":0}
28512024-11-02T06:32:48.159ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
28522024-11-02T06:32:48.160ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 214.171244ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
28532024-11-02T06:32:48.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28542024-11-02T06:32:48.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28552024-11-02T06:32:48.180ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28562024-11-02T06:32:48.183ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28572024-11-02T06:32:48.183ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28582024-11-02T06:32:48.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28592024-11-02T06:32:48.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28602024-11-02T06:32:48.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28612024-11-02T06:32:48.187ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28622024-11-02T06:32:48.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28632024-11-02T06:32:48.260ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
28642024-11-02T06:32:48.260ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "471530df-c00e-4a1b-aa4c-9a6fa20466f5", "date": "Sat, 02 Nov 2024 06:32:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28652024-11-02T06:32:48.260ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28662024-11-02T06:32:48.262ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1356734a-23c5-4fee-af18-494d8dd78292", "date": "Sat, 02 Nov 2024 06:32:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28672024-11-02T06:32:48.262ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28682024-11-02T06:32:48.263ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 317.164685ms iteration = 27 status = {}
28692024-11-02T06:32:48.264ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
28702024-11-02T06:32:48.264ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 318.730084ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
28712024-11-02T06:32:48.267ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28722024-11-02T06:32:48.268ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "18562604-31ea-4d30-8f56-f208b0cad473", "content-length": "2", "date": "Sat, 02 Nov 2024 06:32:47 GMT"} })
28732024-11-02T06:32:48.270ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28742024-11-02T06:32:48.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28752024-11-02T06:32:48.282ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28762024-11-02T06:32:48.282ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28772024-11-02T06:32:48.282ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfee1a56-7684-4a5a-abc6-d823c509c2b6", "content-length": "372", "date": "Sat, 02 Nov 2024 06:32:47 GMT"} })
28782024-11-02T06:32:48.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28792024-11-02T06:32:48.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28802024-11-02T06:32:48.283ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
28812024-11-02T06:32:48.285ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 339.270634ms iteration = 27 status = null
28822024-11-02T06:32:48.299ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
28832024-11-02T06:32:48.299ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28842024-11-02T06:32:48.299ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4f69d5bb-d144-496e-8050-f4b19bd0d5c6", "date": "Sat, 02 Nov 2024 06:32:47 GMT"} })
28852024-11-02T06:32:48.299ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28862024-11-02T06:32:48.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28872024-11-02T06:32:48.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28882024-11-02T06:32:48.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28892024-11-02T06:32:48.306ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28902024-11-02T06:32:48.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28912024-11-02T06:32:48.316ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28922024-11-02T06:32:48.317ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5c9e805-3d7d-46e8-ac00-2a3d66ff6b1a", "content-length": "691", "date": "Sat, 02 Nov 2024 06:32:47 GMT"} })
28932024-11-02T06:32:48.317ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
28942024-11-02T06:32:48.317ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
28952024-11-02T06:32:48.317ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
28962024-11-02T06:32:48.319ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 373.053952ms iteration = 28 status = {}
28972024-11-02T06:32:48.319ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28982024-11-02T06:32:48.319ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28992024-11-02T06:32:48.320ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d8ef1f9c-9274-484f-86fc-fc9efbb5b306", "date": "Sat, 02 Nov 2024 06:32:47 GMT"} })
29002024-11-02T06:32:48.321ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 375.794742ms iteration = 29 status = {}
29012024-11-02T06:32:48.352ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
29022024-11-02T06:32:48.353ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "828a9ea7-fc8a-45a5-916d-d4e960ed284d", "date": "Sat, 02 Nov 2024 06:32:48 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29032024-11-02T06:32:48.353ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29042024-11-02T06:32:48.355ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e5e92188-1acc-4a3f-8f47-657912fc1318", "date": "Sat, 02 Nov 2024 06:32:48 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29052024-11-02T06:32:48.355ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29062024-11-02T06:32:48.356ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5976756b-26ed-455d-8357-e9e5632d610a", "date": "Sat, 02 Nov 2024 06:32:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29072024-11-02T06:32:48.356ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29082024-11-02T06:32:48.358ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29092024-11-02T06:32:48.358ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 412.677687ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
29102024-11-02T06:32:48.385ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29112024-11-02T06:32:48.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29122024-11-02T06:32:48.387ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 29c3f6a1-2034-455b-bc3b-3fbebec1d7c1, rack_id: a9cb4975-e69e-4875-af6f-759c07abd8a8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(72902c82-00a8-446a-b727-41c9c8c92f9b) } rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0
29132024-11-02T06:32:48.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29142024-11-02T06:32:48.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29152024-11-02T06:32:48.395ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29162024-11-02T06:32:48.396ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f14beccd-d8ea-4d99-ba84-2c8f9b120adb", "content-length": "134", "date": "Sat, 02 Nov 2024 06:32:48 GMT"} })
29172024-11-02T06:32:48.396ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29182024-11-02T06:32:48.396ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 72902c82-00a8-446a-b727-41c9c8c92f9b
29192024-11-02T06:32:48.396ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29202024-11-02T06:32:48.396ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29212024-11-02T06:32:48.396ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29222024-11-02T06:32:48.396ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29232024-11-02T06:32:48.396ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29242024-11-02T06:32:48.396ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29252024-11-02T06:32:48.396ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29262024-11-02T06:32:48.396ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29272024-11-02T06:32:48.396ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
29282024-11-02T06:32:48.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29292024-11-02T06:32:48.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29302024-11-02T06:32:48.398ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29312024-11-02T06:32:48.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bb54e2b-d1b2-4c43-b9a6-6a22e7fc6f56", "content-length": "2", "date": "Sat, 02 Nov 2024 06:32:48 GMT"} })
29322024-11-02T06:32:48.399ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29332024-11-02T06:32:48.399ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e99117a-ac1d-4d9c-92b2-bb3e2b834709", "content-length": "52", "date": "Sat, 02 Nov 2024 06:32:48 GMT"} })
29342024-11-02T06:32:48.399ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0
29352024-11-02T06:32:48.399ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29362024-11-02T06:32:48.509ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7477defa-c936-4aa2-a784-e5ff698b6d56", "date": "Sat, 02 Nov 2024 06:32:47 GMT"} })
29372024-11-02T06:32:48.509ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch = Switch0
29382024-11-02T06:32:48.509ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29392024-11-02T06:32:48.510ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4cc1952-030b-4f8a-9e03-cb7b31bec56c", "content-length": "682", "date": "Sat, 02 Nov 2024 06:32:48 GMT"} })
29402024-11-02T06:32:48.510ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29412024-11-02T06:32:48.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29422024-11-02T06:32:48.513ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29432024-11-02T06:32:48.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29442024-11-02T06:32:48.517ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29452024-11-02T06:32:48.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29462024-11-02T06:32:48.519ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29472024-11-02T06:32:48.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29482024-11-02T06:32:48.526ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 580.207375ms iteration = 27 status = {}
29492024-11-02T06:32:48.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3df5d8b5-8327-4d3a-ab3a-428a60800878 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29502024-11-02T06:32:48.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3df5d8b5-8327-4d3a-ab3a-428a60800878 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29512024-11-02T06:32:48.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3df5d8b5-8327-4d3a-ab3a-428a60800878 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29522024-11-02T06:32:49.399ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1412 local_addr = [fd00:1122:3344:101::c]:45423 method = GET remote_addr = [fd00:1122:3344:101::d]:54698 req_id = bf62ce44-f08e-439a-8de6-0b55fc95887a response_code = 200 uri = /0b0286d1-4696-4dd6-a80e-495d344ae645
29532024-11-02T06:32:49.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7b404a4e-4eee-4532-a983-604f32f7817e roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29542024-11-02T06:32:49.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7b404a4e-4eee-4532-a983-604f32f7817e resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29552024-11-02T06:32:49.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1862 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 7b404a4e-4eee-4532-a983-604f32f7817e response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29562024-11-02T06:32:50.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 720ce436-0498-4236-a058-485109049206 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29572024-11-02T06:32:50.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 720ce436-0498-4236-a058-485109049206 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29582024-11-02T06:32:50.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 720ce436-0498-4236-a058-485109049206 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29592024-11-02T06:32:51.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d707b569-fd2e-4032-a443-806b36efdf86 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29602024-11-02T06:32:51.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d707b569-fd2e-4032-a443-806b36efdf86 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29612024-11-02T06:32:51.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d707b569-fd2e-4032-a443-806b36efdf86 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29622024-11-02T06:32:52.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ec47efb2-cef5-48a5-8f71-de32138dd4b1 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29632024-11-02T06:32:52.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ec47efb2-cef5-48a5-8f71-de32138dd4b1 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29642024-11-02T06:32:52.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = ec47efb2-cef5-48a5-8f71-de32138dd4b1 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29652024-11-02T06:32:53.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f42fc66c-3f0c-4931-ab28-65828a8c56f2 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29662024-11-02T06:32:53.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f42fc66c-3f0c-4931-ab28-65828a8c56f2 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29672024-11-02T06:32:53.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = f42fc66c-3f0c-4931-ab28-65828a8c56f2 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29682024-11-02T06:32:54.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = bb1db5f9-2721-47ee-80c7-31c8c7dc58e5 roles = RoleSet { roles: {} } uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
29692024-11-02T06:32:54.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = bb1db5f9-2721-47ee-80c7-31c8c7dc58e5 resource = Database result = Ok(()) uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
29702024-11-02T06:32:54.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = bb1db5f9-2721-47ee-80c7-31c8c7dc58e5 response_code = 200 uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?sort_by=id_ascending
29712024-11-02T06:32:54.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = d27e7452-d89a-46fc-9158-530a6a017ac8 roles = RoleSet { roles: {} } uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
29722024-11-02T06:32:54.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = d27e7452-d89a-46fc-9158-530a6a017ac8 resource = Database result = Ok(()) uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
29732024-11-02T06:32:54.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2756 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:52843 req_id = d27e7452-d89a-46fc-9158-530a6a017ac8 response_code = 200 uri = /metrics/collectors/13175a5b-eed9-4b10-bbf4-9e75d4d6ef03/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMjE2OWMwNi1lY2ZkLTQ4YjEtOThiOS03MWFkMTI1MzY4ZTAifX0%3D
29742024-11-02T06:32:55.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 426c593d-82c1-4e12-9c42-7f61dfed8b54 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29752024-11-02T06:32:55.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 426c593d-82c1-4e12-9c42-7f61dfed8b54 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29762024-11-02T06:32:55.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 426c593d-82c1-4e12-9c42-7f61dfed8b54 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29772024-11-02T06:32:56.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 435f8bc0-1a05-49f9-aed0-fcc0dd82a407 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29782024-11-02T06:32:56.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 435f8bc0-1a05-49f9-aed0-fcc0dd82a407 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29792024-11-02T06:32:56.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 435f8bc0-1a05-49f9-aed0-fcc0dd82a407 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29802024-11-02T06:32:57.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 186d3fab-6f0b-42c3-b91d-aa343e9111c8 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29812024-11-02T06:32:57.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 186d3fab-6f0b-42c3-b91d-aa343e9111c8 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29822024-11-02T06:32:57.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 186d3fab-6f0b-42c3-b91d-aa343e9111c8 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
29832024-11-02T06:32:57.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
29842024-11-02T06:32:57.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
29852024-11-02T06:32:57.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29862024-11-02T06:32:57.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29872024-11-02T06:32:57.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29882024-11-02T06:32:57.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29892024-11-02T06:32:57.947ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29902024-11-02T06:32:57.947ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29912024-11-02T06:32:57.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29922024-11-02T06:32:57.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.966953ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29932024-11-02T06:32:57.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29942024-11-02T06:32:57.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29952024-11-02T06:32:57.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29962024-11-02T06:32:57.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29972024-11-02T06:32:57.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29982024-11-02T06:32:57.953ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29992024-11-02T06:32:57.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
30002024-11-02T06:32:57.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30012024-11-02T06:32:57.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30022024-11-02T06:32:57.964ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
30032024-11-02T06:32:57.964ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.658967ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
30042024-11-02T06:32:58.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 56f06ae6-1410-4940-808a-3d2640604998 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30052024-11-02T06:32:58.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 56f06ae6-1410-4940-808a-3d2640604998 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30062024-11-02T06:32:58.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 56f06ae6-1410-4940-808a-3d2640604998 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30072024-11-02T06:32:59.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d73ca9d8-bd06-406f-aca2-0fd0e92b571f roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30082024-11-02T06:32:59.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d73ca9d8-bd06-406f-aca2-0fd0e92b571f resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30092024-11-02T06:32:59.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2035 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d73ca9d8-bd06-406f-aca2-0fd0e92b571f response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30102024-11-02T06:33:00.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d69b781b-00c0-4222-be68-de51a5b5225f roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30112024-11-02T06:33:00.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d69b781b-00c0-4222-be68-de51a5b5225f resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30122024-11-02T06:33:00.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d69b781b-00c0-4222-be68-de51a5b5225f response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30132024-11-02T06:33:01.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a26dea4c-0b22-4854-8f1b-018251ebeaf7 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30142024-11-02T06:33:01.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a26dea4c-0b22-4854-8f1b-018251ebeaf7 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30152024-11-02T06:33:01.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a26dea4c-0b22-4854-8f1b-018251ebeaf7 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30162024-11-02T06:33:02.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fc369aa6-9c38-48d8-a5ed-2993338c1217 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30172024-11-02T06:33:02.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fc369aa6-9c38-48d8-a5ed-2993338c1217 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30182024-11-02T06:33:02.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2762 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fc369aa6-9c38-48d8-a5ed-2993338c1217 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30192024-11-02T06:33:03.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d6b1ff6a-1e43-44c6-aed0-3b01e7977fd2 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30202024-11-02T06:33:03.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d6b1ff6a-1e43-44c6-aed0-3b01e7977fd2 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30212024-11-02T06:33:03.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = d6b1ff6a-1e43-44c6-aed0-3b01e7977fd2 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30222024-11-02T06:33:04.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1f5bfb3c-0600-445c-8f50-2bf00a1055ca roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30232024-11-02T06:33:04.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1f5bfb3c-0600-445c-8f50-2bf00a1055ca resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30242024-11-02T06:33:04.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1864 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 1f5bfb3c-0600-445c-8f50-2bf00a1055ca response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30252024-11-02T06:33:04.399ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1627 local_addr = [fd00:1122:3344:101::c]:45423 method = GET remote_addr = [fd00:1122:3344:101::d]:54698 req_id = abe74a6c-55c8-4faf-9688-46cdb7097ba8 response_code = 200 uri = /0b0286d1-4696-4dd6-a80e-495d344ae645
30262024-11-02T06:33:05.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3e63cfae-d67f-4f09-8bf2-178adb6930fc roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30272024-11-02T06:33:05.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3e63cfae-d67f-4f09-8bf2-178adb6930fc resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30282024-11-02T06:33:05.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 3e63cfae-d67f-4f09-8bf2-178adb6930fc response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30292024-11-02T06:33:06.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a26c56e5-4faa-43cb-b494-b520f9e69d2b roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30302024-11-02T06:33:06.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a26c56e5-4faa-43cb-b494-b520f9e69d2b resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30312024-11-02T06:33:06.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = a26c56e5-4faa-43cb-b494-b520f9e69d2b response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30322024-11-02T06:33:07.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 2fd4d041-e53a-4f45-a13e-bbcaa3bfb3af roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30332024-11-02T06:33:07.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 2fd4d041-e53a-4f45-a13e-bbcaa3bfb3af resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30342024-11-02T06:33:07.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 2fd4d041-e53a-4f45-a13e-bbcaa3bfb3af response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30352024-11-02T06:33:07.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
30362024-11-02T06:33:07.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
30372024-11-02T06:33:07.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30382024-11-02T06:33:07.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30392024-11-02T06:33:07.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30402024-11-02T06:33:07.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30412024-11-02T06:33:07.947ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30422024-11-02T06:33:07.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30432024-11-02T06:33:07.948ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30442024-11-02T06:33:07.949ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.378882ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30452024-11-02T06:33:07.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30462024-11-02T06:33:07.950ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30472024-11-02T06:33:07.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30482024-11-02T06:33:07.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30492024-11-02T06:33:07.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30502024-11-02T06:33:07.953ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30512024-11-02T06:33:07.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
30522024-11-02T06:33:07.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30532024-11-02T06:33:07.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30542024-11-02T06:33:07.964ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
30552024-11-02T06:33:07.964ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.87416ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
30562024-11-02T06:33:08.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 8bbd8c9b-5052-434a-8272-d3811522b569 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30572024-11-02T06:33:08.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 8bbd8c9b-5052-434a-8272-d3811522b569 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30582024-11-02T06:33:08.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 8bbd8c9b-5052-434a-8272-d3811522b569 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30592024-11-02T06:33:09.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5d2e82ce-e8c3-4808-af3b-6b0d4b081210 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30602024-11-02T06:33:09.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5d2e82ce-e8c3-4808-af3b-6b0d4b081210 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30612024-11-02T06:33:09.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 5d2e82ce-e8c3-4808-af3b-6b0d4b081210 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30622024-11-02T06:33:09.928ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33999
30632024-11-02T06:33:09.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33999 req_id = 5db393dd-b092-4766-9cbe-68c6dbf0e4ba roles = RoleSet { roles: {} } uri = /metrics/producers
30642024-11-02T06:33:09.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33999 req_id = 5db393dd-b092-4766-9cbe-68c6dbf0e4ba resource = Database result = Ok(()) uri = /metrics/producers
30652024-11-02T06:33:09.939ZINFOnexus: assigned collector to new producer collector_id = 13175a5b-eed9-4b10-bbf4-9e75d4d6ef03 file = nexus/src/app/oximeter.rs:76 producer_id = 52ca2d34-0954-4f9a-ab69-c867b3191a66
30662024-11-02T06:33:09.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10647 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33999 req_id = 5db393dd-b092-4766-9cbe-68c6dbf0e4ba response_code = 201 uri = /metrics/producers
30672024-11-02T06:33:10.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 93b44777-801f-4328-a135-66f487474de5 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30682024-11-02T06:33:10.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 93b44777-801f-4328-a135-66f487474de5 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30692024-11-02T06:33:10.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 93b44777-801f-4328-a135-66f487474de5 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30702024-11-02T06:33:11.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 948798de-4311-4c6b-a0f4-6b0cbe1a9a38 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30712024-11-02T06:33:11.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 948798de-4311-4c6b-a0f4-6b0cbe1a9a38 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30722024-11-02T06:33:11.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 948798de-4311-4c6b-a0f4-6b0cbe1a9a38 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30732024-11-02T06:33:12.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 8b2849a4-7b92-40c7-b5b9-cc5466e81386 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30742024-11-02T06:33:12.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 8b2849a4-7b92-40c7-b5b9-cc5466e81386 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30752024-11-02T06:33:12.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 8b2849a4-7b92-40c7-b5b9-cc5466e81386 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30762024-11-02T06:33:13.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b292ea79-91d5-4532-8da9-a0da7f68e2fc roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30772024-11-02T06:33:13.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b292ea79-91d5-4532-8da9-a0da7f68e2fc resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30782024-11-02T06:33:13.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = b292ea79-91d5-4532-8da9-a0da7f68e2fc response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30792024-11-02T06:33:14.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 879d0431-7617-429f-8fdb-ee0ca7e61d40 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
30802024-11-02T06:33:14.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 879d0431-7617-429f-8fdb-ee0ca7e61d40 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
30812024-11-02T06:33:14.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3759 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:53709 req_id = 879d0431-7617-429f-8fdb-ee0ca7e61d40 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
30822024-11-02T06:33:14.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9c520a4d-b66b-4d96-b52f-8d475f95dc88 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30832024-11-02T06:33:14.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9c520a4d-b66b-4d96-b52f-8d475f95dc88 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30842024-11-02T06:33:14.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 9c520a4d-b66b-4d96-b52f-8d475f95dc88 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30852024-11-02T06:33:15.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e35a98a4-8edb-4eaa-acec-b0dd17fd7069 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30862024-11-02T06:33:15.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e35a98a4-8edb-4eaa-acec-b0dd17fd7069 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30872024-11-02T06:33:15.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = e35a98a4-8edb-4eaa-acec-b0dd17fd7069 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30882024-11-02T06:33:16.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = dcd9ebb7-1b5b-4e46-89f0-68e1a3ad8d59 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30892024-11-02T06:33:16.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = dcd9ebb7-1b5b-4e46-89f0-68e1a3ad8d59 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30902024-11-02T06:33:16.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = dcd9ebb7-1b5b-4e46-89f0-68e1a3ad8d59 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30912024-11-02T06:33:17.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 03a13f4f-5c3a-4dff-970a-416ee6ecaad3 roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30922024-11-02T06:33:17.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 03a13f4f-5c3a-4dff-970a-416ee6ecaad3 resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30932024-11-02T06:33:17.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = 03a13f4f-5c3a-4dff-970a-416ee6ecaad3 response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
30942024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
30952024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
30962024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30972024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30982024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
30992024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
31002024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
31012024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
31022024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31032024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31042024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
31052024-11-02T06:33:17.945ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31062024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31072024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
31082024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31092024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31102024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
31112024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31122024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
31132024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31142024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
31152024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
31162024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31172024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
31182024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31192024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31202024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31212024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31222024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31232024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31242024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31252024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31262024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31272024-11-02T06:33:17.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31282024-11-02T06:33:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31292024-11-02T06:33:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31302024-11-02T06:33:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31312024-11-02T06:33:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31322024-11-02T06:33:17.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31332024-11-02T06:33:17.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
31342024-11-02T06:33:17.946ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
31352024-11-02T06:33:17.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.581\u{b5}s iteration = 28 status = {"errors":[],"records_set_to_done":[]}
31362024-11-02T06:33:17.947ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
31372024-11-02T06:33:17.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 9.191\u{b5}s iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
31382024-11-02T06:33:17.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.8\u{b5}s iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
31392024-11-02T06:33:17.947ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
31402024-11-02T06:33:17.947ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.86\u{b5}s iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
31412024-11-02T06:33:17.947ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.218551ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31422024-11-02T06:33:17.947ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31432024-11-02T06:33:17.948ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31442024-11-02T06:33:17.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31452024-11-02T06:33:17.949ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31462024-11-02T06:33:17.949ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5574, tv_nsec: 539188550 } })
31472024-11-02T06:33:17.950ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
31482024-11-02T06:33:17.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31492024-11-02T06:33:17.950ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31502024-11-02T06:33:17.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31512024-11-02T06:33:17.952ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5574, tv_nsec: 542232317 } })
31522024-11-02T06:33:17.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31532024-11-02T06:33:17.953ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
31542024-11-02T06:33:17.953ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31552024-11-02T06:33:17.953ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31562024-11-02T06:33:17.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
31572024-11-02T06:33:17.954ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31582024-11-02T06:33:17.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31592024-11-02T06:33:17.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31602024-11-02T06:33:17.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31612024-11-02T06:33:17.956ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31622024-11-02T06:33:17.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
31632024-11-02T06:33:17.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31642024-11-02T06:33:17.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31652024-11-02T06:33:17.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31662024-11-02T06:33:17.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31672024-11-02T06:33:17.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31682024-11-02T06:33:17.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31692024-11-02T06:33:17.961ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31702024-11-02T06:33:17.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31712024-11-02T06:33:17.962ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31722024-11-02T06:33:17.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31732024-11-02T06:33:17.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31742024-11-02T06:33:17.964ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31752024-11-02T06:33:17.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31762024-11-02T06:33:17.965ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31772024-11-02T06:33:17.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31782024-11-02T06:33:17.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31792024-11-02T06:33:17.967ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31802024-11-02T06:33:17.967ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e910c408-e8f8-499f-81a3-43816eb138fc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 5574, tv_nsec: 556915039 } })
31812024-11-02T06:33:17.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31822024-11-02T06:33:17.967ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
31832024-11-02T06:33:17.968ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31842024-11-02T06:33:17.969ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31852024-11-02T06:33:17.969ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 23.618379ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
31862024-11-02T06:33:17.969ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31872024-11-02T06:33:17.971ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31882024-11-02T06:33:17.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31892024-11-02T06:33:17.971ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31902024-11-02T06:33:17.971ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31912024-11-02T06:33:17.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31922024-11-02T06:33:17.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31932024-11-02T06:33:17.973ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31942024-11-02T06:33:17.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b67c0edc-c274-4bf1-b16f-6bc12e22e951, lookup_type: ById(b67c0edc-c274-4bf1-b16f-6bc12e22e951) } result = Ok(())
31952024-11-02T06:33:17.973ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31962024-11-02T06:33:17.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31972024-11-02T06:33:17.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31982024-11-02T06:33:17.975ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31992024-11-02T06:33:17.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32002024-11-02T06:33:17.980ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32012024-11-02T06:33:17.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32022024-11-02T06:33:17.983ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32032024-11-02T06:33:17.986ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
32042024-11-02T06:33:17.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32052024-11-02T06:33:17.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
32062024-11-02T06:33:17.996ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 original_time_created = 2024-11-02 06:19:34.134065 UTC target_id = b67c0edc-c274-4bf1-b16f-6bc12e22e951 time_created = 2024-11-02 06:19:34.134065 UTC
32072024-11-02T06:33:17.996ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.684171ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b67c0edc-c274-4bf1-b16f-6bc12e22e951","time_created":"2024-11-02T06:19:34.134065Z"}
32082024-11-02T06:33:17.996ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32092024-11-02T06:33:17.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32102024-11-02T06:33:18.002ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32112024-11-02T06:33:18.002ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32122024-11-02T06:33:18.002ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32132024-11-02T06:33:18.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32142024-11-02T06:33:18.005ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32152024-11-02T06:33:18.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32162024-11-02T06:33:18.007ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.322276ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32172024-11-02T06:33:18.077ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
32182024-11-02T06:33:18.077ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32192024-11-02T06:33:18.077ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7f3faad-d887-49a2-8f3c-dccf59603bcd", "content-length": "26", "date": "Sat, 02 Nov 2024 06:33:18 GMT"} })
32202024-11-02T06:33:18.077ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32212024-11-02T06:33:18.078ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 132.887256ms iteration = 32 status = {"physical_disks_added":0}
32222024-11-02T06:33:18.079ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32232024-11-02T06:33:18.090ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 zone_address = fd00:1122:3344:101::2
32242024-11-02T06:33:18.090ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32252024-11-02T06:33:18.090ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef4b58e4-b61f-40ea-b020-c7787b2cdf3c", "content-length": "26", "date": "Sat, 02 Nov 2024 06:33:18 GMT"} })
32262024-11-02T06:33:18.090ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32272024-11-02T06:33:18.092ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
32282024-11-02T06:33:18.162ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
32292024-11-02T06:33:18.162ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32302024-11-02T06:33:18.162ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ba9067e-0616-4dcb-97e2-2082aa848df3", "content-length": "26", "date": "Sat, 02 Nov 2024 06:33:18 GMT"} })
32312024-11-02T06:33:18.162ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32322024-11-02T06:33:18.163ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32332024-11-02T06:33:18.183ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32342024-11-02T06:33:18.183ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32352024-11-02T06:33:18.184ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c524a98d-141e-47c9-b75f-1674c3e91274", "content-length": "372", "date": "Sat, 02 Nov 2024 06:33:17 GMT"} })
32362024-11-02T06:33:18.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32372024-11-02T06:33:18.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32382024-11-02T06:33:18.187ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32392024-11-02T06:33:18.188ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcb8f1c1-201b-4a26-b310-ddcdc0a06d47", "content-length": "2", "date": "Sat, 02 Nov 2024 06:33:17 GMT"} })
32402024-11-02T06:33:18.189ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32412024-11-02T06:33:18.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32422024-11-02T06:33:18.191ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 246.349601ms iteration = 28 status = null
32432024-11-02T06:33:18.192ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32442024-11-02T06:33:18.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32452024-11-02T06:33:18.193ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32462024-11-02T06:33:18.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e910c408-e8f8-499f-81a3-43816eb138fc, lookup_type: ById(e910c408-e8f8-499f-81a3-43816eb138fc) } result = Ok(())
32472024-11-02T06:33:18.197ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32482024-11-02T06:33:18.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32492024-11-02T06:33:18.199ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 254.094265ms iteration = 28 status = 0
32502024-11-02T06:33:18.223ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32512024-11-02T06:33:18.223ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
32522024-11-02T06:33:18.223ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32532024-11-02T06:33:18.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32542024-11-02T06:33:18.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 285.293363ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32552024-11-02T06:33:18.231ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
32562024-11-02T06:33:18.231ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32572024-11-02T06:33:18.232ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cf985929-4bf9-49fa-9422-554bed9e3cc0", "date": "Sat, 02 Nov 2024 06:33:17 GMT"} })
32582024-11-02T06:33:18.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32592024-11-02T06:33:18.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32602024-11-02T06:33:18.244ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 298.886196ms iteration = 28 status = {}
32612024-11-02T06:33:18.263ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32622024-11-02T06:33:18.263ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "05936ce1-8d12-4e76-8d24-a9e58ad64df2", "content-length": "691", "date": "Sat, 02 Nov 2024 06:33:17 GMT"} })
32632024-11-02T06:33:18.263ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
32642024-11-02T06:33:18.263ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
32652024-11-02T06:33:18.263ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
32662024-11-02T06:33:18.265ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 320.047908ms iteration = 29 status = {}
32672024-11-02T06:33:18.266ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32682024-11-02T06:33:18.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32692024-11-02T06:33:18.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32702024-11-02T06:33:18.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32712024-11-02T06:33:18.272ZINFOnexus (BackgroundTasks): VPC route manager sled e910c408-e8f8-499f-81a3-43816eb138fc push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32722024-11-02T06:33:18.272ZDEBGnexus (BackgroundTasks): client request SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32732024-11-02T06:33:18.272ZDEBGnexus (BackgroundTasks): client response SledAgent = e910c408-e8f8-499f-81a3-43816eb138fc background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1e718360-3dca-4dd2-8037-374611d530d6", "date": "Sat, 02 Nov 2024 06:33:17 GMT"} })
32742024-11-02T06:33:18.274ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 328.669508ms iteration = 30 status = {}
32752024-11-02T06:33:18.292ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32762024-11-02T06:33:18.292ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32772024-11-02T06:33:18.292ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 347.258403ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32782024-11-02T06:33:18.294ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32792024-11-02T06:33:18.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32802024-11-02T06:33:18.296ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 29c3f6a1-2034-455b-bc3b-3fbebec1d7c1, rack_id: a9cb4975-e69e-4875-af6f-759c07abd8a8, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(72902c82-00a8-446a-b727-41c9c8c92f9b) } rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0
32812024-11-02T06:33:18.296ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32822024-11-02T06:33:18.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32832024-11-02T06:33:18.305ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
32842024-11-02T06:33:18.305ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "545feac5-e61c-427f-8cd6-2329437fd326", "content-length": "134", "date": "Sat, 02 Nov 2024 06:33:17 GMT"} })
32852024-11-02T06:33:18.305ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
32862024-11-02T06:33:18.305ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 72902c82-00a8-446a-b727-41c9c8c92f9b
32872024-11-02T06:33:18.306ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
32882024-11-02T06:33:18.306ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
32892024-11-02T06:33:18.306ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32902024-11-02T06:33:18.306ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32912024-11-02T06:33:18.306ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32922024-11-02T06:33:18.306ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32932024-11-02T06:33:18.306ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32942024-11-02T06:33:18.306ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32952024-11-02T06:33:18.306ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8
32962024-11-02T06:33:18.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32972024-11-02T06:33:18.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32982024-11-02T06:33:18.308ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32992024-11-02T06:33:18.309ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5893359f-a9af-4dd3-8283-94a195c830e6", "content-length": "2", "date": "Sat, 02 Nov 2024 06:33:17 GMT"} })
33002024-11-02T06:33:18.309ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33012024-11-02T06:33:18.309ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d520f6e-635a-4ffd-a3d7-c9c4f3f63d10", "content-length": "52", "date": "Sat, 02 Nov 2024 06:33:17 GMT"} })
33022024-11-02T06:33:18.309ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch_location = Switch0
33032024-11-02T06:33:18.309ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33042024-11-02T06:33:18.417ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d35514a4-3ff6-4ffb-9af3-b076cfa3befa", "date": "Sat, 02 Nov 2024 06:33:17 GMT"} })
33052024-11-02T06:33:18.417ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 switch = Switch0
33062024-11-02T06:33:18.417ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33072024-11-02T06:33:18.418ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = a9cb4975-e69e-4875-af6f-759c07abd8a8 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ba11853-6afd-4e6f-b09b-25e6f2e1a58d", "content-length": "682", "date": "Sat, 02 Nov 2024 06:33:17 GMT"} })
33082024-11-02T06:33:18.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33092024-11-02T06:33:18.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33102024-11-02T06:33:18.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33112024-11-02T06:33:18.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33122024-11-02T06:33:18.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33132024-11-02T06:33:18.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33142024-11-02T06:33:18.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33152024-11-02T06:33:18.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33162024-11-02T06:33:18.434ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 488.672467ms iteration = 28 status = {}
33172024-11-02T06:33:18.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fe0aba1c-e912-45fc-864d-3f3ee3abdd9f roles = RoleSet { roles: {} } uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
33182024-11-02T06:33:18.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fe0aba1c-e912-45fc-864d-3f3ee3abdd9f resource = Database result = Ok(()) uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
33192024-11-02T06:33:18.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42895 req_id = fe0aba1c-e912-45fc-864d-3f3ee3abdd9f response_code = 200 uri = /probes/e910c408-e8f8-499f-81a3-43816eb138fc
33202024-11-02T06:33:19.399ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1586 local_addr = [fd00:1122:3344:101::c]:45423 method = GET remote_addr = [fd00:1122:3344:101::d]:54698 req_id = 88b189d7-2952-47db-99af-70667353afc2 response_code = 200 uri = /0b0286d1-4696-4dd6-a80e-495d344ae645