Max level shown:
12024-12-02T16:45:01.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9908128f-7ee5-484b-af24-39680daceaa8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22024-12-02T16:45:01.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9908128f-7ee5-484b-af24-39680daceaa8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32024-12-02T16:45:01.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2626 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9908128f-7ee5-484b-af24-39680daceaa8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42024-12-02T16:45:02.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 84fca335-6bc7-4b1b-a2d1-c73180741137 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52024-12-02T16:45:02.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 84fca335-6bc7-4b1b-a2d1-c73180741137 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
62024-12-02T16:45:02.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 84fca335-6bc7-4b1b-a2d1-c73180741137 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
72024-12-02T16:45:03.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 29a90fdd-553d-486b-9952-f52a0d8ca76c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
82024-12-02T16:45:03.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 29a90fdd-553d-486b-9952-f52a0d8ca76c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
92024-12-02T16:45:03.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 29a90fdd-553d-486b-9952-f52a0d8ca76c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
102024-12-02T16:45:04.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 18d256c6-9c67-4657-9433-6c084b13bd60 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112024-12-02T16:45:04.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 18d256c6-9c67-4657-9433-6c084b13bd60 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
122024-12-02T16:45:04.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 18d256c6-9c67-4657-9433-6c084b13bd60 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
132024-12-02T16:45:05.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f5cb6aac-5817-4e4e-8370-cb78921c4543 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
142024-12-02T16:45:05.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f5cb6aac-5817-4e4e-8370-cb78921c4543 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
152024-12-02T16:45:05.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f5cb6aac-5817-4e4e-8370-cb78921c4543 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
162024-12-02T16:45:06.548ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1653 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = d71f15ad-efc0-4fa7-9187-7bd5a5f962dc response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
172024-12-02T16:45:06.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a88d60af-1ee8-4650-87ce-29a14ff56176 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
182024-12-02T16:45:06.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a88d60af-1ee8-4650-87ce-29a14ff56176 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
192024-12-02T16:45:06.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a88d60af-1ee8-4650-87ce-29a14ff56176 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
202024-12-02T16:45:07.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3d5846ef-cc9d-4fe0-bf4a-9cadde99bb91 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
212024-12-02T16:45:07.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3d5846ef-cc9d-4fe0-bf4a-9cadde99bb91 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
222024-12-02T16:45:07.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3d5846ef-cc9d-4fe0-bf4a-9cadde99bb91 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
232024-12-02T16:45:08.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 016c40bc-9e3b-4b45-92d3-b98967a9b4a4 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
242024-12-02T16:45:08.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 016c40bc-9e3b-4b45-92d3-b98967a9b4a4 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
252024-12-02T16:45:08.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1742 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 016c40bc-9e3b-4b45-92d3-b98967a9b4a4 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
262024-12-02T16:45:09.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 51bfb914-50fd-4e2e-9c9b-b78754b7415b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
272024-12-02T16:45:09.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 51bfb914-50fd-4e2e-9c9b-b78754b7415b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
282024-12-02T16:45:09.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 51bfb914-50fd-4e2e-9c9b-b78754b7415b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
292024-12-02T16:45:09.785ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
302024-12-02T16:45:09.786ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
312024-12-02T16:45:09.786ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
322024-12-02T16:45:09.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
332024-12-02T16:45:09.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
342024-12-02T16:45:09.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
352024-12-02T16:45:09.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
362024-12-02T16:45:09.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
372024-12-02T16:45:09.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
382024-12-02T16:45:09.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
392024-12-02T16:45:09.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
402024-12-02T16:45:09.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
412024-12-02T16:45:09.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
422024-12-02T16:45:09.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
432024-12-02T16:45:09.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
442024-12-02T16:45:09.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
452024-12-02T16:45:09.807ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
462024-12-02T16:45:09.807ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.493088ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
472024-12-02T16:45:09.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
482024-12-02T16:45:09.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
492024-12-02T16:45:09.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.969423ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
502024-12-02T16:45:10.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cca7deec-ebef-424b-b18e-499f7a3a4a41 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
512024-12-02T16:45:10.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cca7deec-ebef-424b-b18e-499f7a3a4a41 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
522024-12-02T16:45:10.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cca7deec-ebef-424b-b18e-499f7a3a4a41 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
532024-12-02T16:45:11.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cd91d6db-3feb-4454-a3fd-b16ae93e7261 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
542024-12-02T16:45:11.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cd91d6db-3feb-4454-a3fd-b16ae93e7261 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
552024-12-02T16:45:11.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cd91d6db-3feb-4454-a3fd-b16ae93e7261 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
562024-12-02T16:45:12.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0d155058-503c-4704-9e10-962f2cae0a38 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
572024-12-02T16:45:12.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0d155058-503c-4704-9e10-962f2cae0a38 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
582024-12-02T16:45:12.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0d155058-503c-4704-9e10-962f2cae0a38 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
592024-12-02T16:45:13.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 827c9ec8-9a7a-4b23-8edc-def9ef4908cd roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
602024-12-02T16:45:13.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 827c9ec8-9a7a-4b23-8edc-def9ef4908cd resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
612024-12-02T16:45:13.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 827c9ec8-9a7a-4b23-8edc-def9ef4908cd response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
622024-12-02T16:45:14.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e505bdd4-52b9-43df-9811-b125371fa66c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
632024-12-02T16:45:14.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e505bdd4-52b9-43df-9811-b125371fa66c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
642024-12-02T16:45:14.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e505bdd4-52b9-43df-9811-b125371fa66c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
652024-12-02T16:45:15.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7eb5e89d-6425-47de-a482-114412c3e7d2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
662024-12-02T16:45:15.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7eb5e89d-6425-47de-a482-114412c3e7d2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
672024-12-02T16:45:15.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7eb5e89d-6425-47de-a482-114412c3e7d2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
682024-12-02T16:45:16.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 01556170-cb82-4066-9914-a5e8040cb062 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
692024-12-02T16:45:16.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 01556170-cb82-4066-9914-a5e8040cb062 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
702024-12-02T16:45:16.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2749 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 01556170-cb82-4066-9914-a5e8040cb062 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
712024-12-02T16:45:16.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f4112e49-53a0-4a1a-931a-36bbaf9424f6 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
722024-12-02T16:45:16.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f4112e49-53a0-4a1a-931a-36bbaf9424f6 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
732024-12-02T16:45:16.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f4112e49-53a0-4a1a-931a-36bbaf9424f6 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
742024-12-02T16:45:16.549ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1454 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 110d3e8b-b81c-47c5-889d-f5d119b1b5d1 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
752024-12-02T16:45:16.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 17115f67-b33c-4afe-8ff6-b87c65c08006 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
762024-12-02T16:45:16.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 17115f67-b33c-4afe-8ff6-b87c65c08006 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
772024-12-02T16:45:16.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 17115f67-b33c-4afe-8ff6-b87c65c08006 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
782024-12-02T16:45:17.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd63da55-0727-49f4-887a-7ca684ab9385 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
792024-12-02T16:45:17.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd63da55-0727-49f4-887a-7ca684ab9385 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
802024-12-02T16:45:17.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd63da55-0727-49f4-887a-7ca684ab9385 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
812024-12-02T16:45:18.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b5a1d1b7-033c-4afb-8296-eb0763b6e2ea roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
822024-12-02T16:45:18.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b5a1d1b7-033c-4afb-8296-eb0763b6e2ea resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
832024-12-02T16:45:18.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b5a1d1b7-033c-4afb-8296-eb0763b6e2ea response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
842024-12-02T16:45:19.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 6aaf1bc9-442d-498b-ac18-31a1cfd1c63a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
852024-12-02T16:45:19.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 6aaf1bc9-442d-498b-ac18-31a1cfd1c63a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
862024-12-02T16:45:19.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 6aaf1bc9-442d-498b-ac18-31a1cfd1c63a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
872024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
882024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
892024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
902024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
912024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
922024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
932024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
942024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
952024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
962024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
972024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
982024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
992024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1002024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1012024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
1022024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1032024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
1042024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1052024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
1062024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
1072024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1082024-12-02T16:45:19.785ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1092024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1102024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1112024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1122024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1132024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1142024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1152024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1162024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1172024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1182024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1192024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
1202024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
1212024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1222024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
1232024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1242024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1252024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
1262024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1272024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
1282024-12-02T16:45:19.786ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1292024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1302024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
1312024-12-02T16:45:19.786ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1322024-12-02T16:45:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1332024-12-02T16:45:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1342024-12-02T16:45:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1352024-12-02T16:45:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1362024-12-02T16:45:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1372024-12-02T16:45:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1382024-12-02T16:45:19.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1392024-12-02T16:45:19.788ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1402024-12-02T16:45:19.789ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.295617ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1412024-12-02T16:45:19.789ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25481, tv_nsec: 534483895 } })
1422024-12-02T16:45:19.790ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
1432024-12-02T16:45:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1442024-12-02T16:45:19.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1452024-12-02T16:45:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1462024-12-02T16:45:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1472024-12-02T16:45:19.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1482024-12-02T16:45:19.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1492024-12-02T16:45:19.794ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25481, tv_nsec: 538581680 } })
1502024-12-02T16:45:19.794ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
1512024-12-02T16:45:19.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1522024-12-02T16:45:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1532024-12-02T16:45:19.798ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25481, tv_nsec: 543360282 } })
1542024-12-02T16:45:19.799ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
1552024-12-02T16:45:19.811ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1562024-12-02T16:45:19.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1572024-12-02T16:45:19.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1582024-12-02T16:45:19.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1592024-12-02T16:45:19.827ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1602024-12-02T16:45:19.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1612024-12-02T16:45:19.830ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1622024-12-02T16:45:19.830ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1632024-12-02T16:45:19.830ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1642024-12-02T16:45:19.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1652024-12-02T16:45:19.832ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1662024-12-02T16:45:19.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1672024-12-02T16:45:19.833ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1682024-12-02T16:45:19.834ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1692024-12-02T16:45:19.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1702024-12-02T16:45:19.835ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1712024-12-02T16:45:19.835ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1722024-12-02T16:45:19.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1732024-12-02T16:45:19.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1742024-12-02T16:45:19.835ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1752024-12-02T16:45:19.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1762024-12-02T16:45:19.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.342701ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
1772024-12-02T16:45:19.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1782024-12-02T16:45:19.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1792024-12-02T16:45:19.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1802024-12-02T16:45:19.837ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
1812024-12-02T16:45:19.837ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
1822024-12-02T16:45:19.837ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "484ac705-36d3-47f4-a367-c825fe23341b", "content-length": "26", "date": "Mon, 02 Dec 2024 16:45:19 GMT"} })
1832024-12-02T16:45:19.837ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
1842024-12-02T16:45:19.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.822622ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1852024-12-02T16:45:19.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1862024-12-02T16:45:19.839ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
1872024-12-02T16:45:19.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1882024-12-02T16:45:19.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1892024-12-02T16:45:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1902024-12-02T16:45:19.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1912024-12-02T16:45:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1922024-12-02T16:45:19.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1932024-12-02T16:45:19.841ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1942024-12-02T16:45:19.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1952024-12-02T16:45:19.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1962024-12-02T16:45:19.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1972024-12-02T16:45:19.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1982024-12-02T16:45:19.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1992024-12-02T16:45:19.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2002024-12-02T16:45:19.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2012024-12-02T16:45:19.847ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2022024-12-02T16:45:19.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2032024-12-02T16:45:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
2042024-12-02T16:45:19.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2052024-12-02T16:45:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2062024-12-02T16:45:19.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2072024-12-02T16:45:19.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2082024-12-02T16:45:19.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.058227ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
2092024-12-02T16:45:19.864ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
2102024-12-02T16:45:19.864ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2112024-12-02T16:45:19.864ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c75aaf9d-0940-471d-9ae8-a48553fe5aa6", "content-length": "26", "date": "Mon, 02 Dec 2024 16:45:19 GMT"} })
2122024-12-02T16:45:19.864ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2132024-12-02T16:45:19.866ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
2142024-12-02T16:45:19.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
2152024-12-02T16:45:19.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.441721ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
2162024-12-02T16:45:19.868ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2172024-12-02T16:45:19.868ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2182024-12-02T16:45:19.868ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2192024-12-02T16:45:19.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2202024-12-02T16:45:19.870ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2212024-12-02T16:45:19.870ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.248375ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2222024-12-02T16:45:19.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 84.139316ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2232024-12-02T16:45:19.873ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2242024-12-02T16:45:19.873ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2252024-12-02T16:45:19.873ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "307d5992-d6f8-43d3-8c21-b010badb4c8d", "content-length": "26", "date": "Mon, 02 Dec 2024 16:45:19 GMT"} })
2262024-12-02T16:45:19.873ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2272024-12-02T16:45:19.875ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2282024-12-02T16:45:19.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2292024-12-02T16:45:19.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2302024-12-02T16:45:19.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.980244ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2312024-12-02T16:45:19.878ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2322024-12-02T16:45:19.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7b9d457a-b704-4d07-b4c3-7ebe67027199 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
2332024-12-02T16:45:19.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2342024-12-02T16:45:19.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7b9d457a-b704-4d07-b4c3-7ebe67027199 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
2352024-12-02T16:45:19.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2362024-12-02T16:45:19.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7b9d457a-b704-4d07-b4c3-7ebe67027199 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
2372024-12-02T16:45:19.884ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
2382024-12-02T16:45:19.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2392024-12-02T16:45:19.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2402024-12-02T16:45:19.886ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 99.806262ms iteration = 4 status = 0
2412024-12-02T16:45:19.895ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2422024-12-02T16:45:19.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2432024-12-02T16:45:19.904ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2442024-12-02T16:45:19.904ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2452024-12-02T16:45:19.904ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.131991ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2462024-12-02T16:45:19.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.47468ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
2472024-12-02T16:45:19.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2482024-12-02T16:45:19.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2492024-12-02T16:45:19.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2502024-12-02T16:45:19.941ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2512024-12-02T16:45:19.941ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2522024-12-02T16:45:19.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2532024-12-02T16:45:19.943ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 157.722029ms iteration = 4 status = {}
2542024-12-02T16:45:19.943ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2552024-12-02T16:45:19.945ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2562024-12-02T16:45:19.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2572024-12-02T16:45:19.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2582024-12-02T16:45:19.950ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 165.219114ms iteration = 7 status = {"physical_disks_added":0}
2592024-12-02T16:45:20.017ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2602024-12-02T16:45:20.018ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb59b529-5635-4ce9-bdca-f58011eb6f2c", "content-length": "1", "date": "Mon, 02 Dec 2024 16:45:19 GMT"} })
2612024-12-02T16:45:20.019ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2622024-12-02T16:45:20.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2632024-12-02T16:45:20.052ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2642024-12-02T16:45:20.052ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2652024-12-02T16:45:20.052ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ab4c935-a378-479a-b1e7-5c84f73098bc", "content-length": "372", "date": "Mon, 02 Dec 2024 16:45:19 GMT"} })
2662024-12-02T16:45:20.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2672024-12-02T16:45:20.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2682024-12-02T16:45:20.054ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 269.132202ms iteration = 4 status = null
2692024-12-02T16:45:20.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2702024-12-02T16:45:20.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2712024-12-02T16:45:20.088ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
2722024-12-02T16:45:20.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2732024-12-02T16:45:20.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2742024-12-02T16:45:20.100ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
2752024-12-02T16:45:20.100ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2762024-12-02T16:45:20.101ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "68c08a4c-d574-4bf5-b17e-929723c3321e", "date": "Mon, 02 Dec 2024 16:45:19 GMT"} })
2772024-12-02T16:45:20.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2782024-12-02T16:45:20.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2792024-12-02T16:45:20.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2802024-12-02T16:45:20.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2812024-12-02T16:45:20.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2822024-12-02T16:45:20.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2832024-12-02T16:45:20.109ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2842024-12-02T16:45:20.109ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2852024-12-02T16:45:20.110ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d4229e5a-288e-4c32-a3de-d29387eab98b", "date": "Mon, 02 Dec 2024 16:45:19 GMT"} })
2862024-12-02T16:45:20.111ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 324.764138ms iteration = 5 status = {}
2872024-12-02T16:45:20.146ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2882024-12-02T16:45:20.147ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "35a6827a-5b2b-402b-8502-9c01bf5ca371", "content-length": "691", "date": "Mon, 02 Dec 2024 16:45:19 GMT"} })
2892024-12-02T16:45:20.147ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
2902024-12-02T16:45:20.147ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
2912024-12-02T16:45:20.147ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
2922024-12-02T16:45:20.149ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 364.131433ms iteration = 4 status = {}
2932024-12-02T16:45:20.204ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
2942024-12-02T16:45:20.204ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b7a9edb-fa26-42a4-9ec1-4d6aa45e1c71", "content-length": "134", "date": "Mon, 02 Dec 2024 16:45:19 GMT"} })
2952024-12-02T16:45:20.204ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
2962024-12-02T16:45:20.204ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
2972024-12-02T16:45:20.204ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2982024-12-02T16:45:20.204ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2992024-12-02T16:45:20.204ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3002024-12-02T16:45:20.204ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3012024-12-02T16:45:20.204ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3022024-12-02T16:45:20.204ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3032024-12-02T16:45:20.205ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3042024-12-02T16:45:20.205ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3052024-12-02T16:45:20.205ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
3062024-12-02T16:45:20.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3072024-12-02T16:45:20.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3082024-12-02T16:45:20.207ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
3092024-12-02T16:45:20.207ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "466f3201-bfae-4476-bb44-12c8f050d182", "content-length": "2", "date": "Mon, 02 Dec 2024 16:45:19 GMT"} })
3102024-12-02T16:45:20.207ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
3112024-12-02T16:45:20.207ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f55635b-f1ed-4ac9-951e-8b02731d3a07", "content-length": "52", "date": "Mon, 02 Dec 2024 16:45:19 GMT"} })
3122024-12-02T16:45:20.207ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
3132024-12-02T16:45:20.207ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3142024-12-02T16:45:20.300ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "32104791-59eb-4019-b13b-124e1c29ef62", "date": "Mon, 02 Dec 2024 16:45:19 GMT"} })
3152024-12-02T16:45:20.300ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
3162024-12-02T16:45:20.300ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3172024-12-02T16:45:20.300ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d78309cd-0d41-46d8-8959-c1dfd3cc4cce", "content-length": "682", "date": "Mon, 02 Dec 2024 16:45:19 GMT"} })
3182024-12-02T16:45:20.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3192024-12-02T16:45:20.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3202024-12-02T16:45:20.314ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3212024-12-02T16:45:20.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3222024-12-02T16:45:20.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3232024-12-02T16:45:20.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3242024-12-02T16:45:20.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3252024-12-02T16:45:20.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3262024-12-02T16:45:20.326ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 541.026269ms iteration = 4 status = {}
3272024-12-02T16:45:20.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6e667f01-d06f-4a1e-95c3-b8a48c399edd roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3282024-12-02T16:45:20.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6e667f01-d06f-4a1e-95c3-b8a48c399edd resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3292024-12-02T16:45:20.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6e667f01-d06f-4a1e-95c3-b8a48c399edd response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3302024-12-02T16:45:21.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fe331cf1-938e-403d-9622-0fb5f0668ae3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3312024-12-02T16:45:21.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fe331cf1-938e-403d-9622-0fb5f0668ae3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3322024-12-02T16:45:21.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fe331cf1-938e-403d-9622-0fb5f0668ae3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3332024-12-02T16:45:22.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6ea31e35-dbd5-47f2-9da3-950eab6b87bb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3342024-12-02T16:45:22.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6ea31e35-dbd5-47f2-9da3-950eab6b87bb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3352024-12-02T16:45:22.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6ea31e35-dbd5-47f2-9da3-950eab6b87bb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3362024-12-02T16:45:23.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4ce2a4e1-5865-452e-b122-50b737ce499c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3372024-12-02T16:45:23.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4ce2a4e1-5865-452e-b122-50b737ce499c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3382024-12-02T16:45:23.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4ce2a4e1-5865-452e-b122-50b737ce499c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3392024-12-02T16:45:24.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6e68a516-d87d-4fc9-96e3-3615acf7f7fe roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3402024-12-02T16:45:24.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6e68a516-d87d-4fc9-96e3-3615acf7f7fe resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3412024-12-02T16:45:24.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6e68a516-d87d-4fc9-96e3-3615acf7f7fe response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3422024-12-02T16:45:26.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 36c3a88a-fad4-4bee-bfe5-3577baf87512 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3432024-12-02T16:45:26.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 36c3a88a-fad4-4bee-bfe5-3577baf87512 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3442024-12-02T16:45:26.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 36c3a88a-fad4-4bee-bfe5-3577baf87512 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3452024-12-02T16:45:26.548ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1656 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = b67fa51e-d42e-42fb-8f98-3eb74cf4925d response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
3462024-12-02T16:45:27.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 31d22971-84d8-434c-b02f-b2841585dea5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3472024-12-02T16:45:27.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 31d22971-84d8-434c-b02f-b2841585dea5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3482024-12-02T16:45:27.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 31d22971-84d8-434c-b02f-b2841585dea5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3492024-12-02T16:45:28.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9902f783-7b01-45d3-9604-1ba8600ba8f6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3502024-12-02T16:45:28.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9902f783-7b01-45d3-9604-1ba8600ba8f6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3512024-12-02T16:45:28.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9902f783-7b01-45d3-9604-1ba8600ba8f6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3522024-12-02T16:45:29.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1575abb2-5b9b-45c2-8033-657f6a3de857 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3532024-12-02T16:45:29.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1575abb2-5b9b-45c2-8033-657f6a3de857 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3542024-12-02T16:45:29.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1575abb2-5b9b-45c2-8033-657f6a3de857 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3552024-12-02T16:45:29.786ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
3562024-12-02T16:45:29.786ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
3572024-12-02T16:45:29.786ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3582024-12-02T16:45:29.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3592024-12-02T16:45:29.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3602024-12-02T16:45:29.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3612024-12-02T16:45:29.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3622024-12-02T16:45:29.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3632024-12-02T16:45:29.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3642024-12-02T16:45:29.790ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.59901ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3652024-12-02T16:45:29.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3662024-12-02T16:45:29.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3672024-12-02T16:45:29.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3682024-12-02T16:45:29.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3692024-12-02T16:45:29.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3702024-12-02T16:45:29.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3712024-12-02T16:45:29.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
3722024-12-02T16:45:29.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3732024-12-02T16:45:29.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3742024-12-02T16:45:29.807ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
3752024-12-02T16:45:29.807ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.284107ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
3762024-12-02T16:45:30.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 540d91d5-abf0-481b-827e-6a2a4b876864 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3772024-12-02T16:45:30.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 540d91d5-abf0-481b-827e-6a2a4b876864 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3782024-12-02T16:45:30.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 540d91d5-abf0-481b-827e-6a2a4b876864 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3792024-12-02T16:45:31.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ad7b6dc-e87c-49de-9e7b-23935adcf6d1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3802024-12-02T16:45:31.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ad7b6dc-e87c-49de-9e7b-23935adcf6d1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3812024-12-02T16:45:31.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ad7b6dc-e87c-49de-9e7b-23935adcf6d1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3822024-12-02T16:45:32.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ab77471f-f01a-4ed6-8ed2-b94b2166c7a4 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3832024-12-02T16:45:32.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ab77471f-f01a-4ed6-8ed2-b94b2166c7a4 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3842024-12-02T16:45:32.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ab77471f-f01a-4ed6-8ed2-b94b2166c7a4 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3852024-12-02T16:45:33.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = de392c4a-f491-4a8b-9cb6-f0dbedeb2ad8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3862024-12-02T16:45:33.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = de392c4a-f491-4a8b-9cb6-f0dbedeb2ad8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3872024-12-02T16:45:33.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = de392c4a-f491-4a8b-9cb6-f0dbedeb2ad8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3882024-12-02T16:45:34.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a2d57573-a238-4cd1-9ca5-0cf4c529d66b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3892024-12-02T16:45:34.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a2d57573-a238-4cd1-9ca5-0cf4c529d66b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3902024-12-02T16:45:34.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a2d57573-a238-4cd1-9ca5-0cf4c529d66b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3912024-12-02T16:45:35.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fc8c8f6c-b862-42b0-8a10-6ca31acc57fe roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3922024-12-02T16:45:35.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fc8c8f6c-b862-42b0-8a10-6ca31acc57fe resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3932024-12-02T16:45:35.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fc8c8f6c-b862-42b0-8a10-6ca31acc57fe response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3942024-12-02T16:45:36.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4fdec1b1-7cc9-4412-9395-d5b6406fd055 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3952024-12-02T16:45:36.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4fdec1b1-7cc9-4412-9395-d5b6406fd055 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3962024-12-02T16:45:36.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4fdec1b1-7cc9-4412-9395-d5b6406fd055 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3972024-12-02T16:45:36.548ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1230 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 631659da-0809-435f-9d1e-39a4f85c8be6 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
3982024-12-02T16:45:37.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c15b9c44-f213-4b7e-a5ee-e25b80f7c3bf roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
3992024-12-02T16:45:37.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c15b9c44-f213-4b7e-a5ee-e25b80f7c3bf resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4002024-12-02T16:45:37.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c15b9c44-f213-4b7e-a5ee-e25b80f7c3bf response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4012024-12-02T16:45:38.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f52315ef-7dcb-4262-be49-dfc1c1dbec8a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4022024-12-02T16:45:38.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f52315ef-7dcb-4262-be49-dfc1c1dbec8a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4032024-12-02T16:45:38.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f52315ef-7dcb-4262-be49-dfc1c1dbec8a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4042024-12-02T16:45:39.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 16660911-7ef6-4a10-bb81-9c07cbf313a4 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4052024-12-02T16:45:39.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 16660911-7ef6-4a10-bb81-9c07cbf313a4 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4062024-12-02T16:45:39.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 16660911-7ef6-4a10-bb81-9c07cbf313a4 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4072024-12-02T16:45:39.786ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
4082024-12-02T16:45:39.786ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4092024-12-02T16:45:39.786ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
4102024-12-02T16:45:39.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4112024-12-02T16:45:39.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4122024-12-02T16:45:39.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4132024-12-02T16:45:39.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4142024-12-02T16:45:39.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4152024-12-02T16:45:39.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4162024-12-02T16:45:39.789ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.335199ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4172024-12-02T16:45:39.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4182024-12-02T16:45:39.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4192024-12-02T16:45:39.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4202024-12-02T16:45:39.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4212024-12-02T16:45:39.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4222024-12-02T16:45:39.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4232024-12-02T16:45:39.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
4242024-12-02T16:45:39.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4252024-12-02T16:45:39.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4262024-12-02T16:45:39.807ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
4272024-12-02T16:45:39.807ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.558469ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
4282024-12-02T16:45:40.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72782e2b-53c5-4a59-81e2-72bb63ab3a3e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4292024-12-02T16:45:40.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72782e2b-53c5-4a59-81e2-72bb63ab3a3e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4302024-12-02T16:45:40.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72782e2b-53c5-4a59-81e2-72bb63ab3a3e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4312024-12-02T16:45:41.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0cef167c-58ff-4e30-b53b-3ce4c0075622 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4322024-12-02T16:45:41.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0cef167c-58ff-4e30-b53b-3ce4c0075622 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4332024-12-02T16:45:41.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0cef167c-58ff-4e30-b53b-3ce4c0075622 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4342024-12-02T16:45:42.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7d751f23-9afd-4d57-a13d-802188b46403 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4352024-12-02T16:45:42.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7d751f23-9afd-4d57-a13d-802188b46403 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4362024-12-02T16:45:42.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2546 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7d751f23-9afd-4d57-a13d-802188b46403 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4372024-12-02T16:45:43.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c6f77f0c-7919-4e69-ba85-795fde8dbdcf roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4382024-12-02T16:45:43.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c6f77f0c-7919-4e69-ba85-795fde8dbdcf resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4392024-12-02T16:45:43.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c6f77f0c-7919-4e69-ba85-795fde8dbdcf response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4402024-12-02T16:45:44.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 04735713-aca9-47d9-a898-d598724ef5a3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4412024-12-02T16:45:44.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 04735713-aca9-47d9-a898-d598724ef5a3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4422024-12-02T16:45:44.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 04735713-aca9-47d9-a898-d598724ef5a3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4432024-12-02T16:45:45.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6cb98d94-3d65-4fca-b96f-cf3ca2af295d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4442024-12-02T16:45:45.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6cb98d94-3d65-4fca-b96f-cf3ca2af295d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4452024-12-02T16:45:45.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6cb98d94-3d65-4fca-b96f-cf3ca2af295d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4462024-12-02T16:45:46.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9487aad4-6ae4-4d8f-8d5c-8ce4e1f7f4d2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4472024-12-02T16:45:46.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9487aad4-6ae4-4d8f-8d5c-8ce4e1f7f4d2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4482024-12-02T16:45:46.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9487aad4-6ae4-4d8f-8d5c-8ce4e1f7f4d2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4492024-12-02T16:45:46.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 9d49b702-92c8-4aea-831b-5e58cacd63ac roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
4502024-12-02T16:45:46.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 9d49b702-92c8-4aea-831b-5e58cacd63ac resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
4512024-12-02T16:45:46.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 9d49b702-92c8-4aea-831b-5e58cacd63ac response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
4522024-12-02T16:45:46.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 060c8de5-3545-4569-9107-b0ae5bd78c68 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
4532024-12-02T16:45:46.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 060c8de5-3545-4569-9107-b0ae5bd78c68 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
4542024-12-02T16:45:46.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 060c8de5-3545-4569-9107-b0ae5bd78c68 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
4552024-12-02T16:45:46.550ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1759 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = c1da11b3-d75b-428e-97e8-29759c0676f1 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
4562024-12-02T16:45:47.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 64f39c37-782e-4988-b0e4-b9d99e513cdd roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4572024-12-02T16:45:47.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 64f39c37-782e-4988-b0e4-b9d99e513cdd resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4582024-12-02T16:45:47.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 64f39c37-782e-4988-b0e4-b9d99e513cdd response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4592024-12-02T16:45:48.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d775a6f2-7345-4afb-b1e1-d63501a36263 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4602024-12-02T16:45:48.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d775a6f2-7345-4afb-b1e1-d63501a36263 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4612024-12-02T16:45:48.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d775a6f2-7345-4afb-b1e1-d63501a36263 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4622024-12-02T16:45:49.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = c0abd731-94ac-408f-91fb-c7772eaad90b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
4632024-12-02T16:45:49.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = c0abd731-94ac-408f-91fb-c7772eaad90b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
4642024-12-02T16:45:49.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = c0abd731-94ac-408f-91fb-c7772eaad90b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
4652024-12-02T16:45:49.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 43c001ab-a13d-4bfd-94a7-d81ab7cba3ec roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4662024-12-02T16:45:49.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 43c001ab-a13d-4bfd-94a7-d81ab7cba3ec resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4672024-12-02T16:45:49.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1871 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 43c001ab-a13d-4bfd-94a7-d81ab7cba3ec response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
4682024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
4692024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
4702024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
4712024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4722024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4732024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4742024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
4752024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4762024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
4772024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
4782024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4792024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
4802024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4812024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
4822024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
4832024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4842024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
4852024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4862024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4872024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
4882024-12-02T16:45:49.787ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4892024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
4902024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4912024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4922024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
4932024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
4942024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
4952024-12-02T16:45:49.787ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c575ce6d-3e43-4b59-886a-60182869b755
4962024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.55\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"c575ce6d-3e43-4b59-886a-60182869b755"}
4972024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
4982024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
4992024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5002024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
5012024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5022024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
5032024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
5042024-12-02T16:45:49.787ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
5052024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5062024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5072024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
5082024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
5092024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5102024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
5112024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5122024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
5132024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
5142024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5152024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5162024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
5172024-12-02T16:45:49.787ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-02 16:35:49.787628261 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
5182024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
5192024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
5202024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5212024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
5222024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
5232024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
5242024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5252024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
5262024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
5272024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5282024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5292024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5302024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5312024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5322024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5332024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5342024-12-02T16:45:49.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5352024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5362024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5372024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5382024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5392024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5402024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5412024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5422024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5432024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5442024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5452024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5462024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5472024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5482024-12-02T16:45:49.788ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5510b96c-d504-40ca-83bc-e27293be3abe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 25511, tv_nsec: 531871932 } })
5492024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5502024-12-02T16:45:49.788ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a1a23f6-3701-4a53-9e08-543f9ba04e60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5030471-1797-42f6-9660-1ead64511c29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 25511, tv_nsec: 531941972 } })
5512024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5522024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5532024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
5542024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.393612ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
5552024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5562024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5572024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5582024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
5592024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.332302ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
5602024-12-02T16:45:49.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5612024-12-02T16:45:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5622024-12-02T16:45:49.790ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5632024-12-02T16:45:49.791ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.293978ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5642024-12-02T16:45:49.792ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25511, tv_nsec: 535857017 } })
5652024-12-02T16:45:49.792ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5662024-12-02T16:45:49.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5672024-12-02T16:45:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5682024-12-02T16:45:49.793ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5692024-12-02T16:45:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5702024-12-02T16:45:49.793ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25511, tv_nsec: 537279439 } })
5712024-12-02T16:45:49.793ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
5722024-12-02T16:45:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5732024-12-02T16:45:49.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5742024-12-02T16:45:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5752024-12-02T16:45:49.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5762024-12-02T16:45:49.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5772024-12-02T16:45:49.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5782024-12-02T16:45:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5792024-12-02T16:45:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5802024-12-02T16:45:49.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5812024-12-02T16:45:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5822024-12-02T16:45:49.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5832024-12-02T16:45:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5842024-12-02T16:45:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5852024-12-02T16:45:49.805ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-02 16:35:49.787628261 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5862024-12-02T16:45:49.805ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.821156ms iteration = 3 status = {"expiration":"2024-12-02T16:35:49.787628261Z","pruned":[]}
5872024-12-02T16:45:49.806ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.775575ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
5882024-12-02T16:45:49.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5892024-12-02T16:45:49.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5902024-12-02T16:45:49.810ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25511, tv_nsec: 554418809 } })
5912024-12-02T16:45:49.811ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
5922024-12-02T16:45:49.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5932024-12-02T16:45:49.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5942024-12-02T16:45:49.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5952024-12-02T16:45:49.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5962024-12-02T16:45:49.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5972024-12-02T16:45:49.832ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5982024-12-02T16:45:49.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5992024-12-02T16:45:49.832ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6002024-12-02T16:45:49.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6012024-12-02T16:45:49.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.719978ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
6022024-12-02T16:45:49.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6032024-12-02T16:45:49.835ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6042024-12-02T16:45:49.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6052024-12-02T16:45:49.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.035509ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6062024-12-02T16:45:49.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6072024-12-02T16:45:49.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6082024-12-02T16:45:49.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.572812ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
6092024-12-02T16:45:49.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 50.973086ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6102024-12-02T16:45:49.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6112024-12-02T16:45:49.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6122024-12-02T16:45:49.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6132024-12-02T16:45:49.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6142024-12-02T16:45:49.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6152024-12-02T16:45:49.841ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6162024-12-02T16:45:49.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6172024-12-02T16:45:49.842ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6182024-12-02T16:45:49.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
6192024-12-02T16:45:49.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6202024-12-02T16:45:49.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6212024-12-02T16:45:49.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6222024-12-02T16:45:49.844ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6232024-12-02T16:45:49.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6242024-12-02T16:45:49.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6252024-12-02T16:45:49.848ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6262024-12-02T16:45:49.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6272024-12-02T16:45:49.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6282024-12-02T16:45:49.850ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6292024-12-02T16:45:49.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6302024-12-02T16:45:49.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6312024-12-02T16:45:49.853ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6322024-12-02T16:45:49.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6332024-12-02T16:45:49.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6342024-12-02T16:45:49.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6352024-12-02T16:45:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6362024-12-02T16:45:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6372024-12-02T16:45:49.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6382024-12-02T16:45:49.857ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6392024-12-02T16:45:49.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6402024-12-02T16:45:49.857ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6412024-12-02T16:45:49.857ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6422024-12-02T16:45:49.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6432024-12-02T16:45:49.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6442024-12-02T16:45:49.858ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6452024-12-02T16:45:49.858ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6462024-12-02T16:45:49.858ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6472024-12-02T16:45:49.858ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6482024-12-02T16:45:49.858ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 70.711068ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6492024-12-02T16:45:49.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6502024-12-02T16:45:49.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 71.330964ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6512024-12-02T16:45:49.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6522024-12-02T16:45:49.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6532024-12-02T16:45:49.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
6542024-12-02T16:45:49.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.756073ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
6552024-12-02T16:45:49.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6562024-12-02T16:45:49.864ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6572024-12-02T16:45:49.864ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6582024-12-02T16:45:49.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6592024-12-02T16:45:49.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6602024-12-02T16:45:49.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6612024-12-02T16:45:49.878ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6622024-12-02T16:45:49.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6632024-12-02T16:45:49.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6642024-12-02T16:45:49.881ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6652024-12-02T16:45:49.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6662024-12-02T16:45:49.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6672024-12-02T16:45:49.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
6682024-12-02T16:45:49.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6692024-12-02T16:45:49.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6702024-12-02T16:45:49.889ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.547338ms iteration = 5 status = 0
6712024-12-02T16:45:49.890ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6722024-12-02T16:45:49.890ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6732024-12-02T16:45:49.890ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6742024-12-02T16:45:49.890ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 103.092621ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6752024-12-02T16:45:49.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6762024-12-02T16:45:49.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6772024-12-02T16:45:49.893ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6782024-12-02T16:45:49.893ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6792024-12-02T16:45:49.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6802024-12-02T16:45:49.895ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6812024-12-02T16:45:49.898ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
6822024-12-02T16:45:49.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6832024-12-02T16:45:49.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6842024-12-02T16:45:49.899ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6852024-12-02T16:45:49.899ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 111.535775ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6862024-12-02T16:45:49.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6872024-12-02T16:45:49.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6882024-12-02T16:45:49.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6892024-12-02T16:45:49.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6902024-12-02T16:45:49.902ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6912024-12-02T16:45:49.902ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
6922024-12-02T16:45:49.902ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 114.629472ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
6932024-12-02T16:45:49.903ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6942024-12-02T16:45:49.903ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6952024-12-02T16:45:49.903ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6962024-12-02T16:45:49.903ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6972024-12-02T16:45:49.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6982024-12-02T16:45:49.903ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6992024-12-02T16:45:49.903ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7002024-12-02T16:45:49.903ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 116.030004ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7012024-12-02T16:45:49.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7022024-12-02T16:45:49.904ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7032024-12-02T16:45:49.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7042024-12-02T16:45:49.905ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
7052024-12-02T16:45:49.905ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
7062024-12-02T16:45:49.905ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
7072024-12-02T16:45:49.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7082024-12-02T16:45:49.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7092024-12-02T16:45:49.910ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7102024-12-02T16:45:49.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7112024-12-02T16:45:49.913ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7122024-12-02T16:45:49.923ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7132024-12-02T16:45:49.923ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7142024-12-02T16:45:49.923ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "032b76c8-c633-43c7-bbe7-fefa0c9c4543", "content-length": "26", "date": "Mon, 02 Dec 2024 16:45:49 GMT"} })
7152024-12-02T16:45:49.923ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7162024-12-02T16:45:49.925ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7172024-12-02T16:45:49.948ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 161.582093ms iteration = 8 status = {"physical_disks_added":0}
7182024-12-02T16:45:49.949ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7192024-12-02T16:45:49.949ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7202024-12-02T16:45:49.949ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "32361cc6-c1ec-4e9f-83f5-213029436500", "content-length": "26", "date": "Mon, 02 Dec 2024 16:45:49 GMT"} })
7212024-12-02T16:45:49.949ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7222024-12-02T16:45:49.951ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7232024-12-02T16:45:49.955ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7242024-12-02T16:45:49.966ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
7252024-12-02T16:45:49.966ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7262024-12-02T16:45:49.967ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6dc314b-4c91-400e-a20c-e1d058ff8313", "content-length": "26", "date": "Mon, 02 Dec 2024 16:45:49 GMT"} })
7272024-12-02T16:45:49.967ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7282024-12-02T16:45:49.968ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
7292024-12-02T16:45:50.149ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7302024-12-02T16:45:50.287ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7312024-12-02T16:45:50.287ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c83698a-ef65-4df7-89af-a1fa30468731", "content-length": "1", "date": "Mon, 02 Dec 2024 16:45:49 GMT"} })
7322024-12-02T16:45:50.289ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7332024-12-02T16:45:50.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7342024-12-02T16:45:50.300ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 513.262827ms iteration = 5 status = {}
7352024-12-02T16:45:50.318ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7362024-12-02T16:45:50.318ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "afc2b18d-5b91-4b9c-90f7-0bcd52d850f4", "content-length": "691", "date": "Mon, 02 Dec 2024 16:45:49 GMT"} })
7372024-12-02T16:45:50.318ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
7382024-12-02T16:45:50.318ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
7392024-12-02T16:45:50.318ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
7402024-12-02T16:45:50.319ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 532.592386ms iteration = 5 status = {}
7412024-12-02T16:45:50.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7422024-12-02T16:45:50.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7432024-12-02T16:45:50.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7442024-12-02T16:45:50.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7452024-12-02T16:45:50.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7462024-12-02T16:45:50.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7472024-12-02T16:45:50.324ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7482024-12-02T16:45:50.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7492024-12-02T16:45:50.351ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-02T16:43:45.642486Z, time_modified: 2024-12-02T16:43:45.642486Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }) }
7502024-12-02T16:45:50.351ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 564.243372ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]}},"default_endpoint":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7512024-12-02T16:45:50.352ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7522024-12-02T16:45:50.352ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "28b4bd7d-000f-43f9-8eab-6c4cfb9d48b6", "date": "Mon, 02 Dec 2024 16:45:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7532024-12-02T16:45:50.352ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7542024-12-02T16:45:50.354ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7552024-12-02T16:45:50.354ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7562024-12-02T16:45:50.354ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8905a138-1b7a-451d-8f40-e6ec24464a63", "content-length": "372", "date": "Mon, 02 Dec 2024 16:45:49 GMT"} })
7572024-12-02T16:45:50.354ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7582024-12-02T16:45:50.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7592024-12-02T16:45:50.354ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "852eeab1-9ea6-4b7a-857d-e02f83c573da", "date": "Mon, 02 Dec 2024 16:45:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7602024-12-02T16:45:50.354ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7612024-12-02T16:45:50.356ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 568.358178ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7622024-12-02T16:45:50.356ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "dd6c6f90-e2ab-45a8-9215-d321b6a9692a", "date": "Mon, 02 Dec 2024 16:45:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7632024-12-02T16:45:50.356ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7642024-12-02T16:45:50.357ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7652024-12-02T16:45:50.357ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 0 version = 2
7662024-12-02T16:45:50.357ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7672024-12-02T16:45:50.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7682024-12-02T16:45:50.358ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
7692024-12-02T16:45:50.358ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 570.993441ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
7702024-12-02T16:45:50.359ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7712024-12-02T16:45:50.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7722024-12-02T16:45:50.362ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7732024-12-02T16:45:50.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7742024-12-02T16:45:50.363ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
7752024-12-02T16:45:50.363ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 1 version = 2
7762024-12-02T16:45:50.363ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7772024-12-02T16:45:50.363ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-02 16:44:12.116348 UTC dns_group = external generation = 2
7782024-12-02T16:45:50.363ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 576.58638ms iteration = 4 status = {"generation":2}
7792024-12-02T16:45:50.364ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "85de78cc-f250-4d1e-91e6-4df7a6920bfb", "date": "Mon, 02 Dec 2024 16:45:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7802024-12-02T16:45:50.364ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7812024-12-02T16:45:50.365ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "63439ed2-debd-4279-a547-28d9902033e4", "date": "Mon, 02 Dec 2024 16:45:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7822024-12-02T16:45:50.365ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7832024-12-02T16:45:50.367ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7842024-12-02T16:45:50.367ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 579.651077ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7852024-12-02T16:45:50.383ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7862024-12-02T16:45:50.383ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7872024-12-02T16:45:50.383ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7882024-12-02T16:45:50.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7892024-12-02T16:45:50.385ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7902024-12-02T16:45:50.386ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7912024-12-02T16:45:50.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7922024-12-02T16:45:50.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7932024-12-02T16:45:50.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7942024-12-02T16:45:50.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7952024-12-02T16:45:50.388ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
7962024-12-02T16:45:50.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7972024-12-02T16:45:50.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7982024-12-02T16:45:50.390ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
7992024-12-02T16:45:50.390ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
8002024-12-02T16:45:50.390ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-02 16:44:11.214841 UTC dns_group = internal generation = 1
8012024-12-02T16:45:50.390ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 603.030901ms iteration = 4 status = {"generation":1}
8022024-12-02T16:45:50.400ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
8032024-12-02T16:45:50.400ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8042024-12-02T16:45:50.400ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7e7ac3a2-52fa-4dab-841b-e5c41fae9122", "date": "Mon, 02 Dec 2024 16:45:49 GMT"} })
8052024-12-02T16:45:50.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8062024-12-02T16:45:50.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8072024-12-02T16:45:50.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8082024-12-02T16:45:50.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8092024-12-02T16:45:50.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8102024-12-02T16:45:50.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8112024-12-02T16:45:50.406ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8122024-12-02T16:45:50.406ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8132024-12-02T16:45:50.407ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "68596ec7-943e-4bef-8810-457393eb514f", "date": "Mon, 02 Dec 2024 16:45:49 GMT"} })
8142024-12-02T16:45:50.409ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 621.443122ms iteration = 6 status = {}
8152024-12-02T16:45:50.470ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 683.460264ms iteration = 5 status = null
8162024-12-02T16:45:50.489ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8172024-12-02T16:45:50.490ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dd990fb-2f1d-4486-84e6-e71d21e9ca53", "content-length": "134", "date": "Mon, 02 Dec 2024 16:45:49 GMT"} })
8182024-12-02T16:45:50.490ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8192024-12-02T16:45:50.490ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
8202024-12-02T16:45:50.490ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8212024-12-02T16:45:50.490ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8222024-12-02T16:45:50.490ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8232024-12-02T16:45:50.490ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8242024-12-02T16:45:50.490ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8252024-12-02T16:45:50.490ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8262024-12-02T16:45:50.490ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8272024-12-02T16:45:50.490ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8282024-12-02T16:45:50.490ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
8292024-12-02T16:45:50.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8302024-12-02T16:45:50.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8312024-12-02T16:45:50.492ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8322024-12-02T16:45:50.493ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a8b267a-e663-4e93-84dc-9a9397ccfb72", "content-length": "2", "date": "Mon, 02 Dec 2024 16:45:49 GMT"} })
8332024-12-02T16:45:50.493ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8342024-12-02T16:45:50.493ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "05a7f375-4d79-4344-b4aa-e7c8f1426755", "content-length": "52", "date": "Mon, 02 Dec 2024 16:45:49 GMT"} })
8352024-12-02T16:45:50.493ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
8362024-12-02T16:45:50.493ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8372024-12-02T16:45:50.591ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "be27af23-a837-47f6-9f7c-95c9054d5d15", "date": "Mon, 02 Dec 2024 16:45:49 GMT"} })
8382024-12-02T16:45:50.591ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
8392024-12-02T16:45:50.591ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8402024-12-02T16:45:50.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ce57e17-c4e1-482d-b2cb-adf04169fd91 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8412024-12-02T16:45:50.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ce57e17-c4e1-482d-b2cb-adf04169fd91 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8422024-12-02T16:45:50.592ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ff9e569-99d8-4b74-a2e0-8e341bbe1543", "content-length": "682", "date": "Mon, 02 Dec 2024 16:45:49 GMT"} })
8432024-12-02T16:45:50.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8442024-12-02T16:45:50.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8452024-12-02T16:45:50.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ce57e17-c4e1-482d-b2cb-adf04169fd91 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8462024-12-02T16:45:50.596ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8472024-12-02T16:45:50.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8482024-12-02T16:45:50.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8492024-12-02T16:45:50.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8502024-12-02T16:45:50.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8512024-12-02T16:45:50.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8522024-12-02T16:45:50.608ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 821.283339ms iteration = 5 status = {}
8532024-12-02T16:45:51.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8e8b67a1-1f51-460f-ab4a-40f05c55a7be roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8542024-12-02T16:45:51.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8e8b67a1-1f51-460f-ab4a-40f05c55a7be resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8552024-12-02T16:45:51.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8e8b67a1-1f51-460f-ab4a-40f05c55a7be response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8562024-12-02T16:45:52.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b2a340d2-7792-4088-a068-bfa20da7bcca roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8572024-12-02T16:45:52.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b2a340d2-7792-4088-a068-bfa20da7bcca resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8582024-12-02T16:45:52.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b2a340d2-7792-4088-a068-bfa20da7bcca response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8592024-12-02T16:45:53.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3a4607bc-9799-4659-a7ec-2dfa0fd5c75b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8602024-12-02T16:45:53.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3a4607bc-9799-4659-a7ec-2dfa0fd5c75b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8612024-12-02T16:45:53.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3a4607bc-9799-4659-a7ec-2dfa0fd5c75b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8622024-12-02T16:45:54.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 62a5f987-f3e4-40a5-8a80-ab737f598a2b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8632024-12-02T16:45:54.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 62a5f987-f3e4-40a5-8a80-ab737f598a2b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8642024-12-02T16:45:54.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 62a5f987-f3e4-40a5-8a80-ab737f598a2b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8652024-12-02T16:45:55.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e856f91f-8615-46be-a91a-570082f294cc roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8662024-12-02T16:45:55.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e856f91f-8615-46be-a91a-570082f294cc resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8672024-12-02T16:45:55.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2488 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e856f91f-8615-46be-a91a-570082f294cc response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8682024-12-02T16:45:56.549ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1332 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 13f39383-a155-46fd-ada9-bc990308447e response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
8692024-12-02T16:45:56.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 56c2cefc-21f0-4b37-befe-ba8c44fd3f29 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8702024-12-02T16:45:56.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 56c2cefc-21f0-4b37-befe-ba8c44fd3f29 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8712024-12-02T16:45:56.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 56c2cefc-21f0-4b37-befe-ba8c44fd3f29 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8722024-12-02T16:45:57.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b1754e1b-9f58-4d75-8b4a-b8a5aed7ff41 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8732024-12-02T16:45:57.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b1754e1b-9f58-4d75-8b4a-b8a5aed7ff41 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8742024-12-02T16:45:57.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b1754e1b-9f58-4d75-8b4a-b8a5aed7ff41 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8752024-12-02T16:45:58.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9b8ea37c-b0b6-4f07-9edd-3e865a0e5fa9 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8762024-12-02T16:45:58.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9b8ea37c-b0b6-4f07-9edd-3e865a0e5fa9 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8772024-12-02T16:45:58.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9b8ea37c-b0b6-4f07-9edd-3e865a0e5fa9 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8782024-12-02T16:45:59.786ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
8792024-12-02T16:45:59.786ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8802024-12-02T16:45:59.786ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
8812024-12-02T16:45:59.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8822024-12-02T16:45:59.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4af8b0f1-9080-4010-8228-9d056ae4ebca roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8832024-12-02T16:45:59.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8842024-12-02T16:45:59.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8852024-12-02T16:45:59.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4af8b0f1-9080-4010-8228-9d056ae4ebca resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8862024-12-02T16:45:59.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8872024-12-02T16:45:59.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8882024-12-02T16:45:59.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8892024-12-02T16:45:59.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4af8b0f1-9080-4010-8228-9d056ae4ebca response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
8902024-12-02T16:45:59.789ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.371159ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8912024-12-02T16:45:59.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8922024-12-02T16:45:59.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8932024-12-02T16:45:59.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8942024-12-02T16:45:59.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8952024-12-02T16:45:59.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8962024-12-02T16:45:59.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8972024-12-02T16:45:59.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
8982024-12-02T16:45:59.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8992024-12-02T16:45:59.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9002024-12-02T16:45:59.806ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
9012024-12-02T16:45:59.806ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.367098ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
9022024-12-02T16:46:00.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8c9ba00e-701d-4538-a289-bef196a0f7da roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9032024-12-02T16:46:00.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8c9ba00e-701d-4538-a289-bef196a0f7da resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9042024-12-02T16:46:00.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8c9ba00e-701d-4538-a289-bef196a0f7da response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9052024-12-02T16:46:01.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 8bfc371c-4a96-4aa8-a899-92a48a9430a5 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
9062024-12-02T16:46:01.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 8bfc371c-4a96-4aa8-a899-92a48a9430a5 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
9072024-12-02T16:46:01.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 8bfc371c-4a96-4aa8-a899-92a48a9430a5 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
9082024-12-02T16:46:01.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = ccaf10e5-43ef-4f8a-8e24-acc002f4b5ce roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
9092024-12-02T16:46:01.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = ccaf10e5-43ef-4f8a-8e24-acc002f4b5ce resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
9102024-12-02T16:46:01.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = ccaf10e5-43ef-4f8a-8e24-acc002f4b5ce response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
9112024-12-02T16:46:01.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = abc9901b-1284-48f0-9be9-92578ca01dc8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9122024-12-02T16:46:01.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = abc9901b-1284-48f0-9be9-92578ca01dc8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9132024-12-02T16:46:01.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = abc9901b-1284-48f0-9be9-92578ca01dc8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9142024-12-02T16:46:02.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cbd95213-0560-480c-8630-55e9c6593ca1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9152024-12-02T16:46:02.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cbd95213-0560-480c-8630-55e9c6593ca1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9162024-12-02T16:46:02.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cbd95213-0560-480c-8630-55e9c6593ca1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9172024-12-02T16:46:03.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 683162b2-9826-4302-a2f9-291c34b3ad20 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9182024-12-02T16:46:03.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 683162b2-9826-4302-a2f9-291c34b3ad20 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9192024-12-02T16:46:03.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 683162b2-9826-4302-a2f9-291c34b3ad20 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9202024-12-02T16:46:04.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b13f5cba-a238-481f-a3cf-29c6160f2714 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9212024-12-02T16:46:04.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b13f5cba-a238-481f-a3cf-29c6160f2714 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9222024-12-02T16:46:04.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1749 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b13f5cba-a238-481f-a3cf-29c6160f2714 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9232024-12-02T16:46:05.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c5373a26-ab13-48db-aa18-13832a7a16d3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9242024-12-02T16:46:05.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c5373a26-ab13-48db-aa18-13832a7a16d3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9252024-12-02T16:46:05.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c5373a26-ab13-48db-aa18-13832a7a16d3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9262024-12-02T16:46:06.550ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1370 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 3a4ba336-6676-40f8-99b9-0dfffebf5b1b response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
9272024-12-02T16:46:06.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 097c8340-cce4-42a7-89d8-000cc6458afb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9282024-12-02T16:46:06.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 097c8340-cce4-42a7-89d8-000cc6458afb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9292024-12-02T16:46:06.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 097c8340-cce4-42a7-89d8-000cc6458afb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9302024-12-02T16:46:07.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 51bdc012-5c27-4f28-88d4-8497c21a1584 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9312024-12-02T16:46:07.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 51bdc012-5c27-4f28-88d4-8497c21a1584 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9322024-12-02T16:46:07.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 51bdc012-5c27-4f28-88d4-8497c21a1584 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9332024-12-02T16:46:08.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0385c43b-6c10-40ea-a355-c5fe31ca49f2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9342024-12-02T16:46:08.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0385c43b-6c10-40ea-a355-c5fe31ca49f2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9352024-12-02T16:46:08.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0385c43b-6c10-40ea-a355-c5fe31ca49f2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9362024-12-02T16:46:09.787ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
9372024-12-02T16:46:09.787ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
9382024-12-02T16:46:09.787ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9392024-12-02T16:46:09.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9402024-12-02T16:46:09.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9412024-12-02T16:46:09.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9422024-12-02T16:46:09.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9432024-12-02T16:46:09.789ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9442024-12-02T16:46:09.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9452024-12-02T16:46:09.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9462024-12-02T16:46:09.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9472024-12-02T16:46:09.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9482024-12-02T16:46:09.791ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.660941ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9492024-12-02T16:46:09.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9502024-12-02T16:46:09.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9512024-12-02T16:46:09.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9522024-12-02T16:46:09.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
9532024-12-02T16:46:09.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9542024-12-02T16:46:09.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9552024-12-02T16:46:09.807ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
9562024-12-02T16:46:09.807ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.108696ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
9572024-12-02T16:46:10.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5f6a2fa1-4521-42d8-a182-947b0411dda4 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9582024-12-02T16:46:10.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5f6a2fa1-4521-42d8-a182-947b0411dda4 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9592024-12-02T16:46:10.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5f6a2fa1-4521-42d8-a182-947b0411dda4 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9602024-12-02T16:46:11.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a6e78083-a0f4-4d58-8b0e-93ff6a36c41c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9612024-12-02T16:46:11.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a6e78083-a0f4-4d58-8b0e-93ff6a36c41c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9622024-12-02T16:46:11.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a6e78083-a0f4-4d58-8b0e-93ff6a36c41c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9632024-12-02T16:46:12.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 82addb34-31c0-465e-911f-63a3f833739b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9642024-12-02T16:46:12.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 82addb34-31c0-465e-911f-63a3f833739b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9652024-12-02T16:46:12.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2880 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 82addb34-31c0-465e-911f-63a3f833739b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9662024-12-02T16:46:13.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7f987760-4f56-46ab-9fcc-b8b7108abaa1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9672024-12-02T16:46:13.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7f987760-4f56-46ab-9fcc-b8b7108abaa1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9682024-12-02T16:46:13.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7f987760-4f56-46ab-9fcc-b8b7108abaa1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9692024-12-02T16:46:14.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd11ff83-1ff5-4566-8d22-048a5c9b12db roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9702024-12-02T16:46:14.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd11ff83-1ff5-4566-8d22-048a5c9b12db resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9712024-12-02T16:46:14.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd11ff83-1ff5-4566-8d22-048a5c9b12db response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9722024-12-02T16:46:15.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1ffe2adc-8567-40e2-8e6c-442a967c2bce roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9732024-12-02T16:46:15.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1ffe2adc-8567-40e2-8e6c-442a967c2bce resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9742024-12-02T16:46:15.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1ffe2adc-8567-40e2-8e6c-442a967c2bce response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9752024-12-02T16:46:16.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 274ac839-182a-4aa3-9b01-72fafbc3302a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9762024-12-02T16:46:16.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 274ac839-182a-4aa3-9b01-72fafbc3302a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9772024-12-02T16:46:16.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 274ac839-182a-4aa3-9b01-72fafbc3302a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9782024-12-02T16:46:16.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 0e5599f3-f9c9-4a85-ad4b-d943da91bade roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
9792024-12-02T16:46:16.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 0e5599f3-f9c9-4a85-ad4b-d943da91bade resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
9802024-12-02T16:46:16.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3904 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 0e5599f3-f9c9-4a85-ad4b-d943da91bade response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
9812024-12-02T16:46:16.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = b4444471-ecf0-4bf3-b382-6fd85e48a46f roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
9822024-12-02T16:46:16.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = b4444471-ecf0-4bf3-b382-6fd85e48a46f resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
9832024-12-02T16:46:16.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = b4444471-ecf0-4bf3-b382-6fd85e48a46f response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
9842024-12-02T16:46:16.550ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1529 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = a1ae0adb-f317-48fd-abb3-9113f9488267 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
9852024-12-02T16:46:17.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0009b3c5-50b2-463f-bfd2-24e8fe78a08d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9862024-12-02T16:46:17.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0009b3c5-50b2-463f-bfd2-24e8fe78a08d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9872024-12-02T16:46:17.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0009b3c5-50b2-463f-bfd2-24e8fe78a08d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9882024-12-02T16:46:17.455ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:53466
9892024-12-02T16:46:17.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53466 req_id = be303a57-8e30-4c2d-a187-7d339f61e216 roles = RoleSet { roles: {} } uri = /metrics/producers
9902024-12-02T16:46:17.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53466 req_id = be303a57-8e30-4c2d-a187-7d339f61e216 resource = Database result = Ok(()) uri = /metrics/producers
9912024-12-02T16:46:17.490ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = d6743efc-3f8c-4f9c-82eb-c8c8561c254a
9922024-12-02T16:46:17.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34776 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53466 req_id = be303a57-8e30-4c2d-a187-7d339f61e216 response_code = 201 uri = /metrics/producers
9932024-12-02T16:46:18.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ddce83ab-7376-4ca2-9aea-c640ff0a1457 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9942024-12-02T16:46:18.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ddce83ab-7376-4ca2-9aea-c640ff0a1457 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9952024-12-02T16:46:18.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ddce83ab-7376-4ca2-9aea-c640ff0a1457 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9962024-12-02T16:46:19.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5e0ab733-e65f-4a26-b630-35a54c59913b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9972024-12-02T16:46:19.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5e0ab733-e65f-4a26-b630-35a54c59913b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9982024-12-02T16:46:19.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5e0ab733-e65f-4a26-b630-35a54c59913b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
9992024-12-02T16:46:19.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 8cc3756c-f527-4427-9ac0-4428765010bf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
10002024-12-02T16:46:19.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 8cc3756c-f527-4427-9ac0-4428765010bf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
10012024-12-02T16:46:19.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 8cc3756c-f527-4427-9ac0-4428765010bf response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
10022024-12-02T16:46:19.430ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:40722
10032024-12-02T16:46:19.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40722 req_id = cb88d6b2-18e2-4555-b56c-39fa254ab50b roles = RoleSet { roles: {} } uri = /metrics/producers
10042024-12-02T16:46:19.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40722 req_id = cb88d6b2-18e2-4555-b56c-39fa254ab50b resource = Database result = Ok(()) uri = /metrics/producers
10052024-12-02T16:46:19.481ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = 999318be-e8de-4392-9ed9-30887ef5bc8f
10062024-12-02T16:46:19.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50304 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40722 req_id = cb88d6b2-18e2-4555-b56c-39fa254ab50b response_code = 201 uri = /metrics/producers
10072024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
10082024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
10092024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
10102024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
10112024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10122024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
10132024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10142024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10152024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10162024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
10172024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10182024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
10192024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
10202024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
10212024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10222024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10232024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10242024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
10252024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10262024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
10272024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10282024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10292024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10302024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10312024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10322024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10332024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10342024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10352024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10362024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10372024-12-02T16:46:19.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10382024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10392024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
10402024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
10412024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10422024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10432024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
10442024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10452024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
10462024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10472024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
10482024-12-02T16:46:19.788ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10492024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10502024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
10512024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10522024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10532024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10542024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10552024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10562024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10572024-12-02T16:46:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10582024-12-02T16:46:19.789ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10592024-12-02T16:46:19.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10602024-12-02T16:46:19.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10612024-12-02T16:46:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10622024-12-02T16:46:19.791ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25541, tv_nsec: 534218052 } })
10632024-12-02T16:46:19.791ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10642024-12-02T16:46:19.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10652024-12-02T16:46:19.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10662024-12-02T16:46:19.791ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
10672024-12-02T16:46:19.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10682024-12-02T16:46:19.792ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.879242ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10692024-12-02T16:46:19.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10702024-12-02T16:46:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10712024-12-02T16:46:19.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10722024-12-02T16:46:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10732024-12-02T16:46:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10742024-12-02T16:46:19.793ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10752024-12-02T16:46:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10762024-12-02T16:46:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10772024-12-02T16:46:19.794ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10782024-12-02T16:46:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10792024-12-02T16:46:19.795ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25541, tv_nsec: 538701612 } })
10802024-12-02T16:46:19.795ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
10812024-12-02T16:46:19.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10822024-12-02T16:46:19.797ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10832024-12-02T16:46:19.799ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10842024-12-02T16:46:19.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10852024-12-02T16:46:19.799ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10862024-12-02T16:46:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10872024-12-02T16:46:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10882024-12-02T16:46:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10892024-12-02T16:46:19.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10902024-12-02T16:46:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10912024-12-02T16:46:19.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10922024-12-02T16:46:19.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10932024-12-02T16:46:19.802ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25541, tv_nsec: 545777333 } })
10942024-12-02T16:46:19.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10952024-12-02T16:46:19.803ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 14.460717ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
10962024-12-02T16:46:19.803ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
10972024-12-02T16:46:19.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10982024-12-02T16:46:19.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10992024-12-02T16:46:19.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11002024-12-02T16:46:19.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11012024-12-02T16:46:19.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11022024-12-02T16:46:19.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11032024-12-02T16:46:19.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11042024-12-02T16:46:19.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11052024-12-02T16:46:19.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11062024-12-02T16:46:19.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11072024-12-02T16:46:19.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11082024-12-02T16:46:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
11092024-12-02T16:46:19.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11102024-12-02T16:46:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11112024-12-02T16:46:19.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11122024-12-02T16:46:19.809ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11132024-12-02T16:46:19.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11142024-12-02T16:46:19.814ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11152024-12-02T16:46:19.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11162024-12-02T16:46:19.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11172024-12-02T16:46:19.823ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
11182024-12-02T16:46:19.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.60257ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
11192024-12-02T16:46:19.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11202024-12-02T16:46:19.824ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11212024-12-02T16:46:19.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11222024-12-02T16:46:19.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11232024-12-02T16:46:19.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11242024-12-02T16:46:19.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11252024-12-02T16:46:19.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11262024-12-02T16:46:19.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.985606ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
11272024-12-02T16:46:19.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11282024-12-02T16:46:19.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11292024-12-02T16:46:19.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11302024-12-02T16:46:19.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11312024-12-02T16:46:19.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11322024-12-02T16:46:19.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11332024-12-02T16:46:19.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.606724ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
11342024-12-02T16:46:19.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11352024-12-02T16:46:19.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11362024-12-02T16:46:19.839ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11372024-12-02T16:46:19.839ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11382024-12-02T16:46:19.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11392024-12-02T16:46:19.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.875393ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11402024-12-02T16:46:19.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11412024-12-02T16:46:19.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11422024-12-02T16:46:19.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
11432024-12-02T16:46:19.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11442024-12-02T16:46:19.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11452024-12-02T16:46:19.845ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11462024-12-02T16:46:19.845ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.060487ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11472024-12-02T16:46:19.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.861244ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11482024-12-02T16:46:19.897ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11492024-12-02T16:46:19.897ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11502024-12-02T16:46:19.897ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "da9cfbed-ceee-458f-869d-ccd3fe254c3f", "content-length": "26", "date": "Mon, 02 Dec 2024 16:46:19 GMT"} })
11512024-12-02T16:46:19.897ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11522024-12-02T16:46:19.899ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11532024-12-02T16:46:19.904ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 116.928173ms iteration = 9 status = {"physical_disks_added":0}
11542024-12-02T16:46:19.944ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
11552024-12-02T16:46:19.944ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11562024-12-02T16:46:19.944ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c3bf51f-8180-4caf-9b78-5be742a65a8a", "content-length": "26", "date": "Mon, 02 Dec 2024 16:46:19 GMT"} })
11572024-12-02T16:46:19.944ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11582024-12-02T16:46:19.945ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
11592024-12-02T16:46:20.008ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11602024-12-02T16:46:20.008ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11612024-12-02T16:46:20.008ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "368af448-83b3-473a-86c1-5af22d2e9ac2", "content-length": "26", "date": "Mon, 02 Dec 2024 16:46:19 GMT"} })
11622024-12-02T16:46:20.008ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11632024-12-02T16:46:20.010ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11642024-12-02T16:46:20.039ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 252.561187ms iteration = 6 status = {}
11652024-12-02T16:46:20.117ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
11662024-12-02T16:46:20.117ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4436f0f-ad6f-48da-b6f8-19d370e7e596", "content-length": "691", "date": "Mon, 02 Dec 2024 16:46:19 GMT"} })
11672024-12-02T16:46:20.117ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
11682024-12-02T16:46:20.117ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
11692024-12-02T16:46:20.117ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
11702024-12-02T16:46:20.119ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 332.534887ms iteration = 6 status = {}
11712024-12-02T16:46:20.120ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11722024-12-02T16:46:20.121ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "34c0e5f4-a4da-471a-8c19-bf46ff6f8aff", "content-length": "1", "date": "Mon, 02 Dec 2024 16:46:19 GMT"} })
11732024-12-02T16:46:20.122ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11742024-12-02T16:46:20.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11752024-12-02T16:46:20.126ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11762024-12-02T16:46:20.126ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11772024-12-02T16:46:20.126ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a63da1c8-8e79-4f9e-8207-1facc54005e6", "content-length": "372", "date": "Mon, 02 Dec 2024 16:46:19 GMT"} })
11782024-12-02T16:46:20.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11792024-12-02T16:46:20.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11802024-12-02T16:46:20.129ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 340.709888ms iteration = 6 status = 0
11812024-12-02T16:46:20.130ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 342.539464ms iteration = 6 status = null
11822024-12-02T16:46:20.161ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11832024-12-02T16:46:20.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11842024-12-02T16:46:20.161ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11852024-12-02T16:46:20.161ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11862024-12-02T16:46:20.161ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11872024-12-02T16:46:20.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11882024-12-02T16:46:20.163ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 374.692135ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
11892024-12-02T16:46:20.171ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
11902024-12-02T16:46:20.171ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11912024-12-02T16:46:20.172ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "91ca36da-864b-40d9-b114-4e3f7ce5f347", "date": "Mon, 02 Dec 2024 16:46:19 GMT"} })
11922024-12-02T16:46:20.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11932024-12-02T16:46:20.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11942024-12-02T16:46:20.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11952024-12-02T16:46:20.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11962024-12-02T16:46:20.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11972024-12-02T16:46:20.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11982024-12-02T16:46:20.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11992024-12-02T16:46:20.180ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
12002024-12-02T16:46:20.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12012024-12-02T16:46:20.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12022024-12-02T16:46:20.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12032024-12-02T16:46:20.186ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12042024-12-02T16:46:20.186ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12052024-12-02T16:46:20.186ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "471afc22-cac5-4768-812f-b1e2c141bd1e", "date": "Mon, 02 Dec 2024 16:46:19 GMT"} })
12062024-12-02T16:46:20.188ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 400.227209ms iteration = 7 status = {}
12072024-12-02T16:46:20.191ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
12082024-12-02T16:46:20.192ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "64dd8672-593c-42d9-bfa9-34e313fc4e81", "content-length": "134", "date": "Mon, 02 Dec 2024 16:46:20 GMT"} })
12092024-12-02T16:46:20.192ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
12102024-12-02T16:46:20.192ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
12112024-12-02T16:46:20.192ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
12122024-12-02T16:46:20.192ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12132024-12-02T16:46:20.192ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12142024-12-02T16:46:20.192ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12152024-12-02T16:46:20.192ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12162024-12-02T16:46:20.192ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12172024-12-02T16:46:20.192ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12182024-12-02T16:46:20.192ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12192024-12-02T16:46:20.192ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
12202024-12-02T16:46:20.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12212024-12-02T16:46:20.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12222024-12-02T16:46:20.198ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12232024-12-02T16:46:20.198ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12242024-12-02T16:46:20.198ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 411.340455ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12252024-12-02T16:46:20.205ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12262024-12-02T16:46:20.205ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "57d21766-5f82-4de0-9d41-4a025c368fbe", "content-length": "2", "date": "Mon, 02 Dec 2024 16:46:20 GMT"} })
12272024-12-02T16:46:20.205ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
12282024-12-02T16:46:20.205ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef3949d3-1d93-4f19-a1c6-a3622ac06702", "content-length": "52", "date": "Mon, 02 Dec 2024 16:46:20 GMT"} })
12292024-12-02T16:46:20.205ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
12302024-12-02T16:46:20.205ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12312024-12-02T16:46:20.299ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fca40c92-6d34-47cd-ab58-36a28a6f4b86", "date": "Mon, 02 Dec 2024 16:46:19 GMT"} })
12322024-12-02T16:46:20.299ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
12332024-12-02T16:46:20.299ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12342024-12-02T16:46:20.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 64b9b4ce-e557-4aee-85b5-b023e694d6f1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12352024-12-02T16:46:20.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 64b9b4ce-e557-4aee-85b5-b023e694d6f1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12362024-12-02T16:46:20.299ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6457db3e-92ef-429f-94c9-3e5c5887135c", "content-length": "682", "date": "Mon, 02 Dec 2024 16:46:19 GMT"} })
12372024-12-02T16:46:20.299ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12382024-12-02T16:46:20.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12392024-12-02T16:46:20.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 64b9b4ce-e557-4aee-85b5-b023e694d6f1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12402024-12-02T16:46:20.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12412024-12-02T16:46:20.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12422024-12-02T16:46:20.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12432024-12-02T16:46:20.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12442024-12-02T16:46:20.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12452024-12-02T16:46:20.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12462024-12-02T16:46:20.316ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 529.363837ms iteration = 6 status = {}
12472024-12-02T16:46:21.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 716ceafc-ae5b-46c2-bdf6-c2ebb8b4fade roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12482024-12-02T16:46:21.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 716ceafc-ae5b-46c2-bdf6-c2ebb8b4fade resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12492024-12-02T16:46:21.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1597 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 716ceafc-ae5b-46c2-bdf6-c2ebb8b4fade response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12502024-12-02T16:46:22.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 06234324-1137-4392-bd13-5351f0b195d8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12512024-12-02T16:46:22.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 06234324-1137-4392-bd13-5351f0b195d8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12522024-12-02T16:46:22.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 06234324-1137-4392-bd13-5351f0b195d8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12532024-12-02T16:46:23.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 365b74fb-4e16-4748-8d8e-4d1a2f0b3c70 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12542024-12-02T16:46:23.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 365b74fb-4e16-4748-8d8e-4d1a2f0b3c70 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12552024-12-02T16:46:23.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2820 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 365b74fb-4e16-4748-8d8e-4d1a2f0b3c70 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12562024-12-02T16:46:24.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8baa7e4d-b995-4ac3-a526-0e2cb0658a04 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12572024-12-02T16:46:24.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8baa7e4d-b995-4ac3-a526-0e2cb0658a04 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12582024-12-02T16:46:24.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8baa7e4d-b995-4ac3-a526-0e2cb0658a04 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12592024-12-02T16:46:25.195ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:43498
12602024-12-02T16:46:25.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43498 req_id = ec3f5018-bcf3-4049-aafb-a42cda0c30a2 roles = RoleSet { roles: {} } uri = /metrics/producers
12612024-12-02T16:46:25.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43498 req_id = ec3f5018-bcf3-4049-aafb-a42cda0c30a2 resource = Database result = Ok(()) uri = /metrics/producers
12622024-12-02T16:46:25.241ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = c94a6654-1297-4865-84af-bb83693635c3
12632024-12-02T16:46:25.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46478 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43498 req_id = ec3f5018-bcf3-4049-aafb-a42cda0c30a2 response_code = 201 uri = /metrics/producers
12642024-12-02T16:46:25.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fcbeecc9-e539-4db5-bb80-3a6b879b5510 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12652024-12-02T16:46:25.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fcbeecc9-e539-4db5-bb80-3a6b879b5510 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12662024-12-02T16:46:25.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fcbeecc9-e539-4db5-bb80-3a6b879b5510 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12672024-12-02T16:46:26.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c5cc14bc-b590-40fb-a52a-84a934c87ae3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12682024-12-02T16:46:26.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c5cc14bc-b590-40fb-a52a-84a934c87ae3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12692024-12-02T16:46:26.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c5cc14bc-b590-40fb-a52a-84a934c87ae3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12702024-12-02T16:46:26.550ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1253 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = dcd5075d-199a-4716-a1a2-854807b27c9a response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
12712024-12-02T16:46:27.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ae2227b-6343-456a-8141-395422968f28 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12722024-12-02T16:46:27.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ae2227b-6343-456a-8141-395422968f28 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12732024-12-02T16:46:27.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ae2227b-6343-456a-8141-395422968f28 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12742024-12-02T16:46:28.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a199271e-1b2b-4c6f-b308-f7c4f03e4255 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12752024-12-02T16:46:28.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a199271e-1b2b-4c6f-b308-f7c4f03e4255 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12762024-12-02T16:46:28.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a199271e-1b2b-4c6f-b308-f7c4f03e4255 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12772024-12-02T16:46:29.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e8374c6c-28e7-418d-963a-e812f8a16966 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12782024-12-02T16:46:29.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e8374c6c-28e7-418d-963a-e812f8a16966 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12792024-12-02T16:46:29.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e8374c6c-28e7-418d-963a-e812f8a16966 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
12802024-12-02T16:46:29.788ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
12812024-12-02T16:46:29.788ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
12822024-12-02T16:46:29.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12832024-12-02T16:46:29.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12842024-12-02T16:46:29.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12852024-12-02T16:46:29.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12862024-12-02T16:46:29.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12872024-12-02T16:46:29.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12882024-12-02T16:46:29.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12892024-12-02T16:46:29.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12902024-12-02T16:46:29.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12912024-12-02T16:46:29.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12922024-12-02T16:46:29.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12932024-12-02T16:46:29.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12942024-12-02T16:46:29.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.799133ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12952024-12-02T16:46:29.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12962024-12-02T16:46:29.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
12972024-12-02T16:46:29.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12982024-12-02T16:46:29.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12992024-12-02T16:46:29.838ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
13002024-12-02T16:46:29.838ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.29916ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
13012024-12-02T16:46:30.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b6218137-8941-4300-9d4c-0935bc7cbdbe roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13022024-12-02T16:46:30.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b6218137-8941-4300-9d4c-0935bc7cbdbe resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13032024-12-02T16:46:30.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b6218137-8941-4300-9d4c-0935bc7cbdbe response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13042024-12-02T16:46:31.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a0bef174-e775-4678-ac72-fd03a444d5d4 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13052024-12-02T16:46:31.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a0bef174-e775-4678-ac72-fd03a444d5d4 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13062024-12-02T16:46:31.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a0bef174-e775-4678-ac72-fd03a444d5d4 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13072024-12-02T16:46:31.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f86f1fee-db68-49dc-87a3-683207984477 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
13082024-12-02T16:46:31.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f86f1fee-db68-49dc-87a3-683207984477 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
13092024-12-02T16:46:31.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f86f1fee-db68-49dc-87a3-683207984477 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
13102024-12-02T16:46:31.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = dc18219d-1b63-46f4-87bb-11b24ae24c67 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
13112024-12-02T16:46:31.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = dc18219d-1b63-46f4-87bb-11b24ae24c67 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
13122024-12-02T16:46:31.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = dc18219d-1b63-46f4-87bb-11b24ae24c67 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
13132024-12-02T16:46:32.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ea739f8d-b39f-4aa8-85ef-7bb72a00b259 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13142024-12-02T16:46:32.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ea739f8d-b39f-4aa8-85ef-7bb72a00b259 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13152024-12-02T16:46:32.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ea739f8d-b39f-4aa8-85ef-7bb72a00b259 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13162024-12-02T16:46:32.711ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:61133
13172024-12-02T16:46:32.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61133 req_id = acff7728-1b8a-4388-97ea-0b6d4f9d2241 roles = RoleSet { roles: {} } uri = /metrics/producers
13182024-12-02T16:46:32.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61133 req_id = acff7728-1b8a-4388-97ea-0b6d4f9d2241 resource = Database result = Ok(()) uri = /metrics/producers
13192024-12-02T16:46:32.750ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13202024-12-02T16:46:32.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39020 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61133 req_id = acff7728-1b8a-4388-97ea-0b6d4f9d2241 response_code = 201 uri = /metrics/producers
13212024-12-02T16:46:32.754ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45085
13222024-12-02T16:46:32.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45085 req_id = 9ed45ef0-9c85-4c7f-9168-c2d9cafb1d3c roles = RoleSet { roles: {} } uri = /metrics/producers
13232024-12-02T16:46:32.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45085 req_id = 9ed45ef0-9c85-4c7f-9168-c2d9cafb1d3c resource = Database result = Ok(()) uri = /metrics/producers
13242024-12-02T16:46:32.906ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = f1994180-91a5-4667-ac8f-de00c9b09458
13252024-12-02T16:46:32.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152331 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45085 req_id = 9ed45ef0-9c85-4c7f-9168-c2d9cafb1d3c response_code = 201 uri = /metrics/producers
13262024-12-02T16:46:33.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 79b9b6f9-322b-4d84-ac95-0af0a546e068 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13272024-12-02T16:46:33.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 79b9b6f9-322b-4d84-ac95-0af0a546e068 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13282024-12-02T16:46:33.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 79b9b6f9-322b-4d84-ac95-0af0a546e068 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13292024-12-02T16:46:34.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1d30bb21-833d-4652-8ed3-1c6b13fec83c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13302024-12-02T16:46:34.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1d30bb21-833d-4652-8ed3-1c6b13fec83c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13312024-12-02T16:46:34.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1d30bb21-833d-4652-8ed3-1c6b13fec83c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13322024-12-02T16:46:35.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fd1dbb4f-4ee5-4df9-a701-a129aaae7642 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13332024-12-02T16:46:35.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fd1dbb4f-4ee5-4df9-a701-a129aaae7642 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13342024-12-02T16:46:35.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fd1dbb4f-4ee5-4df9-a701-a129aaae7642 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13352024-12-02T16:46:36.357ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52893
13362024-12-02T16:46:36.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52893 req_id = 0b5aed4a-961e-410a-a646-08c5dd31aeda roles = RoleSet { roles: {} } uri = /metrics/producers
13372024-12-02T16:46:36.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52893 req_id = 0b5aed4a-961e-410a-a646-08c5dd31aeda resource = Database result = Ok(()) uri = /metrics/producers
13382024-12-02T16:46:36.369ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = bcacf9eb-c8be-49ce-bc71-4d5ced99f0ed
13392024-12-02T16:46:36.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12511 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52893 req_id = 0b5aed4a-961e-410a-a646-08c5dd31aeda response_code = 201 uri = /metrics/producers
13402024-12-02T16:46:36.550ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1266 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 94bae76c-e758-4c37-b0cd-093de45c6a88 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
13412024-12-02T16:46:36.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c1cfe6cb-5a35-449e-a368-f94fdb6537b8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13422024-12-02T16:46:36.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c1cfe6cb-5a35-449e-a368-f94fdb6537b8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13432024-12-02T16:46:36.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c1cfe6cb-5a35-449e-a368-f94fdb6537b8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13442024-12-02T16:46:37.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 55f24821-31c4-476b-b015-be02a6612372 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13452024-12-02T16:46:37.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 55f24821-31c4-476b-b015-be02a6612372 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13462024-12-02T16:46:37.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 55f24821-31c4-476b-b015-be02a6612372 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13472024-12-02T16:46:38.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3eb71e7d-334b-4684-94ca-0ea6359b7352 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13482024-12-02T16:46:38.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3eb71e7d-334b-4684-94ca-0ea6359b7352 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13492024-12-02T16:46:38.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3eb71e7d-334b-4684-94ca-0ea6359b7352 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13502024-12-02T16:46:39.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 10701922-fa03-42dc-b6c3-b9678951ddd8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13512024-12-02T16:46:39.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 10701922-fa03-42dc-b6c3-b9678951ddd8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13522024-12-02T16:46:39.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 10701922-fa03-42dc-b6c3-b9678951ddd8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13532024-12-02T16:46:39.787ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
13542024-12-02T16:46:39.787ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
13552024-12-02T16:46:39.787ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13562024-12-02T16:46:39.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13572024-12-02T16:46:39.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13582024-12-02T16:46:39.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13592024-12-02T16:46:39.789ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13602024-12-02T16:46:39.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13612024-12-02T16:46:39.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13622024-12-02T16:46:39.791ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.565271ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13632024-12-02T16:46:39.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13642024-12-02T16:46:39.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13652024-12-02T16:46:39.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13662024-12-02T16:46:39.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13672024-12-02T16:46:39.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13682024-12-02T16:46:39.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13692024-12-02T16:46:39.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
13702024-12-02T16:46:39.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13712024-12-02T16:46:39.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13722024-12-02T16:46:39.809ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
13732024-12-02T16:46:39.809ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.076773ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
13742024-12-02T16:46:40.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5ab1d38c-6ec1-40db-8281-f1bfeb7a2b5e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13752024-12-02T16:46:40.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5ab1d38c-6ec1-40db-8281-f1bfeb7a2b5e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13762024-12-02T16:46:40.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5ab1d38c-6ec1-40db-8281-f1bfeb7a2b5e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13772024-12-02T16:46:41.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4f9a331e-3444-4d9a-994d-516d5f7a836b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13782024-12-02T16:46:41.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4f9a331e-3444-4d9a-994d-516d5f7a836b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13792024-12-02T16:46:41.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2680 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4f9a331e-3444-4d9a-994d-516d5f7a836b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13802024-12-02T16:46:42.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 98ab86e0-0b8f-40b9-8772-33d85a2b4ab2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13812024-12-02T16:46:42.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 98ab86e0-0b8f-40b9-8772-33d85a2b4ab2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13822024-12-02T16:46:42.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2661 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 98ab86e0-0b8f-40b9-8772-33d85a2b4ab2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13832024-12-02T16:46:42.960ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
13842024-12-02T16:46:42.960ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
13852024-12-02T16:46:42.990ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
13862024-12-02T16:46:42.990ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:54836
13872024-12-02T16:46:42.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54836 req_id = 61c215c8-8357-4972-ba2f-57b35f989727 roles = RoleSet { roles: {} } uri = /metrics/producers
13882024-12-02T16:46:42.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54836 req_id = 61c215c8-8357-4972-ba2f-57b35f989727 resource = Database result = Ok(()) uri = /metrics/producers
13892024-12-02T16:46:43.026ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
13902024-12-02T16:46:43.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35458 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54836 req_id = 61c215c8-8357-4972-ba2f-57b35f989727 response_code = 201 uri = /metrics/producers
13912024-12-02T16:46:43.026ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "61c215c8-8357-4972-ba2f-57b35f989727", "content-length": "41", "date": "Mon, 02 Dec 2024 16:46:42 GMT"} })
13922024-12-02T16:46:43.028ZDEBGnexus (producer-registration-task): registered with nexus successfully
13932024-12-02T16:46:43.028ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
13942024-12-02T16:46:43.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c5ebeb83-921a-490a-a8fe-3f6d0af1b67d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13952024-12-02T16:46:43.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c5ebeb83-921a-490a-a8fe-3f6d0af1b67d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13962024-12-02T16:46:43.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c5ebeb83-921a-490a-a8fe-3f6d0af1b67d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13972024-12-02T16:46:44.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d9bcf9a9-1f7d-4ff0-a28c-b10cdf17af11 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13982024-12-02T16:46:44.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d9bcf9a9-1f7d-4ff0-a28c-b10cdf17af11 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
13992024-12-02T16:46:44.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d9bcf9a9-1f7d-4ff0-a28c-b10cdf17af11 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
14002024-12-02T16:46:45.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d6089d00-0506-4f91-864c-9f34932de155 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
14012024-12-02T16:46:45.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d6089d00-0506-4f91-864c-9f34932de155 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
14022024-12-02T16:46:45.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d6089d00-0506-4f91-864c-9f34932de155 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
14032024-12-02T16:46:46.550ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1262 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = b1c2c8fc-da30-413e-8d17-0ffb4d0cce1c response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
14042024-12-02T16:46:46.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6524b507-1ff1-41c2-99d1-f4e8e537cb1a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
14052024-12-02T16:46:46.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6524b507-1ff1-41c2-99d1-f4e8e537cb1a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
14062024-12-02T16:46:46.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6524b507-1ff1-41c2-99d1-f4e8e537cb1a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
14072024-12-02T16:46:47.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 62493be7-3ce2-4994-ac44-3146d0ebae8b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
14082024-12-02T16:46:47.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 62493be7-3ce2-4994-ac44-3146d0ebae8b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
14092024-12-02T16:46:47.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 62493be7-3ce2-4994-ac44-3146d0ebae8b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
14102024-12-02T16:46:48.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e1161a7e-7bd5-435c-83dc-d41f12089aee roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
14112024-12-02T16:46:48.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e1161a7e-7bd5-435c-83dc-d41f12089aee resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
14122024-12-02T16:46:48.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e1161a7e-7bd5-435c-83dc-d41f12089aee response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
14132024-12-02T16:46:49.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = d17d44e2-d886-49d7-bfcd-cb2394d2b823 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
14142024-12-02T16:46:49.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = d17d44e2-d886-49d7-bfcd-cb2394d2b823 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
14152024-12-02T16:46:49.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = d17d44e2-d886-49d7-bfcd-cb2394d2b823 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
14162024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
14172024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
14182024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14192024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
14202024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
14212024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14222024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
14232024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
14242024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
14252024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14262024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
14272024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14282024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14292024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
14302024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
14312024-12-02T16:46:49.788ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c575ce6d-3e43-4b59-886a-60182869b755
14322024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.54\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"c575ce6d-3e43-4b59-886a-60182869b755"}
14332024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
14342024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
14352024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14362024-12-02T16:46:49.788ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-02 16:36:49.788194975 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
14372024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
14382024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
14392024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
14402024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14412024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14422024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
14432024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14442024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
14452024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14462024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
14472024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
14482024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14492024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14502024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
14512024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
14522024-12-02T16:46:49.788ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14532024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
14542024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14552024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14562024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
14572024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14582024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
14592024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14602024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14612024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14622024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14632024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14642024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14652024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14662024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14672024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14682024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14692024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
14702024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14712024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14722024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
14732024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
14742024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
14752024-12-02T16:46:49.788ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14762024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14772024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14782024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
14792024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14802024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14812024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14822024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14832024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
14842024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14852024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
14862024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14872024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
14882024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14892024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
14902024-12-02T16:46:49.788ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14912024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
14922024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14932024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14942024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14952024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14962024-12-02T16:46:49.789ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5510b96c-d504-40ca-83bc-e27293be3abe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 25571, tv_nsec: 531339667 } })
14972024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14982024-12-02T16:46:49.789ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a1a23f6-3701-4a53-9e08-543f9ba04e60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5030471-1797-42f6-9660-1ead64511c29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 25571, tv_nsec: 531361387 } })
14992024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
15002024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
15012024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15022024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15032024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15042024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15052024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15062024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15072024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15082024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15092024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
15102024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
15112024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.1982ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
15122024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15132024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15142024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
15152024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.475153ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
15162024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15172024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15182024-12-02T16:46:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15192024-12-02T16:46:49.791ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25571, tv_nsec: 533763208 } })
15202024-12-02T16:46:49.791ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
15212024-12-02T16:46:49.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15222024-12-02T16:46:49.792ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.000964ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15232024-12-02T16:46:49.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15242024-12-02T16:46:49.793ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15252024-12-02T16:46:49.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15262024-12-02T16:46:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15272024-12-02T16:46:49.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15282024-12-02T16:46:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15292024-12-02T16:46:49.796ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15302024-12-02T16:46:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15312024-12-02T16:46:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15322024-12-02T16:46:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15332024-12-02T16:46:49.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15342024-12-02T16:46:49.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15352024-12-02T16:46:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15362024-12-02T16:46:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15372024-12-02T16:46:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15382024-12-02T16:46:49.798ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15392024-12-02T16:46:49.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15402024-12-02T16:46:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15412024-12-02T16:46:49.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15422024-12-02T16:46:49.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15432024-12-02T16:46:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15442024-12-02T16:46:49.800ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-02 16:36:49.788194975 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
15452024-12-02T16:46:49.800ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.848404ms iteration = 4 status = {"expiration":"2024-12-02T16:36:49.788194975Z","pruned":[]}
15462024-12-02T16:46:49.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15472024-12-02T16:46:49.800ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15482024-12-02T16:46:49.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15492024-12-02T16:46:49.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15502024-12-02T16:46:49.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15512024-12-02T16:46:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15522024-12-02T16:46:49.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15532024-12-02T16:46:49.802ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15542024-12-02T16:46:49.802ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15552024-12-02T16:46:49.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15562024-12-02T16:46:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15572024-12-02T16:46:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15582024-12-02T16:46:49.804ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25571, tv_nsec: 546999904 } })
15592024-12-02T16:46:49.804ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
15602024-12-02T16:46:49.805ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.561435ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
15612024-12-02T16:46:49.805ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15622024-12-02T16:46:49.806ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
15632024-12-02T16:46:49.806ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
15642024-12-02T16:46:49.806ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 17.921616ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
15652024-12-02T16:46:49.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15662024-12-02T16:46:49.808ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15672024-12-02T16:46:49.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15682024-12-02T16:46:49.809ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15692024-12-02T16:46:49.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15702024-12-02T16:46:49.811ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15712024-12-02T16:46:49.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15722024-12-02T16:46:49.813ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15732024-12-02T16:46:49.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25571, tv_nsec: 556729779 } })
15742024-12-02T16:46:49.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
15752024-12-02T16:46:49.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15762024-12-02T16:46:49.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15772024-12-02T16:46:49.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15782024-12-02T16:46:49.815ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15792024-12-02T16:46:49.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15802024-12-02T16:46:49.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15812024-12-02T16:46:49.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15822024-12-02T16:46:49.818ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15832024-12-02T16:46:49.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15842024-12-02T16:46:49.819ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15852024-12-02T16:46:49.819ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15862024-12-02T16:46:49.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15872024-12-02T16:46:49.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15882024-12-02T16:46:49.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15892024-12-02T16:46:49.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
15902024-12-02T16:46:49.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15912024-12-02T16:46:49.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15922024-12-02T16:46:49.836ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15932024-12-02T16:46:49.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15942024-12-02T16:46:49.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15952024-12-02T16:46:49.837ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15962024-12-02T16:46:49.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15972024-12-02T16:46:49.839ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15982024-12-02T16:46:49.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15992024-12-02T16:46:49.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
16002024-12-02T16:46:49.840ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16012024-12-02T16:46:49.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16022024-12-02T16:46:49.851ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16032024-12-02T16:46:49.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
16042024-12-02T16:46:49.854ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
16052024-12-02T16:46:49.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
16062024-12-02T16:46:49.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16072024-12-02T16:46:49.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.579222ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
16082024-12-02T16:46:49.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16092024-12-02T16:46:49.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16102024-12-02T16:46:49.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16112024-12-02T16:46:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16122024-12-02T16:46:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16132024-12-02T16:46:49.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16142024-12-02T16:46:49.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16152024-12-02T16:46:49.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16162024-12-02T16:46:49.858ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16172024-12-02T16:46:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16182024-12-02T16:46:49.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16192024-12-02T16:46:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16202024-12-02T16:46:49.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16212024-12-02T16:46:49.860ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16222024-12-02T16:46:49.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16232024-12-02T16:46:49.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16242024-12-02T16:46:49.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.140349ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
16252024-12-02T16:46:49.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.302229ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16262024-12-02T16:46:49.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16272024-12-02T16:46:49.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16282024-12-02T16:46:49.863ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16292024-12-02T16:46:49.863ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.51384ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16302024-12-02T16:46:49.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16312024-12-02T16:46:49.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16322024-12-02T16:46:49.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16332024-12-02T16:46:49.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16342024-12-02T16:46:49.865ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
16352024-12-02T16:46:49.865ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 76.895063ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
16362024-12-02T16:46:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16372024-12-02T16:46:49.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16382024-12-02T16:46:49.866ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 78.786919ms iteration = 3 status = {"nsuccess":5}
16392024-12-02T16:46:49.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16402024-12-02T16:46:49.873ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16412024-12-02T16:46:49.873ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16422024-12-02T16:46:49.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 84.960483ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16432024-12-02T16:46:49.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.990207ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16442024-12-02T16:46:49.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16452024-12-02T16:46:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16462024-12-02T16:46:49.896ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16472024-12-02T16:46:49.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16482024-12-02T16:46:49.898ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16492024-12-02T16:46:49.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16502024-12-02T16:46:49.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16512024-12-02T16:46:49.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16522024-12-02T16:46:49.900ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16532024-12-02T16:46:49.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16542024-12-02T16:46:49.902ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16552024-12-02T16:46:49.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16562024-12-02T16:46:49.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 114.465271ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16572024-12-02T16:46:49.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16582024-12-02T16:46:49.904ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
16592024-12-02T16:46:49.904ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
16602024-12-02T16:46:49.904ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 116.244746ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
16612024-12-02T16:46:49.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16622024-12-02T16:46:49.906ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16632024-12-02T16:46:49.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16642024-12-02T16:46:49.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16652024-12-02T16:46:49.909ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
16662024-12-02T16:46:49.909ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
16672024-12-02T16:46:49.909ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
16682024-12-02T16:46:49.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16692024-12-02T16:46:49.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16702024-12-02T16:46:49.910ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 122.293269ms iteration = 10 status = {"physical_disks_added":0}
16712024-12-02T16:46:49.910ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16722024-12-02T16:46:49.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
16732024-12-02T16:46:49.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16742024-12-02T16:46:49.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16752024-12-02T16:46:49.911ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
16762024-12-02T16:46:49.911ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
16772024-12-02T16:46:49.911ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
16782024-12-02T16:46:49.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16792024-12-02T16:46:49.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16802024-12-02T16:46:49.912ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 123.986513ms iteration = 7 status = 0
16812024-12-02T16:46:49.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16822024-12-02T16:46:49.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16832024-12-02T16:46:49.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16842024-12-02T16:46:49.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16852024-12-02T16:46:49.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16862024-12-02T16:46:49.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16872024-12-02T16:46:49.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16882024-12-02T16:46:49.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 157.358955ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16892024-12-02T16:46:49.949ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16902024-12-02T16:46:49.949ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
16912024-12-02T16:46:49.949ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 0 version = 2
16922024-12-02T16:46:49.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16932024-12-02T16:46:49.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16942024-12-02T16:46:49.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16952024-12-02T16:46:49.953ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
16962024-12-02T16:46:49.953ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
16972024-12-02T16:46:49.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16982024-12-02T16:46:49.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16992024-12-02T16:46:49.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17002024-12-02T16:46:49.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17012024-12-02T16:46:49.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17022024-12-02T16:46:49.955ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17032024-12-02T16:46:49.957ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-02T16:43:45.642486Z, time_modified: 2024-12-02T16:43:45.642486Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }) }
17042024-12-02T16:46:49.957ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 169.619423ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]}},"default_endpoint":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
17052024-12-02T16:46:49.958ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17062024-12-02T16:46:49.958ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17072024-12-02T16:46:49.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17082024-12-02T16:46:49.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 94b3e404-52d5-40cd-ac35-cb5813e966cd roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
17092024-12-02T16:46:49.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 94b3e404-52d5-40cd-ac35-cb5813e966cd resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
17102024-12-02T16:46:49.982ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
17112024-12-02T16:46:49.982ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17122024-12-02T16:46:49.983ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "973caa6e-e56a-4666-a23e-c4583d2b1904", "content-length": "26", "date": "Mon, 02 Dec 2024 16:46:49 GMT"} })
17132024-12-02T16:46:49.983ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17142024-12-02T16:46:49.985ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17152024-12-02T16:46:49.998ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
17162024-12-02T16:46:49.998ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 209.846194ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
17172024-12-02T16:46:50.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17182024-12-02T16:46:50.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17192024-12-02T16:46:50.154ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17202024-12-02T16:46:50.154ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a83313b7-4739-4f3a-ab99-905315d5cbc4", "content-length": "1", "date": "Mon, 02 Dec 2024 16:46:49 GMT"} })
17212024-12-02T16:46:50.155ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17222024-12-02T16:46:50.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17232024-12-02T16:46:50.175ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
17242024-12-02T16:46:50.198ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
17252024-12-02T16:46:50.198ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17262024-12-02T16:46:50.199ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "abe11b63-d64d-4964-967e-d6bdc7dafea4", "content-length": "26", "date": "Mon, 02 Dec 2024 16:46:49 GMT"} })
17272024-12-02T16:46:50.199ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17282024-12-02T16:46:50.200ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17292024-12-02T16:46:50.212ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
17302024-12-02T16:46:50.212ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17312024-12-02T16:46:50.213ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ca9ea48-1ec8-4713-bb40-b38025965db3", "content-length": "26", "date": "Mon, 02 Dec 2024 16:46:49 GMT"} })
17322024-12-02T16:46:50.213ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17332024-12-02T16:46:50.215ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
17342024-12-02T16:46:50.258ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17352024-12-02T16:46:50.258ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17362024-12-02T16:46:50.258ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d049e49e-75cc-4171-ba32-58b477d3d20a", "content-length": "372", "date": "Mon, 02 Dec 2024 16:46:49 GMT"} })
17372024-12-02T16:46:50.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17382024-12-02T16:46:50.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17392024-12-02T16:46:50.258ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
17402024-12-02T16:46:50.260ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 1 version = 2
17412024-12-02T16:46:50.260ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
17422024-12-02T16:46:50.260ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-02 16:44:12.116348 UTC dns_group = external generation = 2
17432024-12-02T16:46:50.260ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 471.995455ms iteration = 5 status = {"generation":2}
17442024-12-02T16:46:50.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281850 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 94b3e404-52d5-40cd-ac35-cb5813e966cd response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
17452024-12-02T16:46:50.260ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
17462024-12-02T16:46:50.260ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17472024-12-02T16:46:50.260ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-02 16:44:11.214841 UTC dns_group = internal generation = 1
17482024-12-02T16:46:50.261ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 472.766902ms iteration = 5 status = {"generation":1}
17492024-12-02T16:46:50.261ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17502024-12-02T16:46:50.262ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 474.007973ms iteration = 7 status = null
17512024-12-02T16:46:50.263ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17522024-12-02T16:46:50.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17532024-12-02T16:46:50.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17542024-12-02T16:46:50.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17552024-12-02T16:46:50.266ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17562024-12-02T16:46:50.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17572024-12-02T16:46:50.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17582024-12-02T16:46:50.306ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
17592024-12-02T16:46:50.306ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17602024-12-02T16:46:50.307ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fbdae378-8f64-4e54-8231-e4167fd31aae", "date": "Mon, 02 Dec 2024 16:46:49 GMT"} })
17612024-12-02T16:46:50.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17622024-12-02T16:46:50.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17632024-12-02T16:46:50.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17642024-12-02T16:46:50.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17652024-12-02T16:46:50.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17662024-12-02T16:46:50.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17672024-12-02T16:46:50.316ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17682024-12-02T16:46:50.316ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17692024-12-02T16:46:50.317ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e804b98b-db29-4ed6-bb1a-128d9910b4fb", "date": "Mon, 02 Dec 2024 16:46:49 GMT"} })
17702024-12-02T16:46:50.318ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 529.70264ms iteration = 8 status = {}
17712024-12-02T16:46:50.319ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
17722024-12-02T16:46:50.320ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a6b16dff-578f-4de1-88b8-7e66653f85a7", "date": "Mon, 02 Dec 2024 16:46:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17732024-12-02T16:46:50.320ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17742024-12-02T16:46:50.322ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3db3f283-e5d9-4d37-ad96-f91d845aad4d", "date": "Mon, 02 Dec 2024 16:46:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17752024-12-02T16:46:50.322ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17762024-12-02T16:46:50.323ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17772024-12-02T16:46:50.323ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 535.43966ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
17782024-12-02T16:46:50.338ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 550.617893ms iteration = 7 status = {}
17792024-12-02T16:46:50.363ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
17802024-12-02T16:46:50.363ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ab1c5106-afa4-4f6c-b39f-30f61c870bf6", "date": "Mon, 02 Dec 2024 16:46:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17812024-12-02T16:46:50.363ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17822024-12-02T16:46:50.365ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1bac79b1-51b8-4888-bd68-518bd5c21c6c", "date": "Mon, 02 Dec 2024 16:46:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17832024-12-02T16:46:50.365ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17842024-12-02T16:46:50.366ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "71db6de9-d343-4da6-be95-2b75e0865578", "date": "Mon, 02 Dec 2024 16:46:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17852024-12-02T16:46:50.366ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17862024-12-02T16:46:50.367ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
17872024-12-02T16:46:50.367ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 579.825678ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
17882024-12-02T16:46:50.397ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17892024-12-02T16:46:50.397ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "04fc8fc2-6162-4e10-99f4-d1d4b630bc9c", "content-length": "691", "date": "Mon, 02 Dec 2024 16:46:49 GMT"} })
17902024-12-02T16:46:50.397ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
17912024-12-02T16:46:50.397ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
17922024-12-02T16:46:50.397ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
17932024-12-02T16:46:50.398ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 610.458475ms iteration = 7 status = {}
17942024-12-02T16:46:50.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17952024-12-02T16:46:50.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17962024-12-02T16:46:50.436ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
17972024-12-02T16:46:50.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17982024-12-02T16:46:50.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17992024-12-02T16:46:50.445ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18002024-12-02T16:46:50.445ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "101234a0-c59a-4424-b0ce-471ca4fc1dcc", "content-length": "134", "date": "Mon, 02 Dec 2024 16:46:50 GMT"} })
18012024-12-02T16:46:50.446ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
18022024-12-02T16:46:50.446ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
18032024-12-02T16:46:50.446ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18042024-12-02T16:46:50.446ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18052024-12-02T16:46:50.446ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18062024-12-02T16:46:50.446ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18072024-12-02T16:46:50.446ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18082024-12-02T16:46:50.446ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18092024-12-02T16:46:50.446ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18102024-12-02T16:46:50.446ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18112024-12-02T16:46:50.446ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
18122024-12-02T16:46:50.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18132024-12-02T16:46:50.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18142024-12-02T16:46:50.449ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18152024-12-02T16:46:50.449ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "244a4d65-51a1-427a-a401-abc26e17c7ac", "content-length": "2", "date": "Mon, 02 Dec 2024 16:46:50 GMT"} })
18162024-12-02T16:46:50.449ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18172024-12-02T16:46:50.449ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd7844d1-c4c2-4e36-ae38-4d44b4a895e6", "content-length": "52", "date": "Mon, 02 Dec 2024 16:46:50 GMT"} })
18182024-12-02T16:46:50.449ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
18192024-12-02T16:46:50.449ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18202024-12-02T16:46:50.538ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1b35d2b6-b152-4d00-a5a7-6eea97053aa1", "date": "Mon, 02 Dec 2024 16:46:49 GMT"} })
18212024-12-02T16:46:50.538ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
18222024-12-02T16:46:50.538ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18232024-12-02T16:46:50.538ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdce3ba3-d1bb-41ac-aed0-cdb45e7c9ab8", "content-length": "682", "date": "Mon, 02 Dec 2024 16:46:49 GMT"} })
18242024-12-02T16:46:50.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18252024-12-02T16:46:50.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18262024-12-02T16:46:50.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18272024-12-02T16:46:50.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18282024-12-02T16:46:50.546ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18292024-12-02T16:46:50.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18302024-12-02T16:46:50.548ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18312024-12-02T16:46:50.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18322024-12-02T16:46:50.555ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 767.67113ms iteration = 7 status = {}
18332024-12-02T16:46:51.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 71d36c20-50cb-449c-b869-ef7bb4633510 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18342024-12-02T16:46:51.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 71d36c20-50cb-449c-b869-ef7bb4633510 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18352024-12-02T16:46:51.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 71d36c20-50cb-449c-b869-ef7bb4633510 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18362024-12-02T16:46:52.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cdb11204-e987-4965-b5ce-3b9ae6de3f97 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18372024-12-02T16:46:52.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cdb11204-e987-4965-b5ce-3b9ae6de3f97 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18382024-12-02T16:46:52.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cdb11204-e987-4965-b5ce-3b9ae6de3f97 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18392024-12-02T16:46:53.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 879103fa-af0f-47d2-a2f4-cf4b86e4e422 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18402024-12-02T16:46:53.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 879103fa-af0f-47d2-a2f4-cf4b86e4e422 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18412024-12-02T16:46:53.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2784 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 879103fa-af0f-47d2-a2f4-cf4b86e4e422 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18422024-12-02T16:46:54.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c72b9891-9550-42b4-901a-3a8dff0d0029 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18432024-12-02T16:46:54.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c72b9891-9550-42b4-901a-3a8dff0d0029 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18442024-12-02T16:46:54.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c72b9891-9550-42b4-901a-3a8dff0d0029 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18452024-12-02T16:46:55.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 03403a6a-2021-4173-bac4-cd269e75c9e2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18462024-12-02T16:46:55.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 03403a6a-2021-4173-bac4-cd269e75c9e2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18472024-12-02T16:46:55.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 03403a6a-2021-4173-bac4-cd269e75c9e2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18482024-12-02T16:46:56.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = be9f7c69-b7b5-44b8-a2e8-74a15b3ed5c5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18492024-12-02T16:46:56.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = be9f7c69-b7b5-44b8-a2e8-74a15b3ed5c5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18502024-12-02T16:46:56.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = be9f7c69-b7b5-44b8-a2e8-74a15b3ed5c5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18512024-12-02T16:46:56.551ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1739 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 11d3ea70-250e-4fc7-bfe6-e56215435ffd response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
18522024-12-02T16:46:57.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 537f776f-dd25-4961-9982-3a51b3bb843e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18532024-12-02T16:46:57.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 537f776f-dd25-4961-9982-3a51b3bb843e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18542024-12-02T16:46:57.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 537f776f-dd25-4961-9982-3a51b3bb843e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18552024-12-02T16:46:58.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ca1798f-8bcf-4363-9b04-684e663c8247 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18562024-12-02T16:46:58.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ca1798f-8bcf-4363-9b04-684e663c8247 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18572024-12-02T16:46:58.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ca1798f-8bcf-4363-9b04-684e663c8247 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18582024-12-02T16:46:59.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 56a7fe2d-3923-448a-8359-46839b59fd66 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18592024-12-02T16:46:59.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 56a7fe2d-3923-448a-8359-46839b59fd66 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18602024-12-02T16:46:59.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 56a7fe2d-3923-448a-8359-46839b59fd66 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18612024-12-02T16:46:59.788ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
18622024-12-02T16:46:59.788ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
18632024-12-02T16:46:59.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18642024-12-02T16:46:59.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18652024-12-02T16:46:59.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18662024-12-02T16:46:59.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18672024-12-02T16:46:59.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18682024-12-02T16:46:59.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18692024-12-02T16:46:59.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18702024-12-02T16:46:59.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18712024-12-02T16:46:59.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18722024-12-02T16:46:59.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18732024-12-02T16:46:59.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18742024-12-02T16:46:59.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18752024-12-02T16:46:59.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18762024-12-02T16:46:59.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
18772024-12-02T16:46:59.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18782024-12-02T16:46:59.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18792024-12-02T16:46:59.807ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
18802024-12-02T16:46:59.807ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.312369ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
18812024-12-02T16:46:59.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.976951ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18822024-12-02T16:47:00.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4f20a52f-e179-4890-a05f-1083511f544d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18832024-12-02T16:47:00.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4f20a52f-e179-4890-a05f-1083511f544d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18842024-12-02T16:47:00.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4f20a52f-e179-4890-a05f-1083511f544d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18852024-12-02T16:47:01.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d7ac8841-872b-45de-969b-83aa4b6999e5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18862024-12-02T16:47:01.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d7ac8841-872b-45de-969b-83aa4b6999e5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18872024-12-02T16:47:01.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d7ac8841-872b-45de-969b-83aa4b6999e5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18882024-12-02T16:47:02.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 839fc3db-dfb4-41d9-b5b7-cd4944ee4cdd roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18892024-12-02T16:47:02.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 839fc3db-dfb4-41d9-b5b7-cd4944ee4cdd resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18902024-12-02T16:47:02.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 839fc3db-dfb4-41d9-b5b7-cd4944ee4cdd response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18912024-12-02T16:47:03.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 96f2353a-1c3b-4b51-bf9d-57350eb8f7d5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18922024-12-02T16:47:03.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 96f2353a-1c3b-4b51-bf9d-57350eb8f7d5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18932024-12-02T16:47:03.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 96f2353a-1c3b-4b51-bf9d-57350eb8f7d5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18942024-12-02T16:47:04.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 988e5129-6495-49b3-b7ec-08a0a27aa253 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18952024-12-02T16:47:04.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 988e5129-6495-49b3-b7ec-08a0a27aa253 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18962024-12-02T16:47:04.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 988e5129-6495-49b3-b7ec-08a0a27aa253 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18972024-12-02T16:47:05.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1a0631a3-c10d-4437-a2a5-fa6526157471 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18982024-12-02T16:47:05.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1a0631a3-c10d-4437-a2a5-fa6526157471 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
18992024-12-02T16:47:05.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1a0631a3-c10d-4437-a2a5-fa6526157471 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19002024-12-02T16:47:06.551ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1396 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = ac330b79-23d0-4132-b7ad-e2854b851f36 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
19012024-12-02T16:47:06.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 835b1742-5eb4-4348-a921-7c2019746ba8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19022024-12-02T16:47:06.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 835b1742-5eb4-4348-a921-7c2019746ba8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19032024-12-02T16:47:06.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 835b1742-5eb4-4348-a921-7c2019746ba8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19042024-12-02T16:47:07.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2b0c1c00-c06d-4f51-81a0-c71c8cb56d52 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19052024-12-02T16:47:07.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2b0c1c00-c06d-4f51-81a0-c71c8cb56d52 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19062024-12-02T16:47:07.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2b0c1c00-c06d-4f51-81a0-c71c8cb56d52 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19072024-12-02T16:47:08.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a7156745-35f6-496e-ba4f-ddee635955f2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19082024-12-02T16:47:08.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a7156745-35f6-496e-ba4f-ddee635955f2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19092024-12-02T16:47:08.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a7156745-35f6-496e-ba4f-ddee635955f2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19102024-12-02T16:47:09.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4d8c4a96-e9b8-4ea8-afef-f4f46e331329 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19112024-12-02T16:47:09.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4d8c4a96-e9b8-4ea8-afef-f4f46e331329 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19122024-12-02T16:47:09.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4d8c4a96-e9b8-4ea8-afef-f4f46e331329 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19132024-12-02T16:47:09.788ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
19142024-12-02T16:47:09.788ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
19152024-12-02T16:47:09.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19162024-12-02T16:47:09.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19172024-12-02T16:47:09.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19182024-12-02T16:47:09.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19192024-12-02T16:47:09.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19202024-12-02T16:47:09.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19212024-12-02T16:47:09.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19222024-12-02T16:47:09.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19232024-12-02T16:47:09.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19242024-12-02T16:47:09.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19252024-12-02T16:47:09.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19262024-12-02T16:47:09.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19272024-12-02T16:47:09.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19282024-12-02T16:47:09.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
19292024-12-02T16:47:09.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19302024-12-02T16:47:09.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19312024-12-02T16:47:09.812ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
19322024-12-02T16:47:09.812ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.453595ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
19332024-12-02T16:47:09.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.967922ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19342024-12-02T16:47:10.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e5794624-07d6-44d5-ab96-7acb4104d548 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19352024-12-02T16:47:10.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e5794624-07d6-44d5-ab96-7acb4104d548 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19362024-12-02T16:47:10.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e5794624-07d6-44d5-ab96-7acb4104d548 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19372024-12-02T16:47:11.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6ce3854e-3bcd-4f04-8981-1f35db3c1182 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19382024-12-02T16:47:11.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6ce3854e-3bcd-4f04-8981-1f35db3c1182 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19392024-12-02T16:47:11.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6ce3854e-3bcd-4f04-8981-1f35db3c1182 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19402024-12-02T16:47:12.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c0ae99c1-f07c-408c-b0d5-548210c1d4b4 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19412024-12-02T16:47:12.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c0ae99c1-f07c-408c-b0d5-548210c1d4b4 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19422024-12-02T16:47:12.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c0ae99c1-f07c-408c-b0d5-548210c1d4b4 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19432024-12-02T16:47:13.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 02b0281d-7e8d-442d-b0cb-03c1e91daeb4 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19442024-12-02T16:47:13.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 02b0281d-7e8d-442d-b0cb-03c1e91daeb4 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19452024-12-02T16:47:13.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 02b0281d-7e8d-442d-b0cb-03c1e91daeb4 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19462024-12-02T16:47:14.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8d13fba2-3872-47c9-8462-5f56f7fa833c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19472024-12-02T16:47:14.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8d13fba2-3872-47c9-8462-5f56f7fa833c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19482024-12-02T16:47:14.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8d13fba2-3872-47c9-8462-5f56f7fa833c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19492024-12-02T16:47:15.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9aa535e2-ff4d-4054-8fff-d360d0c19a7a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19502024-12-02T16:47:15.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9aa535e2-ff4d-4054-8fff-d360d0c19a7a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19512024-12-02T16:47:15.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9aa535e2-ff4d-4054-8fff-d360d0c19a7a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19522024-12-02T16:47:16.551ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1319 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 334c5549-154a-4553-9ba0-875797e64915 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
19532024-12-02T16:47:16.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 389fae44-15d7-44c8-a2f3-2092ce7be3a8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19542024-12-02T16:47:16.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 389fae44-15d7-44c8-a2f3-2092ce7be3a8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19552024-12-02T16:47:16.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 389fae44-15d7-44c8-a2f3-2092ce7be3a8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19562024-12-02T16:47:17.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 047811d9-2ec6-4ea0-95e9-80b9ccfcd070 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19572024-12-02T16:47:17.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 047811d9-2ec6-4ea0-95e9-80b9ccfcd070 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19582024-12-02T16:47:17.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1743 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 047811d9-2ec6-4ea0-95e9-80b9ccfcd070 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19592024-12-02T16:47:18.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = add9d438-b4f7-46fb-8738-589d1ae53a50 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19602024-12-02T16:47:18.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = add9d438-b4f7-46fb-8738-589d1ae53a50 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19612024-12-02T16:47:18.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = add9d438-b4f7-46fb-8738-589d1ae53a50 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
19622024-12-02T16:47:19.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 5481161a-9c8a-4c5b-ae49-e62a443296b6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
19632024-12-02T16:47:19.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 5481161a-9c8a-4c5b-ae49-e62a443296b6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
19642024-12-02T16:47:19.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 5481161a-9c8a-4c5b-ae49-e62a443296b6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
19652024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
19662024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
19672024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19682024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19692024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19702024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
19712024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19722024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
19732024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19742024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
19752024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
19762024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19772024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
19782024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19792024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
19802024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
19812024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19822024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19832024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
19842024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19852024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
19862024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19872024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19882024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19892024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19902024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19912024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19922024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19932024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19942024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19952024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19962024-12-02T16:47:19.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
19972024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
19982024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
19992024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
20002024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20012024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
20022024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20032024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
20042024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
20052024-12-02T16:47:19.789ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20062024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20072024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20082024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
20092024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20102024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20112024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20122024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20132024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20142024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20152024-12-02T16:47:19.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20162024-12-02T16:47:19.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20172024-12-02T16:47:19.791ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.40111ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20182024-12-02T16:47:19.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20192024-12-02T16:47:19.792ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25601, tv_nsec: 534198082 } })
20202024-12-02T16:47:19.792ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
20212024-12-02T16:47:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20222024-12-02T16:47:19.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20232024-12-02T16:47:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20242024-12-02T16:47:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20252024-12-02T16:47:19.794ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20262024-12-02T16:47:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20272024-12-02T16:47:19.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20282024-12-02T16:47:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20292024-12-02T16:47:19.799ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20302024-12-02T16:47:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20312024-12-02T16:47:19.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20322024-12-02T16:47:19.802ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25601, tv_nsec: 544125099 } })
20332024-12-02T16:47:19.802ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
20342024-12-02T16:47:19.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20352024-12-02T16:47:19.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20362024-12-02T16:47:19.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20372024-12-02T16:47:19.803ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20382024-12-02T16:47:19.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20392024-12-02T16:47:19.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20402024-12-02T16:47:19.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20412024-12-02T16:47:19.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20422024-12-02T16:47:19.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
20432024-12-02T16:47:19.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20442024-12-02T16:47:19.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20452024-12-02T16:47:19.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20462024-12-02T16:47:19.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20472024-12-02T16:47:19.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20482024-12-02T16:47:19.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20492024-12-02T16:47:19.832ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
20502024-12-02T16:47:19.832ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.162666ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
20512024-12-02T16:47:19.834ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25601, tv_nsec: 576140579 } })
20522024-12-02T16:47:19.834ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
20532024-12-02T16:47:19.835ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20542024-12-02T16:47:19.835ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20552024-12-02T16:47:19.835ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20562024-12-02T16:47:19.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20572024-12-02T16:47:19.842ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20582024-12-02T16:47:19.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20592024-12-02T16:47:19.842ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20602024-12-02T16:47:19.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20612024-12-02T16:47:19.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20622024-12-02T16:47:19.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.571941ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20632024-12-02T16:47:19.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20642024-12-02T16:47:19.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.703123ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
20652024-12-02T16:47:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20662024-12-02T16:47:19.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20672024-12-02T16:47:19.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20682024-12-02T16:47:19.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20692024-12-02T16:47:19.851ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20702024-12-02T16:47:19.851ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.805338ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20712024-12-02T16:47:19.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20722024-12-02T16:47:19.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20732024-12-02T16:47:19.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20742024-12-02T16:47:19.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.743307ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
20752024-12-02T16:47:19.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20762024-12-02T16:47:19.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20772024-12-02T16:47:19.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20782024-12-02T16:47:19.855ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20792024-12-02T16:47:19.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20802024-12-02T16:47:19.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20812024-12-02T16:47:19.860ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20822024-12-02T16:47:19.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20832024-12-02T16:47:19.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20842024-12-02T16:47:19.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20852024-12-02T16:47:19.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20862024-12-02T16:47:19.874ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20872024-12-02T16:47:19.874ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20882024-12-02T16:47:19.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20892024-12-02T16:47:19.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20902024-12-02T16:47:19.874ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20912024-12-02T16:47:19.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20922024-12-02T16:47:19.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.833325ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20932024-12-02T16:47:19.878ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20942024-12-02T16:47:19.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20952024-12-02T16:47:19.896ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 107.304608ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
20962024-12-02T16:47:19.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20972024-12-02T16:47:19.915ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20982024-12-02T16:47:19.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
20992024-12-02T16:47:19.915ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21002024-12-02T16:47:19.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21012024-12-02T16:47:19.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21022024-12-02T16:47:19.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 127.944998ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
21032024-12-02T16:47:19.918ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 128.571134ms iteration = 8 status = 0
21042024-12-02T16:47:19.935ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21052024-12-02T16:47:19.935ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21062024-12-02T16:47:19.935ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 147.143526ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21072024-12-02T16:47:19.935ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
21082024-12-02T16:47:19.935ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21092024-12-02T16:47:19.935ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "21ba0a6e-76d5-46d8-a636-05dfa77ceceb", "content-length": "26", "date": "Mon, 02 Dec 2024 16:47:19 GMT"} })
21102024-12-02T16:47:19.935ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21112024-12-02T16:47:19.937ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
21122024-12-02T16:47:19.941ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21132024-12-02T16:47:19.941ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21142024-12-02T16:47:19.941ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "354f6335-e4e0-4996-8952-a3e629517732", "content-length": "26", "date": "Mon, 02 Dec 2024 16:47:19 GMT"} })
21152024-12-02T16:47:19.941ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21162024-12-02T16:47:19.943ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21172024-12-02T16:47:19.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21182024-12-02T16:47:19.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21192024-12-02T16:47:19.956ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 168.16982ms iteration = 11 status = {"physical_disks_added":0}
21202024-12-02T16:47:19.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 44b08089-1dff-4d4d-9c39-c0dcf1c8c6a3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
21212024-12-02T16:47:19.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 44b08089-1dff-4d4d-9c39-c0dcf1c8c6a3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
21222024-12-02T16:47:19.988ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21232024-12-02T16:47:19.988ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21242024-12-02T16:47:19.989ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "69066f51-3944-45d5-b100-a7d884f40306", "content-length": "26", "date": "Mon, 02 Dec 2024 16:47:19 GMT"} })
21252024-12-02T16:47:19.989ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21262024-12-02T16:47:19.991ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21272024-12-02T16:47:20.038ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21282024-12-02T16:47:20.038ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21292024-12-02T16:47:20.039ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e47ece8e-9057-48b0-8f02-6614b599c4f7", "content-length": "372", "date": "Mon, 02 Dec 2024 16:47:19 GMT"} })
21302024-12-02T16:47:20.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21312024-12-02T16:47:20.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21322024-12-02T16:47:20.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 44b08089-1dff-4d4d-9c39-c0dcf1c8c6a3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
21332024-12-02T16:47:20.052ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21342024-12-02T16:47:20.052ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "57c75e8b-8630-42b0-8aef-8a38e3686be6", "content-length": "1", "date": "Mon, 02 Dec 2024 16:47:19 GMT"} })
21352024-12-02T16:47:20.053ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21362024-12-02T16:47:20.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21372024-12-02T16:47:20.055ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 267.569239ms iteration = 8 status = null
21382024-12-02T16:47:20.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21392024-12-02T16:47:20.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21402024-12-02T16:47:20.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21412024-12-02T16:47:20.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21422024-12-02T16:47:20.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21432024-12-02T16:47:20.072ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21442024-12-02T16:47:20.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21452024-12-02T16:47:20.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21462024-12-02T16:47:20.081ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
21472024-12-02T16:47:20.081ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21482024-12-02T16:47:20.081ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1530ef1d-0f80-40f7-b7c2-d9367f15157f", "date": "Mon, 02 Dec 2024 16:47:19 GMT"} })
21492024-12-02T16:47:20.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21502024-12-02T16:47:20.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21512024-12-02T16:47:20.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21522024-12-02T16:47:20.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21532024-12-02T16:47:20.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21542024-12-02T16:47:20.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21552024-12-02T16:47:20.089ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
21562024-12-02T16:47:20.089ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21572024-12-02T16:47:20.090ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ce193a06-d712-4035-975d-25a2b410446f", "date": "Mon, 02 Dec 2024 16:47:19 GMT"} })
21582024-12-02T16:47:20.091ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 301.812318ms iteration = 9 status = {}
21592024-12-02T16:47:20.219ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 431.35415ms iteration = 8 status = {}
21602024-12-02T16:47:20.277ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21612024-12-02T16:47:20.277ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8807f0b5-79ea-4860-9919-64572f83ce81", "content-length": "691", "date": "Mon, 02 Dec 2024 16:47:19 GMT"} })
21622024-12-02T16:47:20.277ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
21632024-12-02T16:47:20.277ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
21642024-12-02T16:47:20.277ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
21652024-12-02T16:47:20.279ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 491.416126ms iteration = 8 status = {}
21662024-12-02T16:47:20.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21672024-12-02T16:47:20.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21682024-12-02T16:47:20.320ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
21692024-12-02T16:47:20.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21702024-12-02T16:47:20.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21712024-12-02T16:47:20.330ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
21722024-12-02T16:47:20.330ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5063a413-92b7-4dd6-9e67-59a459a4dc7e", "content-length": "134", "date": "Mon, 02 Dec 2024 16:47:19 GMT"} })
21732024-12-02T16:47:20.330ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
21742024-12-02T16:47:20.330ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
21752024-12-02T16:47:20.330ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21762024-12-02T16:47:20.330ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21772024-12-02T16:47:20.330ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21782024-12-02T16:47:20.330ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21792024-12-02T16:47:20.330ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21802024-12-02T16:47:20.330ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21812024-12-02T16:47:20.331ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21822024-12-02T16:47:20.331ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21832024-12-02T16:47:20.331ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
21842024-12-02T16:47:20.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21852024-12-02T16:47:20.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21862024-12-02T16:47:20.333ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
21872024-12-02T16:47:20.333ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a666fe72-845e-483a-84ff-e2a44b8154f0", "content-length": "2", "date": "Mon, 02 Dec 2024 16:47:19 GMT"} })
21882024-12-02T16:47:20.333ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
21892024-12-02T16:47:20.333ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d045061-47df-4737-b32f-b6dd81d7b6aa", "content-length": "52", "date": "Mon, 02 Dec 2024 16:47:19 GMT"} })
21902024-12-02T16:47:20.333ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
21912024-12-02T16:47:20.333ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21922024-12-02T16:47:20.426ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7830fe8f-35d5-42f0-a136-1f76913b7f7c", "date": "Mon, 02 Dec 2024 16:47:19 GMT"} })
21932024-12-02T16:47:20.426ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
21942024-12-02T16:47:20.426ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
21952024-12-02T16:47:20.426ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b498a0d4-a622-45a8-8644-2d777cfe5f5c", "content-length": "682", "date": "Mon, 02 Dec 2024 16:47:20 GMT"} })
21962024-12-02T16:47:20.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21972024-12-02T16:47:20.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21982024-12-02T16:47:20.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21992024-12-02T16:47:20.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22002024-12-02T16:47:20.434ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22012024-12-02T16:47:20.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22022024-12-02T16:47:20.435ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22032024-12-02T16:47:20.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22042024-12-02T16:47:20.443ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 654.992006ms iteration = 8 status = {}
22052024-12-02T16:47:21.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3dbea7f4-0c4b-4139-bfdf-de51fdbb6721 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22062024-12-02T16:47:21.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3dbea7f4-0c4b-4139-bfdf-de51fdbb6721 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22072024-12-02T16:47:21.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3dbea7f4-0c4b-4139-bfdf-de51fdbb6721 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22082024-12-02T16:47:22.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3b89bc12-5a18-4064-b0e5-2d872820df3b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22092024-12-02T16:47:22.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3b89bc12-5a18-4064-b0e5-2d872820df3b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22102024-12-02T16:47:22.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1763 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3b89bc12-5a18-4064-b0e5-2d872820df3b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22112024-12-02T16:47:23.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5a96d223-e835-4cf0-8675-5fc6729674f6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22122024-12-02T16:47:23.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5a96d223-e835-4cf0-8675-5fc6729674f6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22132024-12-02T16:47:23.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5a96d223-e835-4cf0-8675-5fc6729674f6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22142024-12-02T16:47:24.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 90edb974-5a2f-4300-8ba6-25fdbe95f7bb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22152024-12-02T16:47:24.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 90edb974-5a2f-4300-8ba6-25fdbe95f7bb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22162024-12-02T16:47:24.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 90edb974-5a2f-4300-8ba6-25fdbe95f7bb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22172024-12-02T16:47:25.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 42dd061c-231b-4115-ba3e-7719fca4cc9a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22182024-12-02T16:47:25.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 42dd061c-231b-4115-ba3e-7719fca4cc9a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22192024-12-02T16:47:25.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 42dd061c-231b-4115-ba3e-7719fca4cc9a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22202024-12-02T16:47:26.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f5721254-b468-4e8d-8efb-80d743572552 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22212024-12-02T16:47:26.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f5721254-b468-4e8d-8efb-80d743572552 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22222024-12-02T16:47:26.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f5721254-b468-4e8d-8efb-80d743572552 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22232024-12-02T16:47:26.551ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1297 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 905594fd-25e4-485d-9e53-fa4847cffc22 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
22242024-12-02T16:47:27.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8bc4fadc-0736-4305-bed9-083e3eb825da roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22252024-12-02T16:47:27.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8bc4fadc-0736-4305-bed9-083e3eb825da resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22262024-12-02T16:47:27.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8bc4fadc-0736-4305-bed9-083e3eb825da response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22272024-12-02T16:47:28.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d308be57-5d81-47d7-bc54-7932b092f974 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22282024-12-02T16:47:28.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d308be57-5d81-47d7-bc54-7932b092f974 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22292024-12-02T16:47:28.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d308be57-5d81-47d7-bc54-7932b092f974 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22302024-12-02T16:47:29.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 17aff461-588e-4ce5-ae72-06c652121c79 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22312024-12-02T16:47:29.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 17aff461-588e-4ce5-ae72-06c652121c79 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22322024-12-02T16:47:29.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 17aff461-588e-4ce5-ae72-06c652121c79 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22332024-12-02T16:47:29.788ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
22342024-12-02T16:47:29.788ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
22352024-12-02T16:47:29.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22362024-12-02T16:47:29.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22372024-12-02T16:47:29.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22382024-12-02T16:47:29.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22392024-12-02T16:47:29.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22402024-12-02T16:47:29.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22412024-12-02T16:47:29.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22422024-12-02T16:47:29.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22432024-12-02T16:47:29.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22442024-12-02T16:47:29.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22452024-12-02T16:47:29.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22462024-12-02T16:47:29.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22472024-12-02T16:47:29.820ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.254343ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22482024-12-02T16:47:29.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22492024-12-02T16:47:29.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
22502024-12-02T16:47:29.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22512024-12-02T16:47:29.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22522024-12-02T16:47:29.836ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
22532024-12-02T16:47:29.836ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.310494ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
22542024-12-02T16:47:30.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 89d77f75-c0e4-4b47-8283-d489e46be79a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22552024-12-02T16:47:30.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 89d77f75-c0e4-4b47-8283-d489e46be79a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22562024-12-02T16:47:30.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1760 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 89d77f75-c0e4-4b47-8283-d489e46be79a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22572024-12-02T16:47:31.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 200ce02e-b22d-45a3-a986-c14fd22415d2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22582024-12-02T16:47:31.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 200ce02e-b22d-45a3-a986-c14fd22415d2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22592024-12-02T16:47:31.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 200ce02e-b22d-45a3-a986-c14fd22415d2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22602024-12-02T16:47:32.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ad90da1b-ef5f-41a7-9ef1-b64b40d7eb0b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22612024-12-02T16:47:32.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ad90da1b-ef5f-41a7-9ef1-b64b40d7eb0b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22622024-12-02T16:47:32.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ad90da1b-ef5f-41a7-9ef1-b64b40d7eb0b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22632024-12-02T16:47:33.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 214d2907-e690-4b75-80a3-1b6a1c9763db roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22642024-12-02T16:47:33.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 214d2907-e690-4b75-80a3-1b6a1c9763db resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22652024-12-02T16:47:33.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 214d2907-e690-4b75-80a3-1b6a1c9763db response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22662024-12-02T16:47:34.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8980fd3d-247a-4211-9b51-a67273005585 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22672024-12-02T16:47:34.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8980fd3d-247a-4211-9b51-a67273005585 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22682024-12-02T16:47:34.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8980fd3d-247a-4211-9b51-a67273005585 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22692024-12-02T16:47:35.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f43607ff-d963-4021-ac24-630a2fb38f42 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22702024-12-02T16:47:35.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f43607ff-d963-4021-ac24-630a2fb38f42 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22712024-12-02T16:47:35.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f43607ff-d963-4021-ac24-630a2fb38f42 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22722024-12-02T16:47:36.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 16019145-5696-4b48-945c-2777117df43b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22732024-12-02T16:47:36.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 16019145-5696-4b48-945c-2777117df43b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22742024-12-02T16:47:36.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 16019145-5696-4b48-945c-2777117df43b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22752024-12-02T16:47:36.552ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1664 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = db76c417-cc9a-49ea-a32b-de02a8df0250 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
22762024-12-02T16:47:37.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a09e74b6-39dd-4fc9-b69c-e8f8e6ff1810 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22772024-12-02T16:47:37.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a09e74b6-39dd-4fc9-b69c-e8f8e6ff1810 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22782024-12-02T16:47:37.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a09e74b6-39dd-4fc9-b69c-e8f8e6ff1810 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22792024-12-02T16:47:38.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 89d91cd0-14ad-4f5e-bd2f-3df15ab3540a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22802024-12-02T16:47:38.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 89d91cd0-14ad-4f5e-bd2f-3df15ab3540a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22812024-12-02T16:47:38.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1907 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 89d91cd0-14ad-4f5e-bd2f-3df15ab3540a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22822024-12-02T16:47:39.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 66b27e3a-beb5-4436-9c98-8c4debe6e663 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22832024-12-02T16:47:39.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 66b27e3a-beb5-4436-9c98-8c4debe6e663 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22842024-12-02T16:47:39.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 66b27e3a-beb5-4436-9c98-8c4debe6e663 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
22852024-12-02T16:47:39.788ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
22862024-12-02T16:47:39.788ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
22872024-12-02T16:47:39.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22882024-12-02T16:47:39.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22892024-12-02T16:47:39.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22902024-12-02T16:47:39.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22912024-12-02T16:47:39.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22922024-12-02T16:47:39.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22932024-12-02T16:47:39.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22942024-12-02T16:47:39.792ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.340527ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22952024-12-02T16:47:39.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22962024-12-02T16:47:39.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22972024-12-02T16:47:39.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22982024-12-02T16:47:39.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22992024-12-02T16:47:39.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23002024-12-02T16:47:39.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23012024-12-02T16:47:39.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
23022024-12-02T16:47:39.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23032024-12-02T16:47:39.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23042024-12-02T16:47:39.809ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
23052024-12-02T16:47:39.809ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.6367ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
23062024-12-02T16:47:40.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e325f545-b629-4805-8ffd-ddeeb948f6fe roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23072024-12-02T16:47:40.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e325f545-b629-4805-8ffd-ddeeb948f6fe resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23082024-12-02T16:47:40.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e325f545-b629-4805-8ffd-ddeeb948f6fe response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23092024-12-02T16:47:41.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c58cff06-cceb-4226-a39c-ea08c61a94ec roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23102024-12-02T16:47:41.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c58cff06-cceb-4226-a39c-ea08c61a94ec resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23112024-12-02T16:47:41.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c58cff06-cceb-4226-a39c-ea08c61a94ec response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23122024-12-02T16:47:42.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5fbf6622-e18a-4bdb-b38b-8f74652201be roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23132024-12-02T16:47:42.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5fbf6622-e18a-4bdb-b38b-8f74652201be resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23142024-12-02T16:47:42.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5fbf6622-e18a-4bdb-b38b-8f74652201be response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23152024-12-02T16:47:43.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 51215887-0a89-495e-b6be-0d376ae2a0b2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23162024-12-02T16:47:43.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 51215887-0a89-495e-b6be-0d376ae2a0b2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23172024-12-02T16:47:43.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 51215887-0a89-495e-b6be-0d376ae2a0b2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23182024-12-02T16:47:44.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1c52aea1-19e3-431f-a8e3-ff0c99759584 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23192024-12-02T16:47:44.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1c52aea1-19e3-431f-a8e3-ff0c99759584 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23202024-12-02T16:47:44.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1862 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1c52aea1-19e3-431f-a8e3-ff0c99759584 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23212024-12-02T16:47:45.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a04caeac-a950-4fd4-9464-e190ec7a2215 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23222024-12-02T16:47:45.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a04caeac-a950-4fd4-9464-e190ec7a2215 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23232024-12-02T16:47:45.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a04caeac-a950-4fd4-9464-e190ec7a2215 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23242024-12-02T16:47:46.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 4a19880b-6921-4380-97ae-1471f40846e1 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
23252024-12-02T16:47:46.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 4a19880b-6921-4380-97ae-1471f40846e1 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
23262024-12-02T16:47:46.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 4a19880b-6921-4380-97ae-1471f40846e1 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
23272024-12-02T16:47:46.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = b510dd1b-62a3-44dc-a2db-56f89b9649d3 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
23282024-12-02T16:47:46.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = b510dd1b-62a3-44dc-a2db-56f89b9649d3 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
23292024-12-02T16:47:46.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = b510dd1b-62a3-44dc-a2db-56f89b9649d3 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
23302024-12-02T16:47:46.553ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1951 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 9b92a5ab-e4d9-468b-8b50-6636e06acd09 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
23312024-12-02T16:47:46.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8463ec1a-1caf-40df-a451-64391a41699c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23322024-12-02T16:47:46.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8463ec1a-1caf-40df-a451-64391a41699c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23332024-12-02T16:47:46.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8463ec1a-1caf-40df-a451-64391a41699c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23342024-12-02T16:47:47.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5ca63540-2589-4b13-8424-eb38b544afc6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23352024-12-02T16:47:47.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5ca63540-2589-4b13-8424-eb38b544afc6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23362024-12-02T16:47:47.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5ca63540-2589-4b13-8424-eb38b544afc6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23372024-12-02T16:47:48.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b8fcc439-79a2-4998-8aef-86d05ee3dba4 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23382024-12-02T16:47:48.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b8fcc439-79a2-4998-8aef-86d05ee3dba4 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23392024-12-02T16:47:48.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b8fcc439-79a2-4998-8aef-86d05ee3dba4 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23402024-12-02T16:47:49.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = a4a12724-e658-4503-8526-f5ac01ce5cc7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
23412024-12-02T16:47:49.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = a4a12724-e658-4503-8526-f5ac01ce5cc7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
23422024-12-02T16:47:49.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3376 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = a4a12724-e658-4503-8526-f5ac01ce5cc7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
23432024-12-02T16:47:49.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 40ce7362-644c-4307-bc63-ca5c9945b30c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23442024-12-02T16:47:49.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 40ce7362-644c-4307-bc63-ca5c9945b30c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23452024-12-02T16:47:49.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 40ce7362-644c-4307-bc63-ca5c9945b30c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
23462024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
23472024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
23482024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23492024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
23502024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
23512024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23522024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
23532024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23542024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
23552024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23562024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
23572024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23582024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
23592024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23602024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23612024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
23622024-12-02T16:47:49.788ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-02 16:37:49.788892421 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
23632024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
23642024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
23652024-12-02T16:47:49.788ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
23662024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
23672024-12-02T16:47:49.788ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
23682024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23692024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
23702024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23712024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
23722024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23732024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
23742024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23752024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
23762024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23772024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
23782024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
23792024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23802024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23812024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
23822024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
23832024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
23842024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23852024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
23862024-12-02T16:47:49.789ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c575ce6d-3e43-4b59-886a-60182869b755
23872024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
23882024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.041\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"c575ce6d-3e43-4b59-886a-60182869b755"}
23892024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23902024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23912024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23922024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23932024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23942024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23952024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
23962024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23972024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23982024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
23992024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24002024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24012024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24022024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24032024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24042024-12-02T16:47:49.789ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5510b96c-d504-40ca-83bc-e27293be3abe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 25631, tv_nsec: 530825043 } })
24052024-12-02T16:47:49.789ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a1a23f6-3701-4a53-9e08-543f9ba04e60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5030471-1797-42f6-9660-1ead64511c29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 25631, tv_nsec: 530840003 } })
24062024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
24072024-12-02T16:47:49.789ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24082024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24092024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
24102024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
24112024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24122024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
24132024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
24142024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
24152024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24162024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24172024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
24182024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24192024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
24202024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24212024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
24222024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
24232024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24242024-12-02T16:47:49.789ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
24252024-12-02T16:47:49.790ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
24262024-12-02T16:47:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24272024-12-02T16:47:49.790ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.309591ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
24282024-12-02T16:47:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
24292024-12-02T16:47:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24302024-12-02T16:47:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24312024-12-02T16:47:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24322024-12-02T16:47:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24332024-12-02T16:47:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24342024-12-02T16:47:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
24352024-12-02T16:47:49.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24362024-12-02T16:47:49.790ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
24372024-12-02T16:47:49.790ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.406982ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
24382024-12-02T16:47:49.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24392024-12-02T16:47:49.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24402024-12-02T16:47:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24412024-12-02T16:47:49.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24422024-12-02T16:47:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24432024-12-02T16:47:49.792ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24442024-12-02T16:47:49.793ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.170967ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24452024-12-02T16:47:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24462024-12-02T16:47:49.793ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24472024-12-02T16:47:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24482024-12-02T16:47:49.794ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24492024-12-02T16:47:49.794ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24502024-12-02T16:47:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24512024-12-02T16:47:49.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24522024-12-02T16:47:49.796ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-02 16:37:49.788892421 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
24532024-12-02T16:47:49.796ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.796638ms iteration = 5 status = {"expiration":"2024-12-02T16:37:49.788892421Z","pruned":[]}
24542024-12-02T16:47:49.797ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25631, tv_nsec: 538709331 } })
24552024-12-02T16:47:49.797ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24562024-12-02T16:47:49.797ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
24572024-12-02T16:47:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24582024-12-02T16:47:49.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24592024-12-02T16:47:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24602024-12-02T16:47:49.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24612024-12-02T16:47:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24622024-12-02T16:47:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
24632024-12-02T16:47:49.799ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24642024-12-02T16:47:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24652024-12-02T16:47:49.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24662024-12-02T16:47:49.801ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25631, tv_nsec: 542433774 } })
24672024-12-02T16:47:49.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24682024-12-02T16:47:49.801ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
24692024-12-02T16:47:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24702024-12-02T16:47:49.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24712024-12-02T16:47:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24722024-12-02T16:47:49.802ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.952473ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
24732024-12-02T16:47:49.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24742024-12-02T16:47:49.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24752024-12-02T16:47:49.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24762024-12-02T16:47:49.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24772024-12-02T16:47:49.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24782024-12-02T16:47:49.805ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24792024-12-02T16:47:49.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24802024-12-02T16:47:49.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24812024-12-02T16:47:49.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24822024-12-02T16:47:49.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24832024-12-02T16:47:49.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24842024-12-02T16:47:49.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24852024-12-02T16:47:49.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24862024-12-02T16:47:49.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24872024-12-02T16:47:49.811ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24882024-12-02T16:47:49.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24892024-12-02T16:47:49.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24902024-12-02T16:47:49.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24912024-12-02T16:47:49.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25631, tv_nsec: 554025885 } })
24922024-12-02T16:47:49.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24932024-12-02T16:47:49.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
24942024-12-02T16:47:49.814ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24952024-12-02T16:47:49.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24962024-12-02T16:47:49.819ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
24972024-12-02T16:47:49.819ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
24982024-12-02T16:47:49.819ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
24992024-12-02T16:47:49.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25002024-12-02T16:47:49.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25012024-12-02T16:47:49.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25022024-12-02T16:47:49.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25032024-12-02T16:47:49.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25042024-12-02T16:47:49.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25052024-12-02T16:47:49.820ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25062024-12-02T16:47:49.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25072024-12-02T16:47:49.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25082024-12-02T16:47:49.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25092024-12-02T16:47:49.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25102024-12-02T16:47:49.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25112024-12-02T16:47:49.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25122024-12-02T16:47:49.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
25132024-12-02T16:47:49.824ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25142024-12-02T16:47:49.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25152024-12-02T16:47:49.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25162024-12-02T16:47:49.824ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25172024-12-02T16:47:49.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25182024-12-02T16:47:49.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25192024-12-02T16:47:49.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25202024-12-02T16:47:49.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25212024-12-02T16:47:49.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25222024-12-02T16:47:49.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
25232024-12-02T16:47:49.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25242024-12-02T16:47:49.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25252024-12-02T16:47:49.835ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25262024-12-02T16:47:49.836ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25272024-12-02T16:47:49.836ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25282024-12-02T16:47:49.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25292024-12-02T16:47:49.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25302024-12-02T16:47:49.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25312024-12-02T16:47:49.842ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25322024-12-02T16:47:49.842ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25332024-12-02T16:47:49.842ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25342024-12-02T16:47:49.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25352024-12-02T16:47:49.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.336143ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25362024-12-02T16:47:49.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.931755ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
25372024-12-02T16:47:49.851ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
25382024-12-02T16:47:49.851ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.85899ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
25392024-12-02T16:47:49.853ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
25402024-12-02T16:47:49.853ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
25412024-12-02T16:47:49.853ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
25422024-12-02T16:47:49.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25432024-12-02T16:47:49.854ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
25442024-12-02T16:47:49.854ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
25452024-12-02T16:47:49.854ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 64.496004ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
25462024-12-02T16:47:49.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25472024-12-02T16:47:49.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.928187ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
25482024-12-02T16:47:49.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25492024-12-02T16:47:49.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25502024-12-02T16:47:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25512024-12-02T16:47:49.859ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25522024-12-02T16:47:49.859ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
25532024-12-02T16:47:49.859ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.276465ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25542024-12-02T16:47:49.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25552024-12-02T16:47:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25562024-12-02T16:47:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25572024-12-02T16:47:49.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25582024-12-02T16:47:49.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25592024-12-02T16:47:49.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25602024-12-02T16:47:49.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.050068ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25612024-12-02T16:47:49.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
25622024-12-02T16:47:49.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25632024-12-02T16:47:49.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25642024-12-02T16:47:49.866ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25652024-12-02T16:47:49.866ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 76.69367ms iteration = 9 status = 0
25662024-12-02T16:47:49.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25672024-12-02T16:47:49.870ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25682024-12-02T16:47:49.870ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.702515ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25692024-12-02T16:47:49.873ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
25702024-12-02T16:47:49.873ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
25712024-12-02T16:47:49.873ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25722024-12-02T16:47:49.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25732024-12-02T16:47:49.881ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25742024-12-02T16:47:49.881ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25752024-12-02T16:47:49.881ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.69064ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25762024-12-02T16:47:49.884ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25772024-12-02T16:47:49.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25782024-12-02T16:47:49.885ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25792024-12-02T16:47:49.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25802024-12-02T16:47:49.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.26359ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
25812024-12-02T16:47:49.887ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25822024-12-02T16:47:49.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
25832024-12-02T16:47:49.889ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25842024-12-02T16:47:49.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25852024-12-02T16:47:49.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25862024-12-02T16:47:49.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25872024-12-02T16:47:49.889ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 101.162674ms iteration = 12 status = {"physical_disks_added":0}
25882024-12-02T16:47:49.893ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
25892024-12-02T16:47:49.893ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 103.293043ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
25902024-12-02T16:47:49.902ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
25912024-12-02T16:47:49.902ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 0 version = 2
25922024-12-02T16:47:49.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25932024-12-02T16:47:49.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25942024-12-02T16:47:49.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25952024-12-02T16:47:49.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25962024-12-02T16:47:49.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25972024-12-02T16:47:49.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25982024-12-02T16:47:49.908ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 1 version = 2
25992024-12-02T16:47:49.908ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26002024-12-02T16:47:49.908ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-02 16:44:12.116348 UTC dns_group = external generation = 2
26012024-12-02T16:47:49.908ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 120.008659ms iteration = 6 status = {"generation":2}
26022024-12-02T16:47:49.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 119.544954ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26032024-12-02T16:47:49.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26042024-12-02T16:47:49.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26052024-12-02T16:47:49.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26062024-12-02T16:47:49.919ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26072024-12-02T16:47:49.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26082024-12-02T16:47:49.921ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
26092024-12-02T16:47:49.921ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26102024-12-02T16:47:49.921ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-02 16:44:11.214841 UTC dns_group = internal generation = 1
26112024-12-02T16:47:49.921ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 132.458298ms iteration = 6 status = {"generation":1}
26122024-12-02T16:47:49.927ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-02T16:43:45.642486Z, time_modified: 2024-12-02T16:43:45.642486Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }) }
26132024-12-02T16:47:49.927ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 138.359439ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]}},"default_endpoint":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26142024-12-02T16:47:49.933ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26152024-12-02T16:47:49.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26162024-12-02T16:47:49.943ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26172024-12-02T16:47:49.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26182024-12-02T16:47:49.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26192024-12-02T16:47:49.945ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26202024-12-02T16:47:49.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26212024-12-02T16:47:49.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26222024-12-02T16:47:49.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26232024-12-02T16:47:49.948ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26242024-12-02T16:47:49.948ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26252024-12-02T16:47:49.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26262024-12-02T16:47:49.982ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
26272024-12-02T16:47:49.982ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26282024-12-02T16:47:49.983ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c40d1f5c-3603-4554-8c87-8b16aaac0c6d", "content-length": "26", "date": "Mon, 02 Dec 2024 16:47:49 GMT"} })
26292024-12-02T16:47:49.983ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26302024-12-02T16:47:49.985ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
26312024-12-02T16:47:50.023ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
26322024-12-02T16:47:50.023ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26332024-12-02T16:47:50.024ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db91b472-52f6-433a-96fc-413d7b0460d9", "content-length": "26", "date": "Mon, 02 Dec 2024 16:47:49 GMT"} })
26342024-12-02T16:47:50.024ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26352024-12-02T16:47:50.026ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26362024-12-02T16:47:50.071ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26372024-12-02T16:47:50.126ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
26382024-12-02T16:47:50.126ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26392024-12-02T16:47:50.126ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c58a56c-9db2-420a-b6a1-3b86f72634af", "content-length": "26", "date": "Mon, 02 Dec 2024 16:47:49 GMT"} })
26402024-12-02T16:47:50.126ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26412024-12-02T16:47:50.127ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26422024-12-02T16:47:50.162ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26432024-12-02T16:47:50.162ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca6eb230-c362-4a10-ad77-048b6bfd6174", "content-length": "691", "date": "Mon, 02 Dec 2024 16:47:49 GMT"} })
26442024-12-02T16:47:50.162ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
26452024-12-02T16:47:50.162ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
26462024-12-02T16:47:50.162ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
26472024-12-02T16:47:50.163ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 375.024558ms iteration = 9 status = {}
26482024-12-02T16:47:50.213ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26492024-12-02T16:47:50.213ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26502024-12-02T16:47:50.213ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0dfe308a-a7ed-4494-9b8f-6357affde409", "content-length": "372", "date": "Mon, 02 Dec 2024 16:47:49 GMT"} })
26512024-12-02T16:47:50.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26522024-12-02T16:47:50.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26532024-12-02T16:47:50.220ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26542024-12-02T16:47:50.222ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2249c63e-7d4a-487b-aebe-df1119a3283b", "date": "Mon, 02 Dec 2024 16:47:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26552024-12-02T16:47:50.222ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26562024-12-02T16:47:50.223ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "fa47627b-0576-4021-b1e4-ff72aeb4a49b", "date": "Mon, 02 Dec 2024 16:47:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26572024-12-02T16:47:50.223ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26582024-12-02T16:47:50.225ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26592024-12-02T16:47:50.225ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 436.223982ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26602024-12-02T16:47:50.231ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
26612024-12-02T16:47:50.231ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26622024-12-02T16:47:50.231ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "58e0e194-2f9b-46f7-8365-a038a4545e35", "date": "Mon, 02 Dec 2024 16:47:49 GMT"} })
26632024-12-02T16:47:50.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26642024-12-02T16:47:50.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26652024-12-02T16:47:50.231ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 442.982071ms iteration = 9 status = {}
26662024-12-02T16:47:50.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26672024-12-02T16:47:50.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26682024-12-02T16:47:50.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26692024-12-02T16:47:50.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26702024-12-02T16:47:50.239ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26712024-12-02T16:47:50.239ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26722024-12-02T16:47:50.240ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "356d2dfd-798d-4f9d-8430-429defeed5b1", "date": "Mon, 02 Dec 2024 16:47:49 GMT"} })
26732024-12-02T16:47:50.241ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 452.111292ms iteration = 10 status = {}
26742024-12-02T16:47:50.246ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26752024-12-02T16:47:50.274ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26762024-12-02T16:47:50.274ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "95600daf-db12-4a8a-aa2b-ae6910ed999d", "content-length": "1", "date": "Mon, 02 Dec 2024 16:47:49 GMT"} })
26772024-12-02T16:47:50.275ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26782024-12-02T16:47:50.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26792024-12-02T16:47:50.277ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 488.162527ms iteration = 9 status = null
26802024-12-02T16:47:50.311ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26812024-12-02T16:47:50.312ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1acae8bf-274e-4ce7-bf4c-a71b221ecc93", "date": "Mon, 02 Dec 2024 16:47:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
26822024-12-02T16:47:50.312ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
26832024-12-02T16:47:50.314ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "35a88b95-628e-47f2-abb8-44591f6d5a4f", "date": "Mon, 02 Dec 2024 16:47:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
26842024-12-02T16:47:50.314ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
26852024-12-02T16:47:50.315ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "095eccf0-954f-4298-b533-4b26a88ea195", "date": "Mon, 02 Dec 2024 16:47:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
26862024-12-02T16:47:50.315ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
26872024-12-02T16:47:50.316ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
26882024-12-02T16:47:50.316ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 527.512711ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26892024-12-02T16:47:50.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26902024-12-02T16:47:50.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26912024-12-02T16:47:50.345ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
26922024-12-02T16:47:50.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26932024-12-02T16:47:50.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26942024-12-02T16:47:50.355ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26952024-12-02T16:47:50.355ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "57ccbb2e-d304-4ef5-aeb2-a94fb59659e8", "content-length": "134", "date": "Mon, 02 Dec 2024 16:47:49 GMT"} })
26962024-12-02T16:47:50.355ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26972024-12-02T16:47:50.355ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
26982024-12-02T16:47:50.355ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26992024-12-02T16:47:50.355ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27002024-12-02T16:47:50.355ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27012024-12-02T16:47:50.355ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27022024-12-02T16:47:50.355ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27032024-12-02T16:47:50.355ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27042024-12-02T16:47:50.355ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27052024-12-02T16:47:50.355ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27062024-12-02T16:47:50.356ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
27072024-12-02T16:47:50.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27082024-12-02T16:47:50.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27092024-12-02T16:47:50.358ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27102024-12-02T16:47:50.358ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c14d96c1-ed9a-4d95-b30c-205752246140", "content-length": "2", "date": "Mon, 02 Dec 2024 16:47:49 GMT"} })
27112024-12-02T16:47:50.358ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27122024-12-02T16:47:50.358ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad36dbee-6ceb-4c35-a76c-3c9a4b32feed", "content-length": "52", "date": "Mon, 02 Dec 2024 16:47:49 GMT"} })
27132024-12-02T16:47:50.358ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
27142024-12-02T16:47:50.358ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27152024-12-02T16:47:50.451ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b7fe3d66-bd5e-4ecc-8095-1150178aec92", "date": "Mon, 02 Dec 2024 16:47:49 GMT"} })
27162024-12-02T16:47:50.451ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
27172024-12-02T16:47:50.451ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27182024-12-02T16:47:50.454ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "04915da7-9a50-46f2-a5c3-ebc2626c2a34", "content-length": "682", "date": "Mon, 02 Dec 2024 16:47:49 GMT"} })
27192024-12-02T16:47:50.454ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27202024-12-02T16:47:50.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27212024-12-02T16:47:50.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27222024-12-02T16:47:50.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27232024-12-02T16:47:50.460ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27242024-12-02T16:47:50.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27252024-12-02T16:47:50.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27262024-12-02T16:47:50.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27272024-12-02T16:47:50.470ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 681.558718ms iteration = 9 status = {}
27282024-12-02T16:47:50.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 85fdb525-5870-4666-82f5-7ff50e0fad75 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27292024-12-02T16:47:50.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 85fdb525-5870-4666-82f5-7ff50e0fad75 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27302024-12-02T16:47:50.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 85fdb525-5870-4666-82f5-7ff50e0fad75 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27312024-12-02T16:47:51.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5f60d679-5470-4c4d-b2b5-49c1d8220db6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27322024-12-02T16:47:51.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5f60d679-5470-4c4d-b2b5-49c1d8220db6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27332024-12-02T16:47:51.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5f60d679-5470-4c4d-b2b5-49c1d8220db6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27342024-12-02T16:47:52.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7cc1d23-7723-420c-b16f-b1dc16454b17 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27352024-12-02T16:47:52.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7cc1d23-7723-420c-b16f-b1dc16454b17 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27362024-12-02T16:47:52.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7cc1d23-7723-420c-b16f-b1dc16454b17 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27372024-12-02T16:47:53.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 726daf8d-0807-46f5-9273-7fc53ce1972d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27382024-12-02T16:47:53.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 726daf8d-0807-46f5-9273-7fc53ce1972d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27392024-12-02T16:47:53.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 726daf8d-0807-46f5-9273-7fc53ce1972d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27402024-12-02T16:47:54.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f90a2364-1dfa-49bb-9c02-607709730796 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27412024-12-02T16:47:54.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f90a2364-1dfa-49bb-9c02-607709730796 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27422024-12-02T16:47:54.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1670 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f90a2364-1dfa-49bb-9c02-607709730796 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27432024-12-02T16:47:55.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 037d1b19-fc32-4f26-be2e-06c8bda1fd49 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27442024-12-02T16:47:55.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 037d1b19-fc32-4f26-be2e-06c8bda1fd49 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27452024-12-02T16:47:55.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1820 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 037d1b19-fc32-4f26-be2e-06c8bda1fd49 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27462024-12-02T16:47:56.552ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1299 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = a4bf08c2-fb16-4f7a-990c-801cf3a70ca3 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
27472024-12-02T16:47:56.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bb4f35bf-4ddf-4bc2-8152-58727adb3bb6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27482024-12-02T16:47:56.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bb4f35bf-4ddf-4bc2-8152-58727adb3bb6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27492024-12-02T16:47:56.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bb4f35bf-4ddf-4bc2-8152-58727adb3bb6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27502024-12-02T16:47:57.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d222d0a9-b88b-4a42-b042-5ed33253bdc3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27512024-12-02T16:47:57.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d222d0a9-b88b-4a42-b042-5ed33253bdc3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27522024-12-02T16:47:57.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d222d0a9-b88b-4a42-b042-5ed33253bdc3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27532024-12-02T16:47:58.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 285c0056-abd0-4b5a-b95e-2b6e10c4b456 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27542024-12-02T16:47:58.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 285c0056-abd0-4b5a-b95e-2b6e10c4b456 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27552024-12-02T16:47:58.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 285c0056-abd0-4b5a-b95e-2b6e10c4b456 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27562024-12-02T16:47:59.789ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
27572024-12-02T16:47:59.789ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27582024-12-02T16:47:59.789ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
27592024-12-02T16:47:59.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27602024-12-02T16:47:59.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27612024-12-02T16:47:59.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27622024-12-02T16:47:59.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27632024-12-02T16:47:59.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27642024-12-02T16:47:59.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27652024-12-02T16:47:59.794ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.689021ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27662024-12-02T16:47:59.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27672024-12-02T16:47:59.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27682024-12-02T16:47:59.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27692024-12-02T16:47:59.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27702024-12-02T16:47:59.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27712024-12-02T16:47:59.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27722024-12-02T16:47:59.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
27732024-12-02T16:47:59.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27742024-12-02T16:47:59.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27752024-12-02T16:47:59.813ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
27762024-12-02T16:47:59.813ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.04793ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
27772024-12-02T16:47:59.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c988a8ca-cede-46f3-9d7f-1c9ce483eb19 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27782024-12-02T16:47:59.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c988a8ca-cede-46f3-9d7f-1c9ce483eb19 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27792024-12-02T16:47:59.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c988a8ca-cede-46f3-9d7f-1c9ce483eb19 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27802024-12-02T16:48:00.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 79b50e91-81ea-401b-bdf5-fd401b9dbda2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27812024-12-02T16:48:00.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 79b50e91-81ea-401b-bdf5-fd401b9dbda2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27822024-12-02T16:48:00.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 79b50e91-81ea-401b-bdf5-fd401b9dbda2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27832024-12-02T16:48:01.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = aee755b5-b86e-4985-91b1-6bf51d9ffcf5 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
27842024-12-02T16:48:01.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = aee755b5-b86e-4985-91b1-6bf51d9ffcf5 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
27852024-12-02T16:48:01.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = aee755b5-b86e-4985-91b1-6bf51d9ffcf5 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
27862024-12-02T16:48:01.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = d50dff06-a8ac-44cb-906b-3a8951fb5e17 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
27872024-12-02T16:48:01.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = d50dff06-a8ac-44cb-906b-3a8951fb5e17 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
27882024-12-02T16:48:01.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = d50dff06-a8ac-44cb-906b-3a8951fb5e17 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
27892024-12-02T16:48:01.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ffdefd0a-889b-4d62-8d7d-74ea68576932 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27902024-12-02T16:48:01.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ffdefd0a-889b-4d62-8d7d-74ea68576932 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27912024-12-02T16:48:01.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ffdefd0a-889b-4d62-8d7d-74ea68576932 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27922024-12-02T16:48:02.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5d9b6ba8-bc10-4564-92ba-daf5f660a57e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27932024-12-02T16:48:02.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5d9b6ba8-bc10-4564-92ba-daf5f660a57e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27942024-12-02T16:48:02.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5d9b6ba8-bc10-4564-92ba-daf5f660a57e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27952024-12-02T16:48:03.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c522f237-5a82-4a18-8e4e-bb2de15e149a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27962024-12-02T16:48:03.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c522f237-5a82-4a18-8e4e-bb2de15e149a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27972024-12-02T16:48:03.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c522f237-5a82-4a18-8e4e-bb2de15e149a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27982024-12-02T16:48:04.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 641d0079-b807-4f95-b260-2f7a2627de5c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
27992024-12-02T16:48:04.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 641d0079-b807-4f95-b260-2f7a2627de5c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28002024-12-02T16:48:04.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 641d0079-b807-4f95-b260-2f7a2627de5c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28012024-12-02T16:48:05.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e118e76c-5719-442f-81ad-fb272c276b0d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28022024-12-02T16:48:05.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e118e76c-5719-442f-81ad-fb272c276b0d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28032024-12-02T16:48:05.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e118e76c-5719-442f-81ad-fb272c276b0d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28042024-12-02T16:48:06.552ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1426 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 019edf2f-a1c7-47c1-bdeb-b544f6f9a0dc response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
28052024-12-02T16:48:07.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4c54278d-ce8b-4ee5-92a8-75f614bbc6c9 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28062024-12-02T16:48:07.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4c54278d-ce8b-4ee5-92a8-75f614bbc6c9 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28072024-12-02T16:48:07.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4c54278d-ce8b-4ee5-92a8-75f614bbc6c9 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28082024-12-02T16:48:08.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0fb9d9f8-f253-4655-ba99-f7bde6040960 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28092024-12-02T16:48:08.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0fb9d9f8-f253-4655-ba99-f7bde6040960 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28102024-12-02T16:48:08.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0fb9d9f8-f253-4655-ba99-f7bde6040960 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28112024-12-02T16:48:09.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = de4cb951-5f49-4928-bb06-e9bcf8f6ce2c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28122024-12-02T16:48:09.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = de4cb951-5f49-4928-bb06-e9bcf8f6ce2c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28132024-12-02T16:48:09.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = de4cb951-5f49-4928-bb06-e9bcf8f6ce2c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28142024-12-02T16:48:09.789ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
28152024-12-02T16:48:09.789ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28162024-12-02T16:48:09.789ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
28172024-12-02T16:48:09.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28182024-12-02T16:48:09.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28192024-12-02T16:48:09.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28202024-12-02T16:48:09.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28212024-12-02T16:48:09.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28222024-12-02T16:48:09.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28232024-12-02T16:48:09.794ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.459959ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28242024-12-02T16:48:09.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28252024-12-02T16:48:09.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28262024-12-02T16:48:09.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28272024-12-02T16:48:09.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28282024-12-02T16:48:09.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28292024-12-02T16:48:09.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28302024-12-02T16:48:09.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
28312024-12-02T16:48:09.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28322024-12-02T16:48:09.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28332024-12-02T16:48:09.810ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
28342024-12-02T16:48:09.810ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.903032ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
28352024-12-02T16:48:10.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 09dd591c-bc31-4388-b06e-0c7e106ab705 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28362024-12-02T16:48:10.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 09dd591c-bc31-4388-b06e-0c7e106ab705 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28372024-12-02T16:48:10.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 09dd591c-bc31-4388-b06e-0c7e106ab705 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28382024-12-02T16:48:11.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ea0a1bf4-1973-47e5-9b6a-a1b1247defd5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28392024-12-02T16:48:11.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ea0a1bf4-1973-47e5-9b6a-a1b1247defd5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28402024-12-02T16:48:11.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 449182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ea0a1bf4-1973-47e5-9b6a-a1b1247defd5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28412024-12-02T16:48:12.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3c1f47a0-be7c-4bfb-b27c-a0d3893a0cae roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28422024-12-02T16:48:12.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3c1f47a0-be7c-4bfb-b27c-a0d3893a0cae resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28432024-12-02T16:48:12.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3c1f47a0-be7c-4bfb-b27c-a0d3893a0cae response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28442024-12-02T16:48:13.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 524f8df5-02c6-46fe-a4fd-52ca98eff95e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28452024-12-02T16:48:13.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 524f8df5-02c6-46fe-a4fd-52ca98eff95e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28462024-12-02T16:48:13.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 524f8df5-02c6-46fe-a4fd-52ca98eff95e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28472024-12-02T16:48:14.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 782c82ec-68d9-4a00-8bb2-07c05955d74e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28482024-12-02T16:48:14.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 782c82ec-68d9-4a00-8bb2-07c05955d74e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28492024-12-02T16:48:14.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 782c82ec-68d9-4a00-8bb2-07c05955d74e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28502024-12-02T16:48:15.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f6fde55f-4284-42fd-85a5-60dddb8ad23f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28512024-12-02T16:48:15.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f6fde55f-4284-42fd-85a5-60dddb8ad23f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28522024-12-02T16:48:15.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f6fde55f-4284-42fd-85a5-60dddb8ad23f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28532024-12-02T16:48:16.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = c69b001c-d304-4b7d-8baa-c6e325ced2c0 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
28542024-12-02T16:48:16.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = c69b001c-d304-4b7d-8baa-c6e325ced2c0 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
28552024-12-02T16:48:16.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = c69b001c-d304-4b7d-8baa-c6e325ced2c0 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
28562024-12-02T16:48:16.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 0e02f829-a13e-478d-8fd8-3dac8a94cbbd roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
28572024-12-02T16:48:16.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 0e02f829-a13e-478d-8fd8-3dac8a94cbbd resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
28582024-12-02T16:48:16.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 0e02f829-a13e-478d-8fd8-3dac8a94cbbd response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
28592024-12-02T16:48:16.552ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1284 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = cfc33223-f73a-4dc0-8dce-6ffdd204853c response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
28602024-12-02T16:48:16.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e1287ddc-2f22-42ac-9155-cd860bfd9bef roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28612024-12-02T16:48:16.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e1287ddc-2f22-42ac-9155-cd860bfd9bef resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28622024-12-02T16:48:16.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e1287ddc-2f22-42ac-9155-cd860bfd9bef response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28632024-12-02T16:48:17.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1244d2bf-7989-402b-892e-dc748bf088ce roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28642024-12-02T16:48:17.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1244d2bf-7989-402b-892e-dc748bf088ce resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28652024-12-02T16:48:17.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1244d2bf-7989-402b-892e-dc748bf088ce response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28662024-12-02T16:48:19.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7dff801b-dffd-46a5-9683-c38ca9303363 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28672024-12-02T16:48:19.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7dff801b-dffd-46a5-9683-c38ca9303363 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28682024-12-02T16:48:19.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7dff801b-dffd-46a5-9683-c38ca9303363 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
28692024-12-02T16:48:19.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 77dad26a-65eb-4fe5-97a3-b6a09f5ff193 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
28702024-12-02T16:48:19.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 77dad26a-65eb-4fe5-97a3-b6a09f5ff193 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
28712024-12-02T16:48:19.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 77dad26a-65eb-4fe5-97a3-b6a09f5ff193 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
28722024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
28732024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
28742024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28752024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28762024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28772024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
28782024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
28792024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28802024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28812024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
28822024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
28832024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28842024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
28852024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28862024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28872024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
28882024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
28892024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
28902024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28912024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
28922024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28932024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28942024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
28952024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28962024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
28972024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28982024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
28992024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29002024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
29012024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29022024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
29032024-12-02T16:48:19.790ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29042024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
29052024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29062024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29072024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29082024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29092024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29102024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29112024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29122024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29132024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29142024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29152024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29162024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29172024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29182024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29192024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29202024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29212024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29222024-12-02T16:48:19.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29232024-12-02T16:48:19.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29242024-12-02T16:48:19.793ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29252024-12-02T16:48:19.793ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29262024-12-02T16:48:19.793ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29272024-12-02T16:48:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29282024-12-02T16:48:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29292024-12-02T16:48:19.794ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.860114ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29302024-12-02T16:48:19.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29312024-12-02T16:48:19.794ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29322024-12-02T16:48:19.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29332024-12-02T16:48:19.796ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25661, tv_nsec: 537371000 } })
29342024-12-02T16:48:19.796ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29352024-12-02T16:48:19.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29362024-12-02T16:48:19.796ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
29372024-12-02T16:48:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29382024-12-02T16:48:19.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29392024-12-02T16:48:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29402024-12-02T16:48:19.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29412024-12-02T16:48:19.799ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29422024-12-02T16:48:19.799ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25661, tv_nsec: 540339496 } })
29432024-12-02T16:48:19.799ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
29442024-12-02T16:48:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29452024-12-02T16:48:19.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29462024-12-02T16:48:19.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29472024-12-02T16:48:19.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 10.588403ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
29482024-12-02T16:48:19.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29492024-12-02T16:48:19.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29502024-12-02T16:48:19.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29512024-12-02T16:48:19.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29522024-12-02T16:48:19.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29532024-12-02T16:48:19.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29542024-12-02T16:48:19.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29552024-12-02T16:48:19.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29562024-12-02T16:48:19.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29572024-12-02T16:48:19.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29582024-12-02T16:48:19.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29592024-12-02T16:48:19.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29602024-12-02T16:48:19.804ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29612024-12-02T16:48:19.804ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29622024-12-02T16:48:19.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29632024-12-02T16:48:19.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29642024-12-02T16:48:19.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29652024-12-02T16:48:19.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29662024-12-02T16:48:19.806ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29672024-12-02T16:48:19.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29682024-12-02T16:48:19.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29692024-12-02T16:48:19.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29702024-12-02T16:48:19.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29712024-12-02T16:48:19.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29722024-12-02T16:48:19.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29732024-12-02T16:48:19.809ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25661, tv_nsec: 549871339 } })
29742024-12-02T16:48:19.809ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
29752024-12-02T16:48:19.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29762024-12-02T16:48:19.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29772024-12-02T16:48:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29782024-12-02T16:48:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29792024-12-02T16:48:19.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29802024-12-02T16:48:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29812024-12-02T16:48:19.812ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29822024-12-02T16:48:19.812ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.560368ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29832024-12-02T16:48:19.821ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 31.386555ms iteration = 13 status = {"physical_disks_added":0}
29842024-12-02T16:48:19.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.490119ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
29852024-12-02T16:48:19.835ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29862024-12-02T16:48:19.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29872024-12-02T16:48:19.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29882024-12-02T16:48:19.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29892024-12-02T16:48:19.844ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29902024-12-02T16:48:19.844ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29912024-12-02T16:48:19.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29922024-12-02T16:48:19.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29932024-12-02T16:48:19.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.796408ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
29942024-12-02T16:48:19.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.564175ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29952024-12-02T16:48:19.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29962024-12-02T16:48:19.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29972024-12-02T16:48:19.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29982024-12-02T16:48:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
29992024-12-02T16:48:19.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30002024-12-02T16:48:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30012024-12-02T16:48:19.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 66.228549ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30022024-12-02T16:48:19.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 77.504107ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30032024-12-02T16:48:19.874ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30042024-12-02T16:48:19.874ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30052024-12-02T16:48:19.874ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 84.360378ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30062024-12-02T16:48:19.890ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
30072024-12-02T16:48:19.890ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30082024-12-02T16:48:19.890ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbfe82b6-b877-4b0b-a02c-8197cbcbc77b", "content-length": "26", "date": "Mon, 02 Dec 2024 16:48:19 GMT"} })
30092024-12-02T16:48:19.890ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30102024-12-02T16:48:19.892ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30112024-12-02T16:48:19.897ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
30122024-12-02T16:48:19.897ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30132024-12-02T16:48:19.898ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "37556e77-322a-434c-a748-9245fe3a2926", "content-length": "26", "date": "Mon, 02 Dec 2024 16:48:19 GMT"} })
30142024-12-02T16:48:19.898ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30152024-12-02T16:48:19.899ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30162024-12-02T16:48:19.916ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30172024-12-02T16:48:19.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30182024-12-02T16:48:19.919ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
30192024-12-02T16:48:19.919ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30202024-12-02T16:48:19.919ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1158ee0f-067a-4655-9ecf-b02b3464a8f6", "content-length": "26", "date": "Mon, 02 Dec 2024 16:48:19 GMT"} })
30212024-12-02T16:48:19.919ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30222024-12-02T16:48:19.920ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
30232024-12-02T16:48:19.922ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30242024-12-02T16:48:19.922ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30252024-12-02T16:48:19.922ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f712c5e3-c812-46fc-8c3f-95f9a3c30425", "content-length": "372", "date": "Mon, 02 Dec 2024 16:48:19 GMT"} })
30262024-12-02T16:48:19.922ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30272024-12-02T16:48:19.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30282024-12-02T16:48:19.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30292024-12-02T16:48:19.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30302024-12-02T16:48:19.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30312024-12-02T16:48:19.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30322024-12-02T16:48:19.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30332024-12-02T16:48:19.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30342024-12-02T16:48:19.936ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
30352024-12-02T16:48:19.936ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 145.949975ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
30362024-12-02T16:48:19.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30372024-12-02T16:48:19.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30382024-12-02T16:48:19.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
30392024-12-02T16:48:19.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30402024-12-02T16:48:19.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30412024-12-02T16:48:19.958ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30422024-12-02T16:48:19.958ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30432024-12-02T16:48:19.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30442024-12-02T16:48:19.959ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 168.746665ms iteration = 10 status = 0
30452024-12-02T16:48:19.963ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
30462024-12-02T16:48:19.963ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30472024-12-02T16:48:19.963ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f4b84ab6-a674-45d9-b28d-426b4827d15c", "date": "Mon, 02 Dec 2024 16:48:19 GMT"} })
30482024-12-02T16:48:19.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30492024-12-02T16:48:19.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30502024-12-02T16:48:19.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30512024-12-02T16:48:19.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30522024-12-02T16:48:19.974ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30532024-12-02T16:48:19.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30542024-12-02T16:48:19.978ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30552024-12-02T16:48:19.978ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30562024-12-02T16:48:19.978ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7f35ffa8-fbad-402b-9105-944fea336c23", "date": "Mon, 02 Dec 2024 16:48:19 GMT"} })
30572024-12-02T16:48:19.980ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30582024-12-02T16:48:19.980ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "da20a90f-fb3b-4911-9dc0-ac2a53a81297", "content-length": "1", "date": "Mon, 02 Dec 2024 16:48:19 GMT"} })
30592024-12-02T16:48:19.981ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 190.827758ms iteration = 11 status = {}
30602024-12-02T16:48:19.982ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30612024-12-02T16:48:19.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30622024-12-02T16:48:19.982ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 192.21018ms iteration = 10 status = {}
30632024-12-02T16:48:19.984ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 193.757994ms iteration = 10 status = null
30642024-12-02T16:48:20.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 083ebfea-2b8c-4d4e-b06a-5e6c8d704cac roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
30652024-12-02T16:48:20.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 083ebfea-2b8c-4d4e-b06a-5e6c8d704cac resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
30662024-12-02T16:48:20.073ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30672024-12-02T16:48:20.073ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "08210d57-459a-4a3f-97b4-19bf5be027f5", "content-length": "691", "date": "Mon, 02 Dec 2024 16:48:19 GMT"} })
30682024-12-02T16:48:20.073ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
30692024-12-02T16:48:20.073ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
30702024-12-02T16:48:20.073ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
30712024-12-02T16:48:20.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 083ebfea-2b8c-4d4e-b06a-5e6c8d704cac response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
30722024-12-02T16:48:20.075ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 285.561246ms iteration = 10 status = {}
30732024-12-02T16:48:20.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30742024-12-02T16:48:20.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30752024-12-02T16:48:20.079ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
30762024-12-02T16:48:20.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30772024-12-02T16:48:20.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30782024-12-02T16:48:20.087ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30792024-12-02T16:48:20.087ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8df2a70b-1cc1-42d6-b6da-a219931adb87", "content-length": "134", "date": "Mon, 02 Dec 2024 16:48:20 GMT"} })
30802024-12-02T16:48:20.087ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
30812024-12-02T16:48:20.087ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
30822024-12-02T16:48:20.088ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30832024-12-02T16:48:20.088ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30842024-12-02T16:48:20.088ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30852024-12-02T16:48:20.088ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30862024-12-02T16:48:20.088ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30872024-12-02T16:48:20.088ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30882024-12-02T16:48:20.088ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30892024-12-02T16:48:20.088ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30902024-12-02T16:48:20.088ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
30912024-12-02T16:48:20.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30922024-12-02T16:48:20.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30932024-12-02T16:48:20.091ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30942024-12-02T16:48:20.091ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbe03a98-f6e7-424d-9126-cf9d1884dfc4", "content-length": "2", "date": "Mon, 02 Dec 2024 16:48:20 GMT"} })
30952024-12-02T16:48:20.091ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30962024-12-02T16:48:20.091ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cf0e133-1487-4148-9eaf-2fb30218b005", "content-length": "52", "date": "Mon, 02 Dec 2024 16:48:20 GMT"} })
30972024-12-02T16:48:20.091ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
30982024-12-02T16:48:20.091ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30992024-12-02T16:48:20.189ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c016cee3-298f-4803-87fa-c4d99f3c283c", "date": "Mon, 02 Dec 2024 16:48:19 GMT"} })
31002024-12-02T16:48:20.189ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
31012024-12-02T16:48:20.189ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31022024-12-02T16:48:20.190ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ba4a130-1016-4d3e-a91d-b0a1867e38e1", "content-length": "682", "date": "Mon, 02 Dec 2024 16:48:19 GMT"} })
31032024-12-02T16:48:20.190ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31042024-12-02T16:48:20.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31052024-12-02T16:48:20.194ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31062024-12-02T16:48:20.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31072024-12-02T16:48:20.198ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31082024-12-02T16:48:20.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31092024-12-02T16:48:20.201ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31102024-12-02T16:48:20.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31112024-12-02T16:48:20.207ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 417.713291ms iteration = 10 status = {}
31122024-12-02T16:48:21.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 87f2721f-b407-4b68-b872-d0637becbe6c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31132024-12-02T16:48:21.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 87f2721f-b407-4b68-b872-d0637becbe6c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31142024-12-02T16:48:21.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 87f2721f-b407-4b68-b872-d0637becbe6c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31152024-12-02T16:48:22.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c9f5cb70-d2c0-4b9c-8f94-f60bbf93c6a0 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31162024-12-02T16:48:22.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c9f5cb70-d2c0-4b9c-8f94-f60bbf93c6a0 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31172024-12-02T16:48:22.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c9f5cb70-d2c0-4b9c-8f94-f60bbf93c6a0 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31182024-12-02T16:48:23.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cb6e1cea-0b3f-4328-b8a2-77db6357ef1f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31192024-12-02T16:48:23.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cb6e1cea-0b3f-4328-b8a2-77db6357ef1f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31202024-12-02T16:48:23.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cb6e1cea-0b3f-4328-b8a2-77db6357ef1f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31212024-12-02T16:48:24.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2efc87d1-8978-421e-864b-e8f89b30539d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31222024-12-02T16:48:24.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2efc87d1-8978-421e-864b-e8f89b30539d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31232024-12-02T16:48:24.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2efc87d1-8978-421e-864b-e8f89b30539d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31242024-12-02T16:48:25.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7ade18ba-1893-43de-9325-f1848b0adc19 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31252024-12-02T16:48:25.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7ade18ba-1893-43de-9325-f1848b0adc19 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31262024-12-02T16:48:25.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7ade18ba-1893-43de-9325-f1848b0adc19 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31272024-12-02T16:48:26.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5ff3e8bf-ae09-4480-b42a-609a4d4fe6eb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31282024-12-02T16:48:26.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5ff3e8bf-ae09-4480-b42a-609a4d4fe6eb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31292024-12-02T16:48:26.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5ff3e8bf-ae09-4480-b42a-609a4d4fe6eb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31302024-12-02T16:48:26.553ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1524 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 3934ebd2-fccd-4abe-8045-d69a968c3fbf response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
31312024-12-02T16:48:27.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c07ffc5b-aae0-4dd7-ba2e-6fed85b73220 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31322024-12-02T16:48:27.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c07ffc5b-aae0-4dd7-ba2e-6fed85b73220 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31332024-12-02T16:48:27.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c07ffc5b-aae0-4dd7-ba2e-6fed85b73220 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31342024-12-02T16:48:28.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 868d6389-7275-4c25-9f34-d3738c192049 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31352024-12-02T16:48:28.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 868d6389-7275-4c25-9f34-d3738c192049 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31362024-12-02T16:48:28.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 868d6389-7275-4c25-9f34-d3738c192049 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31372024-12-02T16:48:29.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 10c48356-a2bf-446a-a8a1-26c1141f1298 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31382024-12-02T16:48:29.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 10c48356-a2bf-446a-a8a1-26c1141f1298 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31392024-12-02T16:48:29.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 10c48356-a2bf-446a-a8a1-26c1141f1298 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31402024-12-02T16:48:29.789ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
31412024-12-02T16:48:29.789ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31422024-12-02T16:48:29.789ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
31432024-12-02T16:48:29.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31442024-12-02T16:48:29.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31452024-12-02T16:48:29.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31462024-12-02T16:48:29.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31472024-12-02T16:48:29.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31482024-12-02T16:48:29.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31492024-12-02T16:48:29.793ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.855533ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31502024-12-02T16:48:29.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31512024-12-02T16:48:29.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31522024-12-02T16:48:29.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31532024-12-02T16:48:29.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31542024-12-02T16:48:29.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31552024-12-02T16:48:29.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31562024-12-02T16:48:29.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
31572024-12-02T16:48:29.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31582024-12-02T16:48:29.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31592024-12-02T16:48:29.813ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
31602024-12-02T16:48:29.813ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.690877ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
31612024-12-02T16:48:30.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72730a44-ec87-4d52-8e9c-a7c38d4e6faf roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31622024-12-02T16:48:30.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72730a44-ec87-4d52-8e9c-a7c38d4e6faf resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31632024-12-02T16:48:30.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72730a44-ec87-4d52-8e9c-a7c38d4e6faf response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31642024-12-02T16:48:31.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fb8d8254-4447-4cca-becb-8bd8f800aa5f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31652024-12-02T16:48:31.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fb8d8254-4447-4cca-becb-8bd8f800aa5f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31662024-12-02T16:48:31.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fb8d8254-4447-4cca-becb-8bd8f800aa5f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31672024-12-02T16:48:31.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f59b5976-b8b7-4627-bac8-cad24beb5bd5 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
31682024-12-02T16:48:31.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f59b5976-b8b7-4627-bac8-cad24beb5bd5 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
31692024-12-02T16:48:31.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f59b5976-b8b7-4627-bac8-cad24beb5bd5 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
31702024-12-02T16:48:31.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f066b69e-7a9a-4d03-ae7b-12603bdf5d76 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
31712024-12-02T16:48:31.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f066b69e-7a9a-4d03-ae7b-12603bdf5d76 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
31722024-12-02T16:48:31.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f066b69e-7a9a-4d03-ae7b-12603bdf5d76 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
31732024-12-02T16:48:32.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5e33d5db-b76b-4458-b574-619223b8fb32 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31742024-12-02T16:48:32.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5e33d5db-b76b-4458-b574-619223b8fb32 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31752024-12-02T16:48:32.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5e33d5db-b76b-4458-b574-619223b8fb32 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31762024-12-02T16:48:33.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72af273f-2d9f-4256-a341-b0cf260e6256 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31772024-12-02T16:48:33.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72af273f-2d9f-4256-a341-b0cf260e6256 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31782024-12-02T16:48:33.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72af273f-2d9f-4256-a341-b0cf260e6256 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31792024-12-02T16:48:34.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4e688fd4-f7bd-446a-a6cb-8ed1b746c1e5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31802024-12-02T16:48:34.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4e688fd4-f7bd-446a-a6cb-8ed1b746c1e5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31812024-12-02T16:48:34.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4e688fd4-f7bd-446a-a6cb-8ed1b746c1e5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31822024-12-02T16:48:35.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6a0962ff-faeb-45c8-932b-f7ec32d09e40 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31832024-12-02T16:48:35.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6a0962ff-faeb-45c8-932b-f7ec32d09e40 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31842024-12-02T16:48:35.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6a0962ff-faeb-45c8-932b-f7ec32d09e40 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31852024-12-02T16:48:36.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 60ef6de5-fda9-49a1-9cda-7ccb7b3b7a14 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31862024-12-02T16:48:36.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 60ef6de5-fda9-49a1-9cda-7ccb7b3b7a14 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31872024-12-02T16:48:36.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 60ef6de5-fda9-49a1-9cda-7ccb7b3b7a14 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31882024-12-02T16:48:36.553ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1470 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 6cb85d00-0b24-43da-889c-3314abfce9b7 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
31892024-12-02T16:48:37.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7b96d527-ec5f-4aa6-93a5-1c74a840b5c8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31902024-12-02T16:48:37.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7b96d527-ec5f-4aa6-93a5-1c74a840b5c8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31912024-12-02T16:48:37.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7b96d527-ec5f-4aa6-93a5-1c74a840b5c8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31922024-12-02T16:48:38.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f5838a43-d56a-477b-a5c4-142481ef5577 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31932024-12-02T16:48:38.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f5838a43-d56a-477b-a5c4-142481ef5577 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31942024-12-02T16:48:38.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f5838a43-d56a-477b-a5c4-142481ef5577 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31952024-12-02T16:48:39.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f82ac3c7-1785-461d-80d1-8766d31ec579 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31962024-12-02T16:48:39.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f82ac3c7-1785-461d-80d1-8766d31ec579 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31972024-12-02T16:48:39.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f82ac3c7-1785-461d-80d1-8766d31ec579 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
31982024-12-02T16:48:39.789ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
31992024-12-02T16:48:39.789ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
32002024-12-02T16:48:39.789ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32012024-12-02T16:48:39.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32022024-12-02T16:48:39.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32032024-12-02T16:48:39.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32042024-12-02T16:48:39.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32052024-12-02T16:48:39.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32062024-12-02T16:48:39.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32072024-12-02T16:48:39.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.355754ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32082024-12-02T16:48:39.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32092024-12-02T16:48:39.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32102024-12-02T16:48:39.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32112024-12-02T16:48:39.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32122024-12-02T16:48:39.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32132024-12-02T16:48:39.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32142024-12-02T16:48:39.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
32152024-12-02T16:48:39.828ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32162024-12-02T16:48:39.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32172024-12-02T16:48:39.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
32182024-12-02T16:48:39.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.602332ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
32192024-12-02T16:48:40.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d46cebb4-2d48-48d1-a72b-fd891cec9834 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32202024-12-02T16:48:40.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d46cebb4-2d48-48d1-a72b-fd891cec9834 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32212024-12-02T16:48:40.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d46cebb4-2d48-48d1-a72b-fd891cec9834 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32222024-12-02T16:48:41.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c35fe227-fb88-4497-bdfe-d163c357c342 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32232024-12-02T16:48:41.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c35fe227-fb88-4497-bdfe-d163c357c342 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32242024-12-02T16:48:41.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c35fe227-fb88-4497-bdfe-d163c357c342 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32252024-12-02T16:48:42.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8f457a49-7b70-404c-ae8e-ca36d1582b2c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32262024-12-02T16:48:42.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8f457a49-7b70-404c-ae8e-ca36d1582b2c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32272024-12-02T16:48:42.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8f457a49-7b70-404c-ae8e-ca36d1582b2c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32282024-12-02T16:48:43.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9e2fb266-db64-4576-bb06-d9cae885c3af roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32292024-12-02T16:48:43.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9e2fb266-db64-4576-bb06-d9cae885c3af resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32302024-12-02T16:48:43.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1494 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9e2fb266-db64-4576-bb06-d9cae885c3af response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32312024-12-02T16:48:44.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b79dfe1b-83e1-4e36-b769-904fe117edfa roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32322024-12-02T16:48:44.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b79dfe1b-83e1-4e36-b769-904fe117edfa resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32332024-12-02T16:48:44.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b79dfe1b-83e1-4e36-b769-904fe117edfa response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32342024-12-02T16:48:45.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5549b1a5-5c4d-4557-8853-792178bc7d0a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32352024-12-02T16:48:45.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5549b1a5-5c4d-4557-8853-792178bc7d0a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32362024-12-02T16:48:45.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5549b1a5-5c4d-4557-8853-792178bc7d0a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32372024-12-02T16:48:46.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 866c83b2-475d-46c6-bcc1-ba8bc9d97319 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
32382024-12-02T16:48:46.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 866c83b2-475d-46c6-bcc1-ba8bc9d97319 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
32392024-12-02T16:48:46.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 866c83b2-475d-46c6-bcc1-ba8bc9d97319 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
32402024-12-02T16:48:46.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = cc52083f-da99-4a8b-b5fb-04f0940e3f83 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
32412024-12-02T16:48:46.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = cc52083f-da99-4a8b-b5fb-04f0940e3f83 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
32422024-12-02T16:48:46.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = cc52083f-da99-4a8b-b5fb-04f0940e3f83 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
32432024-12-02T16:48:46.552ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1320 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 2f52472a-5ba7-4179-ade7-914a60be0cb3 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
32442024-12-02T16:48:46.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ca67e4a7-78b4-49de-810a-c69b3fa8d0e7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32452024-12-02T16:48:46.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ca67e4a7-78b4-49de-810a-c69b3fa8d0e7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32462024-12-02T16:48:46.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ca67e4a7-78b4-49de-810a-c69b3fa8d0e7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32472024-12-02T16:48:47.528ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:35143
32482024-12-02T16:48:47.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35143 req_id = fb887c6b-c440-46d8-b191-0a6b0bfa7e9a roles = RoleSet { roles: {} } uri = /metrics/producers
32492024-12-02T16:48:47.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35143 req_id = fb887c6b-c440-46d8-b191-0a6b0bfa7e9a resource = Database result = Ok(()) uri = /metrics/producers
32502024-12-02T16:48:47.576ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = d6743efc-3f8c-4f9c-82eb-c8c8561c254a
32512024-12-02T16:48:47.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47907 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35143 req_id = fb887c6b-c440-46d8-b191-0a6b0bfa7e9a response_code = 201 uri = /metrics/producers
32522024-12-02T16:48:47.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f75e5a03-e9df-4c54-ae50-4ca98106ed10 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32532024-12-02T16:48:47.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f75e5a03-e9df-4c54-ae50-4ca98106ed10 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32542024-12-02T16:48:47.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f75e5a03-e9df-4c54-ae50-4ca98106ed10 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32552024-12-02T16:48:48.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ca56c311-0b5b-45a6-8dde-1e843cffc036 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32562024-12-02T16:48:48.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ca56c311-0b5b-45a6-8dde-1e843cffc036 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32572024-12-02T16:48:48.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ca56c311-0b5b-45a6-8dde-1e843cffc036 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
32582024-12-02T16:48:49.521ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:51094
32592024-12-02T16:48:49.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51094 req_id = 68033a43-2ab5-4b6b-b4a9-87c3a658296f roles = RoleSet { roles: {} } uri = /metrics/producers
32602024-12-02T16:48:49.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51094 req_id = 68033a43-2ab5-4b6b-b4a9-87c3a658296f resource = Database result = Ok(()) uri = /metrics/producers
32612024-12-02T16:48:49.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = f051cac3-2efd-4fea-a690-a126082d18bc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
32622024-12-02T16:48:49.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = f051cac3-2efd-4fea-a690-a126082d18bc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
32632024-12-02T16:48:49.572ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = 999318be-e8de-4392-9ed9-30887ef5bc8f
32642024-12-02T16:48:49.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50959 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51094 req_id = 68033a43-2ab5-4b6b-b4a9-87c3a658296f response_code = 201 uri = /metrics/producers
32652024-12-02T16:48:49.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = f051cac3-2efd-4fea-a690-a126082d18bc response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
32662024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
32672024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
32682024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32692024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
32702024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32712024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
32722024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
32732024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
32742024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32752024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32762024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
32772024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
32782024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32792024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
32802024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
32812024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32822024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32832024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
32842024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
32852024-12-02T16:48:49.790ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
32862024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32872024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
32882024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32892024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32902024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32912024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
32922024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
32932024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32942024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
32952024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32962024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
32972024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
32982024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32992024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
33002024-12-02T16:48:49.790ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-02 16:38:49.790660786 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
33012024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
33022024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
33032024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
33042024-12-02T16:48:49.790ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c575ce6d-3e43-4b59-886a-60182869b755
33052024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.53\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"c575ce6d-3e43-4b59-886a-60182869b755"}
33062024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
33072024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
33082024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33092024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
33102024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33112024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
33122024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33132024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
33142024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33152024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
33162024-12-02T16:48:49.790ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
33172024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33182024-12-02T16:48:49.790ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
33192024-12-02T16:48:49.791ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
33202024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33212024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
33222024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33232024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
33242024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33252024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
33262024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
33272024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
33282024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
33292024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33302024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
33312024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33322024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33332024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33342024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33352024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33362024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33372024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33382024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33392024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33402024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33412024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33422024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33432024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33442024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33452024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33462024-12-02T16:48:49.791ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5510b96c-d504-40ca-83bc-e27293be3abe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 25691, tv_nsec: 531399258 } })
33472024-12-02T16:48:49.791ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a1a23f6-3701-4a53-9e08-543f9ba04e60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5030471-1797-42f6-9660-1ead64511c29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 25691, tv_nsec: 531445158 } })
33482024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33492024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33502024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33512024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33522024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33532024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
33542024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33552024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
33562024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33572024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33582024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
33592024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.311571ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
33602024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
33612024-12-02T16:48:49.791ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.332531ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
33622024-12-02T16:48:49.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33632024-12-02T16:48:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33642024-12-02T16:48:49.793ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33652024-12-02T16:48:49.793ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25691, tv_nsec: 533790259 } })
33662024-12-02T16:48:49.793ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
33672024-12-02T16:48:49.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33682024-12-02T16:48:49.794ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.218217ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33692024-12-02T16:48:49.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33702024-12-02T16:48:49.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8bb4358c-549e-4858-86f8-01fc4e37e278 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
33712024-12-02T16:48:49.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8bb4358c-549e-4858-86f8-01fc4e37e278 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
33722024-12-02T16:48:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33732024-12-02T16:48:49.795ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33742024-12-02T16:48:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33752024-12-02T16:48:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33762024-12-02T16:48:49.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33772024-12-02T16:48:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33782024-12-02T16:48:49.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33792024-12-02T16:48:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33802024-12-02T16:48:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33812024-12-02T16:48:49.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33822024-12-02T16:48:49.798ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25691, tv_nsec: 538662171 } })
33832024-12-02T16:48:49.798ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
33842024-12-02T16:48:49.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33852024-12-02T16:48:49.799ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33862024-12-02T16:48:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
33872024-12-02T16:48:49.799ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33882024-12-02T16:48:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33892024-12-02T16:48:49.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33902024-12-02T16:48:49.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33912024-12-02T16:48:49.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33922024-12-02T16:48:49.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33932024-12-02T16:48:49.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
33942024-12-02T16:48:49.801ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33952024-12-02T16:48:49.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33962024-12-02T16:48:49.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33972024-12-02T16:48:49.802ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33982024-12-02T16:48:49.802ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
33992024-12-02T16:48:49.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34002024-12-02T16:48:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34012024-12-02T16:48:49.803ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-02 16:38:49.790660786 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34022024-12-02T16:48:49.803ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.166895ms iteration = 6 status = {"expiration":"2024-12-02T16:38:49.790660786Z","pruned":[]}
34032024-12-02T16:48:49.805ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34042024-12-02T16:48:49.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34052024-12-02T16:48:49.806ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.625307ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
34062024-12-02T16:48:49.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34072024-12-02T16:48:49.809ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34082024-12-02T16:48:49.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34092024-12-02T16:48:49.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34102024-12-02T16:48:49.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25691, tv_nsec: 551151811 } })
34112024-12-02T16:48:49.811ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
34122024-12-02T16:48:49.811ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34132024-12-02T16:48:49.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34142024-12-02T16:48:49.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8bb4358c-549e-4858-86f8-01fc4e37e278 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
34152024-12-02T16:48:49.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34162024-12-02T16:48:49.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34172024-12-02T16:48:49.827ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34182024-12-02T16:48:49.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34192024-12-02T16:48:49.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34202024-12-02T16:48:49.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34212024-12-02T16:48:49.829ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34222024-12-02T16:48:49.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34232024-12-02T16:48:49.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34242024-12-02T16:48:49.832ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34252024-12-02T16:48:49.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34262024-12-02T16:48:49.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
34272024-12-02T16:48:49.834ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34282024-12-02T16:48:49.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34292024-12-02T16:48:49.836ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34302024-12-02T16:48:49.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
34312024-12-02T16:48:49.839ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34322024-12-02T16:48:49.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34332024-12-02T16:48:49.841ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34342024-12-02T16:48:49.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34352024-12-02T16:48:49.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34362024-12-02T16:48:49.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.250985ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
34372024-12-02T16:48:49.845ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34382024-12-02T16:48:49.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.586018ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
34392024-12-02T16:48:49.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34402024-12-02T16:48:49.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34412024-12-02T16:48:49.848ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
34422024-12-02T16:48:49.849ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
34432024-12-02T16:48:49.849ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
34442024-12-02T16:48:49.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34452024-12-02T16:48:49.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34462024-12-02T16:48:49.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34472024-12-02T16:48:49.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34482024-12-02T16:48:49.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34492024-12-02T16:48:49.853ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
34502024-12-02T16:48:49.853ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.556997ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
34512024-12-02T16:48:49.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34522024-12-02T16:48:49.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34532024-12-02T16:48:49.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34542024-12-02T16:48:49.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34552024-12-02T16:48:49.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34562024-12-02T16:48:49.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34572024-12-02T16:48:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34582024-12-02T16:48:49.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34592024-12-02T16:48:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34602024-12-02T16:48:49.865ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34612024-12-02T16:48:49.865ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
34622024-12-02T16:48:49.865ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34632024-12-02T16:48:49.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34642024-12-02T16:48:49.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34652024-12-02T16:48:49.868ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
34662024-12-02T16:48:49.868ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
34672024-12-02T16:48:49.868ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.424837ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
34682024-12-02T16:48:49.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34692024-12-02T16:48:49.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34702024-12-02T16:48:49.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34712024-12-02T16:48:49.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34722024-12-02T16:48:49.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34732024-12-02T16:48:49.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34742024-12-02T16:48:49.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34752024-12-02T16:48:49.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34762024-12-02T16:48:49.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34772024-12-02T16:48:49.872ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
34782024-12-02T16:48:49.872ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.36236ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
34792024-12-02T16:48:49.874ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
34802024-12-02T16:48:49.874ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
34812024-12-02T16:48:49.874ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.961004ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
34822024-12-02T16:48:49.877ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
34832024-12-02T16:48:49.877ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
34842024-12-02T16:48:49.877ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
34852024-12-02T16:48:49.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34862024-12-02T16:48:49.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34872024-12-02T16:48:49.879ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34882024-12-02T16:48:49.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34892024-12-02T16:48:49.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34902024-12-02T16:48:49.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34912024-12-02T16:48:49.884ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
34922024-12-02T16:48:49.884ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
34932024-12-02T16:48:49.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34942024-12-02T16:48:49.884ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34952024-12-02T16:48:49.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
34962024-12-02T16:48:49.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34972024-12-02T16:48:49.886ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
34982024-12-02T16:48:49.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34992024-12-02T16:48:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35002024-12-02T16:48:49.888ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35012024-12-02T16:48:49.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.62167ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35022024-12-02T16:48:49.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
35032024-12-02T16:48:49.892ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35042024-12-02T16:48:49.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35052024-12-02T16:48:49.892ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35062024-12-02T16:48:49.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35072024-12-02T16:48:49.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35082024-12-02T16:48:49.893ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35092024-12-02T16:48:49.894ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35102024-12-02T16:48:49.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35112024-12-02T16:48:49.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35122024-12-02T16:48:49.898ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
35132024-12-02T16:48:49.898ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35142024-12-02T16:48:49.898ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-02 16:44:11.214841 UTC dns_group = internal generation = 1
35152024-12-02T16:48:49.898ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 107.841853ms iteration = 7 status = {"generation":1}
35162024-12-02T16:48:49.899ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35172024-12-02T16:48:49.899ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35182024-12-02T16:48:49.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35192024-12-02T16:48:49.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35202024-12-02T16:48:49.900ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 109.555287ms iteration = 14 status = {"physical_disks_added":0}
35212024-12-02T16:48:49.900ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35222024-12-02T16:48:49.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35232024-12-02T16:48:49.900ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35242024-12-02T16:48:49.901ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35252024-12-02T16:48:49.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35262024-12-02T16:48:49.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 110.950341ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
35272024-12-02T16:48:49.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.277181ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35282024-12-02T16:48:49.902ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35292024-12-02T16:48:49.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35302024-12-02T16:48:49.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35312024-12-02T16:48:49.905ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35322024-12-02T16:48:49.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
35332024-12-02T16:48:49.905ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35342024-12-02T16:48:49.906ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
35352024-12-02T16:48:49.906ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35362024-12-02T16:48:49.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35372024-12-02T16:48:49.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35382024-12-02T16:48:49.906ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
35392024-12-02T16:48:49.906ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 0 version = 2
35402024-12-02T16:48:49.906ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35412024-12-02T16:48:49.906ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
35422024-12-02T16:48:49.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35432024-12-02T16:48:49.907ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35442024-12-02T16:48:49.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35452024-12-02T16:48:49.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35462024-12-02T16:48:49.908ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 117.347946ms iteration = 11 status = 0
35472024-12-02T16:48:49.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35482024-12-02T16:48:49.908ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35492024-12-02T16:48:49.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35502024-12-02T16:48:49.909ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35512024-12-02T16:48:49.910ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35522024-12-02T16:48:49.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35532024-12-02T16:48:49.910ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35542024-12-02T16:48:49.910ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35552024-12-02T16:48:49.910ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 120.18132ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35562024-12-02T16:48:49.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35572024-12-02T16:48:49.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35582024-12-02T16:48:49.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35592024-12-02T16:48:49.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35602024-12-02T16:48:49.913ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 1 version = 2
35612024-12-02T16:48:49.913ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
35622024-12-02T16:48:49.913ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-02 16:44:12.116348 UTC dns_group = external generation = 2
35632024-12-02T16:48:49.913ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 122.559771ms iteration = 7 status = {"generation":2}
35642024-12-02T16:48:49.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35652024-12-02T16:48:49.915ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35662024-12-02T16:48:49.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35672024-12-02T16:48:49.916ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35682024-12-02T16:48:49.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35692024-12-02T16:48:49.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 142.838539ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
35702024-12-02T16:48:49.936ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
35712024-12-02T16:48:49.936ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35722024-12-02T16:48:49.937ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f6cb68d-95bf-4bea-8ad2-c418f042ae41", "content-length": "26", "date": "Mon, 02 Dec 2024 16:48:49 GMT"} })
35732024-12-02T16:48:49.937ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35742024-12-02T16:48:49.939ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35752024-12-02T16:48:49.939ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35762024-12-02T16:48:49.939ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
35772024-12-02T16:48:49.939ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35782024-12-02T16:48:49.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35792024-12-02T16:48:49.939ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "280931a0-6069-48ae-a868-4223bb0b617f", "content-length": "26", "date": "Mon, 02 Dec 2024 16:48:49 GMT"} })
35802024-12-02T16:48:49.939ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35812024-12-02T16:48:49.941ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35822024-12-02T16:48:49.951ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-02T16:43:45.642486Z, time_modified: 2024-12-02T16:43:45.642486Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }) }
35832024-12-02T16:48:49.951ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 160.966998ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]}},"default_endpoint":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
35842024-12-02T16:48:49.952ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35852024-12-02T16:48:49.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35862024-12-02T16:48:49.953ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35872024-12-02T16:48:49.957ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
35882024-12-02T16:48:49.957ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35892024-12-02T16:48:49.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35902024-12-02T16:48:49.959ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35912024-12-02T16:48:49.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35922024-12-02T16:48:49.961ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35932024-12-02T16:48:49.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35942024-12-02T16:48:49.963ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35952024-12-02T16:48:49.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
35962024-12-02T16:48:49.964ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
35972024-12-02T16:48:49.964ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 173.307415ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
35982024-12-02T16:48:49.965ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
35992024-12-02T16:48:49.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36002024-12-02T16:48:49.967ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36012024-12-02T16:48:49.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36022024-12-02T16:48:49.968ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36032024-12-02T16:48:49.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36042024-12-02T16:48:49.970ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36052024-12-02T16:48:49.973ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
36062024-12-02T16:48:49.973ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36072024-12-02T16:48:49.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36082024-12-02T16:48:49.974ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
36092024-12-02T16:48:49.975ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36102024-12-02T16:48:49.975ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36112024-12-02T16:48:49.975ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bffc0e84-ed99-454f-a7b7-42e68b954a7f", "content-length": "26", "date": "Mon, 02 Dec 2024 16:48:49 GMT"} })
36122024-12-02T16:48:49.975ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36132024-12-02T16:48:49.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36142024-12-02T16:48:49.977ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36152024-12-02T16:48:49.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36162024-12-02T16:48:49.977ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
36172024-12-02T16:48:49.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36182024-12-02T16:48:49.984ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
36192024-12-02T16:48:49.984ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36202024-12-02T16:48:49.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36212024-12-02T16:48:49.988ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36222024-12-02T16:48:49.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36232024-12-02T16:48:49.991ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36242024-12-02T16:48:49.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36252024-12-02T16:48:49.993ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36262024-12-02T16:48:49.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36272024-12-02T16:48:49.995ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36282024-12-02T16:48:49.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36292024-12-02T16:48:49.998ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36302024-12-02T16:48:49.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36312024-12-02T16:48:49.999ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36322024-12-02T16:48:49.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36332024-12-02T16:48:50.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36342024-12-02T16:48:50.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36352024-12-02T16:48:50.002ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36362024-12-02T16:48:50.006ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
36372024-12-02T16:48:50.006ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36382024-12-02T16:48:50.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36392024-12-02T16:48:50.007ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36402024-12-02T16:48:50.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36412024-12-02T16:48:50.008ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36422024-12-02T16:48:50.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36432024-12-02T16:48:50.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36442024-12-02T16:48:50.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
36452024-12-02T16:48:50.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36462024-12-02T16:48:50.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36472024-12-02T16:48:50.019ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 936229ab-d10a-4f8c-8bea-15ce4db2d97f, kind: Service { id: aecb31a5-75ac-4a9f-bc12-71eca3dc990f }, name: Name("nexus-aecb31a5-75ac-4a9f-bc12-71eca3dc990f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 195])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3b2c589-11d0-4eac-9249-aaa6e4692507, kind: Service { id: e3a2206d-5fc8-4c68-ac44-4ca4fdf3d85b }, name: Name("nexus-e3a2206d-5fc8-4c68-ac44-4ca4fdf3d85b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc168541-f9e5-40eb-82bf-71648886c506, kind: Service { id: 09079b37-9a62-4b04-a7f7-99297d26aab2 }, name: Name("nexus-09079b37-9a62-4b04-a7f7-99297d26aab2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0c599830-7ce4-4624-ac95-0291168a133e, kind: Service { id: efa28bff-324d-4515-8bf9-4ea313797b64 }, name: Name("external-dns-efa28bff-324d-4515-8bf9-4ea313797b64"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 74523f0d-3c18-436d-892f-81007dc1ad64, kind: Service { id: 5510b96c-d504-40ca-83bc-e27293be3abe }, name: Name("external-dns-5510b96c-d504-40ca-83bc-e27293be3abe"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 108])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
36482024-12-02T16:48:50.019ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36492024-12-02T16:48:50.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36502024-12-02T16:48:50.021ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36512024-12-02T16:48:50.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
36522024-12-02T16:48:50.022ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36532024-12-02T16:48:50.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36542024-12-02T16:48:50.024ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
36552024-12-02T16:48:50.024ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0c599830-7ce4-4624-ac95-0291168a133e, kind: Service { id: efa28bff-324d-4515-8bf9-4ea313797b64 }, name: Name("external-dns-efa28bff-324d-4515-8bf9-4ea313797b64"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 74523f0d-3c18-436d-892f-81007dc1ad64, kind: Service { id: 5510b96c-d504-40ca-83bc-e27293be3abe }, name: Name("external-dns-5510b96c-d504-40ca-83bc-e27293be3abe"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 108])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 936229ab-d10a-4f8c-8bea-15ce4db2d97f, kind: Service { id: aecb31a5-75ac-4a9f-bc12-71eca3dc990f }, name: Name("nexus-aecb31a5-75ac-4a9f-bc12-71eca3dc990f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 195])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3b2c589-11d0-4eac-9249-aaa6e4692507, kind: Service { id: e3a2206d-5fc8-4c68-ac44-4ca4fdf3d85b }, name: Name("nexus-e3a2206d-5fc8-4c68-ac44-4ca4fdf3d85b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc168541-f9e5-40eb-82bf-71648886c506, kind: Service { id: 09079b37-9a62-4b04-a7f7-99297d26aab2 }, name: Name("nexus-09079b37-9a62-4b04-a7f7-99297d26aab2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
36562024-12-02T16:48:50.024ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
36572024-12-02T16:48:50.030ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36582024-12-02T16:48:50.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36592024-12-02T16:48:50.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36602024-12-02T16:48:50.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36612024-12-02T16:48:50.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36622024-12-02T16:48:50.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36632024-12-02T16:48:50.034ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36642024-12-02T16:48:50.036ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36652024-12-02T16:48:50.036ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36662024-12-02T16:48:50.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36672024-12-02T16:48:50.074ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, time_created: 2024-12-02T16:44:07.899032Z, time_modified: 2024-12-02T16:44:07.899032Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
36682024-12-02T16:48:50.074ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
36692024-12-02T16:48:50.074ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36702024-12-02T16:48:50.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36712024-12-02T16:48:50.075ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
36722024-12-02T16:48:50.076ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
36732024-12-02T16:48:50.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
36742024-12-02T16:48:50.077ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36752024-12-02T16:48:50.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
36762024-12-02T16:48:50.091ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
36772024-12-02T16:48:50.091ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "78f92232-89d1-4e20-a094-bfa218a087f4", "date": "Mon, 02 Dec 2024 16:48:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36782024-12-02T16:48:50.091ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36792024-12-02T16:48:50.093ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "fa850f18-9991-4331-a4d7-0b2f8b098610", "date": "Mon, 02 Dec 2024 16:48:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36802024-12-02T16:48:50.093ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36812024-12-02T16:48:50.095ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36822024-12-02T16:48:50.095ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 304.869364ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
36832024-12-02T16:48:50.098ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 307.683869ms iteration = 11 status = {}
36842024-12-02T16:48:50.100ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36852024-12-02T16:48:50.100ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36862024-12-02T16:48:50.100ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3d4626f-16e3-46e2-82ce-5b5af67df5dc", "content-length": "372", "date": "Mon, 02 Dec 2024 16:48:50 GMT"} })
36872024-12-02T16:48:50.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36882024-12-02T16:48:50.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36892024-12-02T16:48:50.120ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
36902024-12-02T16:48:50.120ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36912024-12-02T16:48:50.120ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2c8d0924-6ec9-4144-af9f-97801be39ea0", "date": "Mon, 02 Dec 2024 16:48:50 GMT"} })
36922024-12-02T16:48:50.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36932024-12-02T16:48:50.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36942024-12-02T16:48:50.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36952024-12-02T16:48:50.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36962024-12-02T16:48:50.129ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36972024-12-02T16:48:50.130ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d6a613c-4da9-4436-9af8-a318882f5774", "content-length": "1", "date": "Mon, 02 Dec 2024 16:48:49 GMT"} })
36982024-12-02T16:48:50.131ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36992024-12-02T16:48:50.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37002024-12-02T16:48:50.197ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
37012024-12-02T16:48:50.198ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "fa0ff593-83bb-4277-9408-bf7ccc0c7b84", "date": "Mon, 02 Dec 2024 16:48:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37022024-12-02T16:48:50.198ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37032024-12-02T16:48:50.199ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "fa5041e4-0ddf-4e46-804c-b7bc083587de", "date": "Mon, 02 Dec 2024 16:48:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37042024-12-02T16:48:50.199ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37052024-12-02T16:48:50.201ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "60d8d716-8b4d-4ab8-bc35-bbdb9950bb3d", "date": "Mon, 02 Dec 2024 16:48:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37062024-12-02T16:48:50.201ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37072024-12-02T16:48:50.203ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
37082024-12-02T16:48:50.203ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 413.17351ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
37092024-12-02T16:48:50.284ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
37102024-12-02T16:48:50.285ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "0216d357-1597-404a-b4e8-314186a95058", "date": "Mon, 02 Dec 2024 16:48:50 GMT"} })
37112024-12-02T16:48:50.287ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
37122024-12-02T16:48:50.287ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 496.56262ms
37132024-12-02T16:48:50.287ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 496.57195ms iteration = 2 status = {}
37142024-12-02T16:48:50.295ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37152024-12-02T16:48:50.295ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3af7933-8d89-40b7-b3de-c9e6aa03d43a", "content-length": "691", "date": "Mon, 02 Dec 2024 16:48:50 GMT"} })
37162024-12-02T16:48:50.296ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37172024-12-02T16:48:50.296ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37182024-12-02T16:48:50.296ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37192024-12-02T16:48:50.297ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 507.300524ms iteration = 11 status = {}
37202024-12-02T16:48:50.298ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 508.01373ms iteration = 11 status = null
37212024-12-02T16:48:50.298ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37222024-12-02T16:48:50.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37232024-12-02T16:48:50.301ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37242024-12-02T16:48:50.301ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37252024-12-02T16:48:50.302ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b8d457b1-7b1f-4937-8bb1-9f3ca5d53089", "date": "Mon, 02 Dec 2024 16:48:50 GMT"} })
37262024-12-02T16:48:50.302ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37272024-12-02T16:48:50.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37282024-12-02T16:48:50.303ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 512.60404ms iteration = 12 status = {}
37292024-12-02T16:48:50.304ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
37302024-12-02T16:48:50.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37312024-12-02T16:48:50.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37322024-12-02T16:48:50.314ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37332024-12-02T16:48:50.314ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3944553e-484e-45ad-b4cd-70f1168c4975", "content-length": "134", "date": "Mon, 02 Dec 2024 16:48:50 GMT"} })
37342024-12-02T16:48:50.314ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37352024-12-02T16:48:50.314ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
37362024-12-02T16:48:50.314ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37372024-12-02T16:48:50.314ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37382024-12-02T16:48:50.314ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37392024-12-02T16:48:50.314ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37402024-12-02T16:48:50.314ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37412024-12-02T16:48:50.314ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37422024-12-02T16:48:50.314ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37432024-12-02T16:48:50.314ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37442024-12-02T16:48:50.315ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
37452024-12-02T16:48:50.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37462024-12-02T16:48:50.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37472024-12-02T16:48:50.316ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37482024-12-02T16:48:50.316ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e40add7-2418-41a8-86ca-b23a0808b3ed", "content-length": "2", "date": "Mon, 02 Dec 2024 16:48:50 GMT"} })
37492024-12-02T16:48:50.316ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37502024-12-02T16:48:50.317ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2445a5c4-a1f5-4b1b-b816-28687f3b7b6f", "content-length": "52", "date": "Mon, 02 Dec 2024 16:48:50 GMT"} })
37512024-12-02T16:48:50.317ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
37522024-12-02T16:48:50.317ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37532024-12-02T16:48:50.410ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8235b51e-feb0-4b62-be79-f9426fdc4341", "date": "Mon, 02 Dec 2024 16:48:50 GMT"} })
37542024-12-02T16:48:50.410ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
37552024-12-02T16:48:50.410ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37562024-12-02T16:48:50.410ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dafe03f8-2ead-4db0-b017-ed93903d5f1b", "content-length": "682", "date": "Mon, 02 Dec 2024 16:48:50 GMT"} })
37572024-12-02T16:48:50.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37582024-12-02T16:48:50.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37592024-12-02T16:48:50.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37602024-12-02T16:48:50.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37612024-12-02T16:48:50.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37622024-12-02T16:48:50.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37632024-12-02T16:48:50.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37642024-12-02T16:48:50.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37652024-12-02T16:48:50.426ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 636.393753ms iteration = 11 status = {}
37662024-12-02T16:48:50.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1307dd45-413e-4d25-8fc9-8023004034eb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37672024-12-02T16:48:50.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1307dd45-413e-4d25-8fc9-8023004034eb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37682024-12-02T16:48:50.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1307dd45-413e-4d25-8fc9-8023004034eb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37692024-12-02T16:48:51.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d56fb101-edc6-426f-a145-2aba8a22f291 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37702024-12-02T16:48:51.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d56fb101-edc6-426f-a145-2aba8a22f291 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37712024-12-02T16:48:51.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d56fb101-edc6-426f-a145-2aba8a22f291 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37722024-12-02T16:48:52.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 23e2253b-1177-497d-98bb-ebcbaeaa31c8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37732024-12-02T16:48:52.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 23e2253b-1177-497d-98bb-ebcbaeaa31c8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37742024-12-02T16:48:52.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 23e2253b-1177-497d-98bb-ebcbaeaa31c8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37752024-12-02T16:48:53.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c85e6ba2-daab-4ed0-a2a5-fe4ce21f6bab roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37762024-12-02T16:48:53.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c85e6ba2-daab-4ed0-a2a5-fe4ce21f6bab resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37772024-12-02T16:48:53.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c85e6ba2-daab-4ed0-a2a5-fe4ce21f6bab response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37782024-12-02T16:48:54.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 66b6be85-2a48-4229-a380-192ae8fb7fd0 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37792024-12-02T16:48:54.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 66b6be85-2a48-4229-a380-192ae8fb7fd0 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37802024-12-02T16:48:54.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 66b6be85-2a48-4229-a380-192ae8fb7fd0 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37812024-12-02T16:48:55.278ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:54213
37822024-12-02T16:48:55.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54213 req_id = 92e3707f-e34e-41c2-a240-fd91cfe0f8d6 roles = RoleSet { roles: {} } uri = /metrics/producers
37832024-12-02T16:48:55.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54213 req_id = 92e3707f-e34e-41c2-a240-fd91cfe0f8d6 resource = Database result = Ok(()) uri = /metrics/producers
37842024-12-02T16:48:55.329ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = c94a6654-1297-4865-84af-bb83693635c3
37852024-12-02T16:48:55.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50723 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54213 req_id = 92e3707f-e34e-41c2-a240-fd91cfe0f8d6 response_code = 201 uri = /metrics/producers
37862024-12-02T16:48:55.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bf9b7dd5-13b4-4f02-9b34-9827bb69973d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37872024-12-02T16:48:55.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bf9b7dd5-13b4-4f02-9b34-9827bb69973d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37882024-12-02T16:48:55.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bf9b7dd5-13b4-4f02-9b34-9827bb69973d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37892024-12-02T16:48:56.553ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1460 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 3afa4093-9c39-44eb-b51c-63614f6264e5 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
37902024-12-02T16:48:56.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6d41bd38-99eb-4f2f-b592-9fd5e94f8671 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37912024-12-02T16:48:56.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6d41bd38-99eb-4f2f-b592-9fd5e94f8671 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37922024-12-02T16:48:56.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6d41bd38-99eb-4f2f-b592-9fd5e94f8671 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37932024-12-02T16:48:57.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 03080ec9-ed31-4ded-a919-21ce4d3e563c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37942024-12-02T16:48:58.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 03080ec9-ed31-4ded-a919-21ce4d3e563c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37952024-12-02T16:48:58.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2644 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 03080ec9-ed31-4ded-a919-21ce4d3e563c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37962024-12-02T16:48:59.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = feb267d8-a943-435f-8e70-789d166c600d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37972024-12-02T16:48:59.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = feb267d8-a943-435f-8e70-789d166c600d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37982024-12-02T16:48:59.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = feb267d8-a943-435f-8e70-789d166c600d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
37992024-12-02T16:48:59.790ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
38002024-12-02T16:48:59.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38012024-12-02T16:48:59.790ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
38022024-12-02T16:48:59.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38032024-12-02T16:48:59.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38042024-12-02T16:48:59.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38052024-12-02T16:48:59.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38062024-12-02T16:48:59.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38072024-12-02T16:48:59.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38082024-12-02T16:48:59.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38092024-12-02T16:48:59.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38102024-12-02T16:48:59.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38112024-12-02T16:48:59.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38122024-12-02T16:48:59.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
38132024-12-02T16:48:59.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38142024-12-02T16:48:59.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38152024-12-02T16:48:59.812ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
38162024-12-02T16:48:59.812ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.463057ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
38172024-12-02T16:48:59.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38182024-12-02T16:48:59.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38192024-12-02T16:48:59.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.633907ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38202024-12-02T16:49:00.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 81b9fa80-6fc2-4df4-b247-ed0e9be28667 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38212024-12-02T16:49:00.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 81b9fa80-6fc2-4df4-b247-ed0e9be28667 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38222024-12-02T16:49:00.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1871 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 81b9fa80-6fc2-4df4-b247-ed0e9be28667 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38232024-12-02T16:49:01.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3a5fb2ae-c535-4f56-a08e-3c29cbe85d72 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38242024-12-02T16:49:01.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3a5fb2ae-c535-4f56-a08e-3c29cbe85d72 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38252024-12-02T16:49:01.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2684 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3a5fb2ae-c535-4f56-a08e-3c29cbe85d72 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38262024-12-02T16:49:01.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 41096311-4fd4-4f5e-9fac-0248d5380cd4 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
38272024-12-02T16:49:01.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 41096311-4fd4-4f5e-9fac-0248d5380cd4 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
38282024-12-02T16:49:01.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 41096311-4fd4-4f5e-9fac-0248d5380cd4 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
38292024-12-02T16:49:01.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = b4b2fe2b-6d32-4fc7-917e-fc2cb358bcef roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
38302024-12-02T16:49:01.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = b4b2fe2b-6d32-4fc7-917e-fc2cb358bcef resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
38312024-12-02T16:49:01.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = b4b2fe2b-6d32-4fc7-917e-fc2cb358bcef response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
38322024-12-02T16:49:02.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72223e2a-b349-41aa-a932-ffdb7e16b741 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38332024-12-02T16:49:02.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72223e2a-b349-41aa-a932-ffdb7e16b741 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38342024-12-02T16:49:02.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72223e2a-b349-41aa-a932-ffdb7e16b741 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38352024-12-02T16:49:02.790ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:45803
38362024-12-02T16:49:02.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45803 req_id = 4b322c18-83ae-4464-8596-a3b7d7455149 roles = RoleSet { roles: {} } uri = /metrics/producers
38372024-12-02T16:49:02.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45803 req_id = 4b322c18-83ae-4464-8596-a3b7d7455149 resource = Database result = Ok(()) uri = /metrics/producers
38382024-12-02T16:49:02.803ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38392024-12-02T16:49:02.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13433 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45803 req_id = 4b322c18-83ae-4464-8596-a3b7d7455149 response_code = 201 uri = /metrics/producers
38402024-12-02T16:49:02.945ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:60828
38412024-12-02T16:49:02.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60828 req_id = 0034e713-2f53-4bab-8027-7f5c9586a3e7 roles = RoleSet { roles: {} } uri = /metrics/producers
38422024-12-02T16:49:02.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60828 req_id = 0034e713-2f53-4bab-8027-7f5c9586a3e7 resource = Database result = Ok(()) uri = /metrics/producers
38432024-12-02T16:49:02.993ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = f1994180-91a5-4667-ac8f-de00c9b09458
38442024-12-02T16:49:02.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48067 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60828 req_id = 0034e713-2f53-4bab-8027-7f5c9586a3e7 response_code = 201 uri = /metrics/producers
38452024-12-02T16:49:03.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0276c7c9-9c8b-4cad-b318-da3ea7937b86 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38462024-12-02T16:49:03.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0276c7c9-9c8b-4cad-b318-da3ea7937b86 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38472024-12-02T16:49:03.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0276c7c9-9c8b-4cad-b318-da3ea7937b86 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38482024-12-02T16:49:04.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 22c82335-582d-428a-a522-c1ebfd883adb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38492024-12-02T16:49:04.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 22c82335-582d-428a-a522-c1ebfd883adb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38502024-12-02T16:49:04.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 22c82335-582d-428a-a522-c1ebfd883adb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38512024-12-02T16:49:05.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8bb21f39-39cb-4926-8288-99ca990b7634 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38522024-12-02T16:49:05.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8bb21f39-39cb-4926-8288-99ca990b7634 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38532024-12-02T16:49:05.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8bb21f39-39cb-4926-8288-99ca990b7634 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38542024-12-02T16:49:06.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d647ffa3-4ded-4900-9741-654a4e089305 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38552024-12-02T16:49:06.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d647ffa3-4ded-4900-9741-654a4e089305 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38562024-12-02T16:49:06.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d647ffa3-4ded-4900-9741-654a4e089305 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38572024-12-02T16:49:06.407ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35359
38582024-12-02T16:49:06.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35359 req_id = 1eeffbf2-f6b7-453a-9417-a67d45f04d8b roles = RoleSet { roles: {} } uri = /metrics/producers
38592024-12-02T16:49:06.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35359 req_id = 1eeffbf2-f6b7-453a-9417-a67d45f04d8b resource = Database result = Ok(()) uri = /metrics/producers
38602024-12-02T16:49:06.425ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = bcacf9eb-c8be-49ce-bc71-4d5ced99f0ed
38612024-12-02T16:49:06.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 18882 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35359 req_id = 1eeffbf2-f6b7-453a-9417-a67d45f04d8b response_code = 201 uri = /metrics/producers
38622024-12-02T16:49:06.553ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1364 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = c73fa148-b3d0-49b8-8326-43b9282cc0cc response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
38632024-12-02T16:49:07.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 55a45993-cdc9-43fd-ab90-4848e05445cf roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38642024-12-02T16:49:07.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 55a45993-cdc9-43fd-ab90-4848e05445cf resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38652024-12-02T16:49:07.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 55a45993-cdc9-43fd-ab90-4848e05445cf response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38662024-12-02T16:49:08.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 28990cf1-1658-49a8-935e-850d7be65f22 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38672024-12-02T16:49:08.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 28990cf1-1658-49a8-935e-850d7be65f22 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38682024-12-02T16:49:08.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 28990cf1-1658-49a8-935e-850d7be65f22 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38692024-12-02T16:49:09.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 282caa35-ff62-4c4a-8ae9-dc53ffa175c8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38702024-12-02T16:49:09.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 282caa35-ff62-4c4a-8ae9-dc53ffa175c8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38712024-12-02T16:49:09.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 282caa35-ff62-4c4a-8ae9-dc53ffa175c8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38722024-12-02T16:49:09.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
38732024-12-02T16:49:09.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38742024-12-02T16:49:09.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
38752024-12-02T16:49:09.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38762024-12-02T16:49:09.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38772024-12-02T16:49:09.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38782024-12-02T16:49:09.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38792024-12-02T16:49:09.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38802024-12-02T16:49:09.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38812024-12-02T16:49:09.794ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.33973ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38822024-12-02T16:49:09.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38832024-12-02T16:49:09.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38842024-12-02T16:49:09.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38852024-12-02T16:49:09.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38862024-12-02T16:49:09.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38872024-12-02T16:49:09.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38882024-12-02T16:49:09.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
38892024-12-02T16:49:09.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38902024-12-02T16:49:09.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38912024-12-02T16:49:09.809ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
38922024-12-02T16:49:09.809ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.556912ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
38932024-12-02T16:49:10.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ba5ee59-c5dd-4fca-b9ae-9c466836df43 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38942024-12-02T16:49:10.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ba5ee59-c5dd-4fca-b9ae-9c466836df43 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38952024-12-02T16:49:10.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ba5ee59-c5dd-4fca-b9ae-9c466836df43 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38962024-12-02T16:49:11.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c54eb087-b204-4ad1-ac6b-5a78583c60ce roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38972024-12-02T16:49:11.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c54eb087-b204-4ad1-ac6b-5a78583c60ce resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38982024-12-02T16:49:11.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c54eb087-b204-4ad1-ac6b-5a78583c60ce response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
38992024-12-02T16:49:12.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6f7f657a-b2ea-4927-a34d-84061f72a620 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39002024-12-02T16:49:12.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6f7f657a-b2ea-4927-a34d-84061f72a620 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39012024-12-02T16:49:12.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6f7f657a-b2ea-4927-a34d-84061f72a620 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39022024-12-02T16:49:13.032ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
39032024-12-02T16:49:13.032ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
39042024-12-02T16:49:13.063ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
39052024-12-02T16:49:13.063ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:53413
39062024-12-02T16:49:13.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:53413 req_id = 2106b110-eb25-4205-9183-c6ed8f6a793a roles = RoleSet { roles: {} } uri = /metrics/producers
39072024-12-02T16:49:13.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:53413 req_id = 2106b110-eb25-4205-9183-c6ed8f6a793a resource = Database result = Ok(()) uri = /metrics/producers
39082024-12-02T16:49:13.082ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
39092024-12-02T16:49:13.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19297 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:53413 req_id = 2106b110-eb25-4205-9183-c6ed8f6a793a response_code = 201 uri = /metrics/producers
39102024-12-02T16:49:13.083ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2106b110-eb25-4205-9183-c6ed8f6a793a", "content-length": "41", "date": "Mon, 02 Dec 2024 16:49:13 GMT"} })
39112024-12-02T16:49:13.085ZDEBGnexus (producer-registration-task): registered with nexus successfully
39122024-12-02T16:49:13.085ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
39132024-12-02T16:49:13.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7786a7d4-44be-481b-93ba-ee381f34ba7b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39142024-12-02T16:49:13.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7786a7d4-44be-481b-93ba-ee381f34ba7b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39152024-12-02T16:49:13.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7786a7d4-44be-481b-93ba-ee381f34ba7b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39162024-12-02T16:49:14.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9fd58e07-2d2c-4f24-bb4e-4bfdd89987e8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39172024-12-02T16:49:14.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9fd58e07-2d2c-4f24-bb4e-4bfdd89987e8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39182024-12-02T16:49:14.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9fd58e07-2d2c-4f24-bb4e-4bfdd89987e8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39192024-12-02T16:49:15.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a61b5b36-e19b-4dae-bdf7-668b302404cc roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39202024-12-02T16:49:15.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a61b5b36-e19b-4dae-bdf7-668b302404cc resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39212024-12-02T16:49:15.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a61b5b36-e19b-4dae-bdf7-668b302404cc response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39222024-12-02T16:49:16.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b49896cc-0a89-4e0e-9d18-046b76fcc917 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39232024-12-02T16:49:16.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b49896cc-0a89-4e0e-9d18-046b76fcc917 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39242024-12-02T16:49:16.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b49896cc-0a89-4e0e-9d18-046b76fcc917 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39252024-12-02T16:49:16.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = c10509c2-9203-46b7-b61a-ab48c5475fa0 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
39262024-12-02T16:49:16.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = c10509c2-9203-46b7-b61a-ab48c5475fa0 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
39272024-12-02T16:49:16.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = c10509c2-9203-46b7-b61a-ab48c5475fa0 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
39282024-12-02T16:49:16.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 94e2d1a5-b6e9-4a15-8ead-38ec0d53b9d0 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
39292024-12-02T16:49:16.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 94e2d1a5-b6e9-4a15-8ead-38ec0d53b9d0 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
39302024-12-02T16:49:16.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 94e2d1a5-b6e9-4a15-8ead-38ec0d53b9d0 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
39312024-12-02T16:49:16.554ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1714 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 9ffd353c-a2d7-4522-9f04-683ef69673ef response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
39322024-12-02T16:49:17.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5dc52b80-af63-4e9d-a3cc-cbe1097a4df8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39332024-12-02T16:49:17.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5dc52b80-af63-4e9d-a3cc-cbe1097a4df8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39342024-12-02T16:49:17.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5dc52b80-af63-4e9d-a3cc-cbe1097a4df8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39352024-12-02T16:49:18.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 56cc07ce-fba4-4264-ba4a-0afde199df89 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39362024-12-02T16:49:18.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 56cc07ce-fba4-4264-ba4a-0afde199df89 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39372024-12-02T16:49:18.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 56cc07ce-fba4-4264-ba4a-0afde199df89 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39382024-12-02T16:49:19.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 69b7768f-8ab2-461d-a307-a29116c8790e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39392024-12-02T16:49:19.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 69b7768f-8ab2-461d-a307-a29116c8790e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39402024-12-02T16:49:19.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2651 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 69b7768f-8ab2-461d-a307-a29116c8790e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
39412024-12-02T16:49:19.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 0daea942-f05b-4f21-ac3e-b780c0e4650c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
39422024-12-02T16:49:19.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 0daea942-f05b-4f21-ac3e-b780c0e4650c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
39432024-12-02T16:49:19.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 0daea942-f05b-4f21-ac3e-b780c0e4650c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
39442024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
39452024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
39462024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39472024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39482024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39492024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
39502024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
39512024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39522024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
39532024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39542024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
39552024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
39562024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39572024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
39582024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39592024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
39602024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39612024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39622024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
39632024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39642024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
39652024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39662024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
39672024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39682024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
39692024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39702024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
39712024-12-02T16:49:19.791ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39722024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39732024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
39742024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39752024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
39762024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39772024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
39782024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39792024-12-02T16:49:19.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39802024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39812024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39822024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39832024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39842024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39852024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39862024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39872024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39882024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39892024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39902024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39912024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39922024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39932024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39942024-12-02T16:49:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39952024-12-02T16:49:19.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39962024-12-02T16:49:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39972024-12-02T16:49:19.795ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.547622ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39982024-12-02T16:49:19.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39992024-12-02T16:49:19.795ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40002024-12-02T16:49:19.796ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25721, tv_nsec: 535560924 } })
40012024-12-02T16:49:19.796ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
40022024-12-02T16:49:19.797ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25721, tv_nsec: 536752104 } })
40032024-12-02T16:49:19.797ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
40042024-12-02T16:49:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40052024-12-02T16:49:19.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40062024-12-02T16:49:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40072024-12-02T16:49:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40082024-12-02T16:49:19.798ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40092024-12-02T16:49:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40102024-12-02T16:49:19.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40112024-12-02T16:49:19.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40122024-12-02T16:49:19.800ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40132024-12-02T16:49:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40142024-12-02T16:49:19.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40152024-12-02T16:49:19.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40162024-12-02T16:49:19.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40172024-12-02T16:49:19.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40182024-12-02T16:49:19.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40192024-12-02T16:49:19.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40202024-12-02T16:49:19.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40212024-12-02T16:49:19.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40222024-12-02T16:49:19.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.885651ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40232024-12-02T16:49:19.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40242024-12-02T16:49:19.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40252024-12-02T16:49:19.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40262024-12-02T16:49:19.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40272024-12-02T16:49:19.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40282024-12-02T16:49:19.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40292024-12-02T16:49:19.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40302024-12-02T16:49:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40312024-12-02T16:49:19.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40322024-12-02T16:49:19.814ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40332024-12-02T16:49:19.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40342024-12-02T16:49:19.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40352024-12-02T16:49:19.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40362024-12-02T16:49:19.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40372024-12-02T16:49:19.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40382024-12-02T16:49:19.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40392024-12-02T16:49:19.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40402024-12-02T16:49:19.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40412024-12-02T16:49:19.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40422024-12-02T16:49:19.818ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25721, tv_nsec: 557514996 } })
40432024-12-02T16:49:19.818ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
40442024-12-02T16:49:19.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40452024-12-02T16:49:19.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40462024-12-02T16:49:19.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40472024-12-02T16:49:19.834ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40482024-12-02T16:49:19.834ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40492024-12-02T16:49:19.834ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40502024-12-02T16:49:19.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40512024-12-02T16:49:19.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40522024-12-02T16:49:19.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40532024-12-02T16:49:19.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.689008ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
40542024-12-02T16:49:19.840ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.445444ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40552024-12-02T16:49:19.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40562024-12-02T16:49:19.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40572024-12-02T16:49:19.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40582024-12-02T16:49:19.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40592024-12-02T16:49:19.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.759203ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
40602024-12-02T16:49:19.843ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 52.257807ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40612024-12-02T16:49:19.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40622024-12-02T16:49:19.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40632024-12-02T16:49:19.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40642024-12-02T16:49:19.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40652024-12-02T16:49:19.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40662024-12-02T16:49:19.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40672024-12-02T16:49:19.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
40682024-12-02T16:49:19.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40692024-12-02T16:49:19.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40702024-12-02T16:49:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
40712024-12-02T16:49:19.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40722024-12-02T16:49:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40732024-12-02T16:49:19.854ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.92825ms iteration = 12 status = 0
40742024-12-02T16:49:19.854ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40752024-12-02T16:49:19.854ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.105401ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40762024-12-02T16:49:19.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 63.268353ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40772024-12-02T16:49:19.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40782024-12-02T16:49:19.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40792024-12-02T16:49:19.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40802024-12-02T16:49:19.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40812024-12-02T16:49:19.864ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40822024-12-02T16:49:19.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40832024-12-02T16:49:19.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40842024-12-02T16:49:19.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40852024-12-02T16:49:19.868ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40862024-12-02T16:49:19.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40872024-12-02T16:49:19.869ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
40882024-12-02T16:49:19.869ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.238674ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
40892024-12-02T16:49:19.870ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40902024-12-02T16:49:19.870ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40912024-12-02T16:49:19.870ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40922024-12-02T16:49:19.870ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40932024-12-02T16:49:19.870ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40942024-12-02T16:49:19.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40952024-12-02T16:49:19.871ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5a30ba1-7036-4a35-8805-bd1c33ea04d2", "content-length": "26", "date": "Mon, 02 Dec 2024 16:49:19 GMT"} })
40962024-12-02T16:49:19.871ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40972024-12-02T16:49:19.872ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40982024-12-02T16:49:19.874ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40992024-12-02T16:49:19.874ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41002024-12-02T16:49:19.874ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c00f20b9-7ef6-4dce-a245-a142793eb623", "content-length": "26", "date": "Mon, 02 Dec 2024 16:49:19 GMT"} })
41012024-12-02T16:49:19.874ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41022024-12-02T16:49:19.876ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41032024-12-02T16:49:19.896ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
41042024-12-02T16:49:19.896ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41052024-12-02T16:49:19.897ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bed16824-ff4c-445c-a444-2c06fbb57e19", "content-length": "26", "date": "Mon, 02 Dec 2024 16:49:19 GMT"} })
41062024-12-02T16:49:19.897ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41072024-12-02T16:49:19.898ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
41082024-12-02T16:49:19.901ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41092024-12-02T16:49:19.901ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41102024-12-02T16:49:19.901ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.674099ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41112024-12-02T16:49:19.926ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 134.671117ms iteration = 15 status = {"physical_disks_added":0}
41122024-12-02T16:49:19.965ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41132024-12-02T16:49:19.966ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e987bbd-9a73-4f2b-a6e5-27905f25b0a4", "content-length": "1", "date": "Mon, 02 Dec 2024 16:49:19 GMT"} })
41142024-12-02T16:49:19.967ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41152024-12-02T16:49:19.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41162024-12-02T16:49:19.970ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 178.542971ms iteration = 12 status = null
41172024-12-02T16:49:19.978ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 187.242297ms iteration = 12 status = {}
41182024-12-02T16:49:19.983ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41192024-12-02T16:49:19.983ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41202024-12-02T16:49:19.983ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea196eb9-91f3-4f1d-937c-d79aa487cd98", "content-length": "372", "date": "Mon, 02 Dec 2024 16:49:19 GMT"} })
41212024-12-02T16:49:19.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41222024-12-02T16:49:19.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41232024-12-02T16:49:19.996ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
41242024-12-02T16:49:19.996ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41252024-12-02T16:49:19.996ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "edb757c7-7678-4c51-b9ce-e517c37255d1", "date": "Mon, 02 Dec 2024 16:49:19 GMT"} })
41262024-12-02T16:49:19.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41272024-12-02T16:49:19.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41282024-12-02T16:49:19.997ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41292024-12-02T16:49:19.998ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ece7dfa5-e6b1-4e3d-913c-d276d21a1a8d", "content-length": "691", "date": "Mon, 02 Dec 2024 16:49:19 GMT"} })
41302024-12-02T16:49:19.998ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
41312024-12-02T16:49:19.998ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
41322024-12-02T16:49:19.998ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
41332024-12-02T16:49:19.999ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41342024-12-02T16:49:19.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41352024-12-02T16:49:19.999ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 208.308081ms iteration = 12 status = {}
41362024-12-02T16:49:20.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41372024-12-02T16:49:20.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41382024-12-02T16:49:20.006ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41392024-12-02T16:49:20.006ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41402024-12-02T16:49:20.006ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ae9532a8-0c28-4cc9-97e0-b0f56941565f", "date": "Mon, 02 Dec 2024 16:49:19 GMT"} })
41412024-12-02T16:49:20.008ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 216.676645ms iteration = 13 status = {}
41422024-12-02T16:49:20.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41432024-12-02T16:49:20.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41442024-12-02T16:49:20.053ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
41452024-12-02T16:49:20.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41462024-12-02T16:49:20.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41472024-12-02T16:49:20.062ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41482024-12-02T16:49:20.062ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "81adacc9-ef15-4300-a856-f1435d9bef99", "content-length": "134", "date": "Mon, 02 Dec 2024 16:49:19 GMT"} })
41492024-12-02T16:49:20.063ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41502024-12-02T16:49:20.063ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
41512024-12-02T16:49:20.063ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41522024-12-02T16:49:20.063ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41532024-12-02T16:49:20.063ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41542024-12-02T16:49:20.063ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41552024-12-02T16:49:20.063ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41562024-12-02T16:49:20.063ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41572024-12-02T16:49:20.063ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41582024-12-02T16:49:20.063ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41592024-12-02T16:49:20.063ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
41602024-12-02T16:49:20.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41612024-12-02T16:49:20.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41622024-12-02T16:49:20.066ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41632024-12-02T16:49:20.066ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4420fe4e-8922-41af-b2dc-c71c01097ddc", "content-length": "2", "date": "Mon, 02 Dec 2024 16:49:19 GMT"} })
41642024-12-02T16:49:20.066ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41652024-12-02T16:49:20.066ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "eccab9bd-1dd4-4adc-b432-73a248935c76", "content-length": "52", "date": "Mon, 02 Dec 2024 16:49:19 GMT"} })
41662024-12-02T16:49:20.066ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
41672024-12-02T16:49:20.066ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41682024-12-02T16:49:20.162ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a25c69a3-5978-450f-98c2-ea8bf0b94df9", "date": "Mon, 02 Dec 2024 16:49:19 GMT"} })
41692024-12-02T16:49:20.162ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
41702024-12-02T16:49:20.162ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41712024-12-02T16:49:20.162ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe39dced-d63e-4e53-a183-867d0bf6a90d", "content-length": "682", "date": "Mon, 02 Dec 2024 16:49:19 GMT"} })
41722024-12-02T16:49:20.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41732024-12-02T16:49:20.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41742024-12-02T16:49:20.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41752024-12-02T16:49:20.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41762024-12-02T16:49:20.170ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41772024-12-02T16:49:20.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41782024-12-02T16:49:20.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41792024-12-02T16:49:20.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41802024-12-02T16:49:20.179ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 387.87745ms iteration = 12 status = {}
41812024-12-02T16:49:20.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 66f2e3dc-62cb-407b-b531-ed61635515c1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41822024-12-02T16:49:20.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 66f2e3dc-62cb-407b-b531-ed61635515c1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41832024-12-02T16:49:20.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 66f2e3dc-62cb-407b-b531-ed61635515c1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41842024-12-02T16:49:21.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 34311e89-7015-45fd-a812-5b8e25cb4bd6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41852024-12-02T16:49:21.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 34311e89-7015-45fd-a812-5b8e25cb4bd6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41862024-12-02T16:49:21.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 34311e89-7015-45fd-a812-5b8e25cb4bd6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41872024-12-02T16:49:22.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7cbf010-bcda-4475-9ee6-c4ac16a3f6ff roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41882024-12-02T16:49:22.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7cbf010-bcda-4475-9ee6-c4ac16a3f6ff resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41892024-12-02T16:49:22.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7cbf010-bcda-4475-9ee6-c4ac16a3f6ff response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41902024-12-02T16:49:23.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 19dc6a34-87b3-4377-80ca-81d893373c02 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41912024-12-02T16:49:23.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 19dc6a34-87b3-4377-80ca-81d893373c02 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41922024-12-02T16:49:23.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 19dc6a34-87b3-4377-80ca-81d893373c02 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41932024-12-02T16:49:24.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8188a897-1147-40c5-8ec4-b1f1ee9e68af roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41942024-12-02T16:49:24.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8188a897-1147-40c5-8ec4-b1f1ee9e68af resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41952024-12-02T16:49:24.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2691 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8188a897-1147-40c5-8ec4-b1f1ee9e68af response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41962024-12-02T16:49:25.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 89d42e3a-8588-4010-a555-b6b486acb494 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41972024-12-02T16:49:25.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 89d42e3a-8588-4010-a555-b6b486acb494 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41982024-12-02T16:49:25.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 89d42e3a-8588-4010-a555-b6b486acb494 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
41992024-12-02T16:49:26.554ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1426 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 8e7bea16-5cd1-478d-abbc-f980d5d30f79 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
42002024-12-02T16:49:26.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7288c1d9-528b-489c-9b71-805991868883 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42012024-12-02T16:49:26.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7288c1d9-528b-489c-9b71-805991868883 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42022024-12-02T16:49:26.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7288c1d9-528b-489c-9b71-805991868883 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42032024-12-02T16:49:27.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a8766453-d5f7-4424-9fdd-b3f44bba2584 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42042024-12-02T16:49:27.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a8766453-d5f7-4424-9fdd-b3f44bba2584 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42052024-12-02T16:49:27.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a8766453-d5f7-4424-9fdd-b3f44bba2584 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42062024-12-02T16:49:28.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7470cd2a-92e5-473c-b0ef-9295c229e1f1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42072024-12-02T16:49:28.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7470cd2a-92e5-473c-b0ef-9295c229e1f1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42082024-12-02T16:49:28.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7470cd2a-92e5-473c-b0ef-9295c229e1f1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42092024-12-02T16:49:29.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ca5521cb-3937-44fc-a76b-bcf73e2dcbcc roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42102024-12-02T16:49:29.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ca5521cb-3937-44fc-a76b-bcf73e2dcbcc resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42112024-12-02T16:49:29.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ca5521cb-3937-44fc-a76b-bcf73e2dcbcc response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42122024-12-02T16:49:29.790ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
42132024-12-02T16:49:29.790ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
42142024-12-02T16:49:29.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42152024-12-02T16:49:29.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42162024-12-02T16:49:29.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42172024-12-02T16:49:29.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42182024-12-02T16:49:29.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42192024-12-02T16:49:29.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42202024-12-02T16:49:29.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42212024-12-02T16:49:29.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42222024-12-02T16:49:29.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42232024-12-02T16:49:29.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42242024-12-02T16:49:29.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42252024-12-02T16:49:29.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
42262024-12-02T16:49:29.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42272024-12-02T16:49:29.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42282024-12-02T16:49:29.813ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
42292024-12-02T16:49:29.813ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.424936ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
42302024-12-02T16:49:29.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42312024-12-02T16:49:29.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42322024-12-02T16:49:29.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.504203ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42332024-12-02T16:49:30.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6e49a883-05b4-4bc1-aac0-f013a21d7cfb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42342024-12-02T16:49:30.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6e49a883-05b4-4bc1-aac0-f013a21d7cfb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42352024-12-02T16:49:30.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1796 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6e49a883-05b4-4bc1-aac0-f013a21d7cfb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42362024-12-02T16:49:31.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b125c69a-b4d0-4b95-af9f-0b3f9218f40e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42372024-12-02T16:49:31.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b125c69a-b4d0-4b95-af9f-0b3f9218f40e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42382024-12-02T16:49:31.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b125c69a-b4d0-4b95-af9f-0b3f9218f40e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42392024-12-02T16:49:32.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cdcf5e10-692b-43e1-bba0-56fcb373d0a7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42402024-12-02T16:49:32.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cdcf5e10-692b-43e1-bba0-56fcb373d0a7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42412024-12-02T16:49:32.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cdcf5e10-692b-43e1-bba0-56fcb373d0a7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42422024-12-02T16:49:33.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = efe9676d-8e0d-4c32-ad1a-1f9d84235669 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42432024-12-02T16:49:33.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = efe9676d-8e0d-4c32-ad1a-1f9d84235669 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42442024-12-02T16:49:33.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = efe9676d-8e0d-4c32-ad1a-1f9d84235669 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42452024-12-02T16:49:34.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 88c60c6c-36a0-4d7b-b8c8-f74486a84691 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42462024-12-02T16:49:34.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 88c60c6c-36a0-4d7b-b8c8-f74486a84691 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42472024-12-02T16:49:34.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1767 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 88c60c6c-36a0-4d7b-b8c8-f74486a84691 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42482024-12-02T16:49:35.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7c55ea4-ef4a-462e-9d3b-26c717d1a862 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42492024-12-02T16:49:35.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7c55ea4-ef4a-462e-9d3b-26c717d1a862 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42502024-12-02T16:49:35.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7c55ea4-ef4a-462e-9d3b-26c717d1a862 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42512024-12-02T16:49:36.554ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1283 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 47597944-0ee7-498c-b52c-44b09896f1c9 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
42522024-12-02T16:49:36.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 03f54cc4-914e-4152-9068-4921c89a0980 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42532024-12-02T16:49:36.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 03f54cc4-914e-4152-9068-4921c89a0980 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42542024-12-02T16:49:36.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 03f54cc4-914e-4152-9068-4921c89a0980 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42552024-12-02T16:49:37.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 46989ff9-77b7-47e8-bf77-de697df707aa roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42562024-12-02T16:49:37.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 46989ff9-77b7-47e8-bf77-de697df707aa resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42572024-12-02T16:49:37.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 46989ff9-77b7-47e8-bf77-de697df707aa response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42582024-12-02T16:49:38.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9495d6eb-5050-4cfb-b175-4863518f85bd roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42592024-12-02T16:49:38.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9495d6eb-5050-4cfb-b175-4863518f85bd resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42602024-12-02T16:49:38.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9495d6eb-5050-4cfb-b175-4863518f85bd response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42612024-12-02T16:49:39.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
42622024-12-02T16:49:39.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42632024-12-02T16:49:39.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
42642024-12-02T16:49:39.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42652024-12-02T16:49:39.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42662024-12-02T16:49:39.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42672024-12-02T16:49:39.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42682024-12-02T16:49:39.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42692024-12-02T16:49:39.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42702024-12-02T16:49:39.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42712024-12-02T16:49:39.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42722024-12-02T16:49:39.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.004704ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42732024-12-02T16:49:39.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42742024-12-02T16:49:39.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42752024-12-02T16:49:39.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42762024-12-02T16:49:39.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42772024-12-02T16:49:39.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
42782024-12-02T16:49:39.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42792024-12-02T16:49:39.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42802024-12-02T16:49:39.813ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
42812024-12-02T16:49:39.813ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.432546ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
42822024-12-02T16:49:39.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ab116583-fb3b-421d-b34c-3a35dd78c3d6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42832024-12-02T16:49:39.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ab116583-fb3b-421d-b34c-3a35dd78c3d6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42842024-12-02T16:49:39.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ab116583-fb3b-421d-b34c-3a35dd78c3d6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42852024-12-02T16:49:40.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = eeb24ada-ff0a-4844-a5fb-a5486f595680 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42862024-12-02T16:49:40.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = eeb24ada-ff0a-4844-a5fb-a5486f595680 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42872024-12-02T16:49:40.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = eeb24ada-ff0a-4844-a5fb-a5486f595680 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42882024-12-02T16:49:41.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e2ce2d12-0917-47a5-a63c-8dfe27a0c51a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42892024-12-02T16:49:41.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e2ce2d12-0917-47a5-a63c-8dfe27a0c51a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42902024-12-02T16:49:41.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e2ce2d12-0917-47a5-a63c-8dfe27a0c51a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42912024-12-02T16:49:42.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = db28e69e-7c4b-456c-8352-7a4eb073de8d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42922024-12-02T16:49:42.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = db28e69e-7c4b-456c-8352-7a4eb073de8d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42932024-12-02T16:49:42.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = db28e69e-7c4b-456c-8352-7a4eb073de8d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42942024-12-02T16:49:43.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 743ba75d-2cf5-44d8-b219-f8593ad80d43 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42952024-12-02T16:49:44.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 743ba75d-2cf5-44d8-b219-f8593ad80d43 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42962024-12-02T16:49:44.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2750 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 743ba75d-2cf5-44d8-b219-f8593ad80d43 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42972024-12-02T16:49:45.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1226cdeb-be89-4a96-b891-98a35717fea1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42982024-12-02T16:49:45.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1226cdeb-be89-4a96-b891-98a35717fea1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
42992024-12-02T16:49:45.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1226cdeb-be89-4a96-b891-98a35717fea1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
43002024-12-02T16:49:46.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3e307617-81bc-46a5-85cb-304d74b158f0 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
43012024-12-02T16:49:46.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3e307617-81bc-46a5-85cb-304d74b158f0 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
43022024-12-02T16:49:46.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2813 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3e307617-81bc-46a5-85cb-304d74b158f0 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
43032024-12-02T16:49:46.554ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1419 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 1580b9e9-6e38-4435-b193-a3d25bdc4cf0 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
43042024-12-02T16:49:47.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 84cfad83-48e6-4484-bc87-7695912517a6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
43052024-12-02T16:49:47.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 84cfad83-48e6-4484-bc87-7695912517a6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
43062024-12-02T16:49:47.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 84cfad83-48e6-4484-bc87-7695912517a6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
43072024-12-02T16:49:48.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e783512e-7274-4e75-861a-037de0669c2a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
43082024-12-02T16:49:48.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e783512e-7274-4e75-861a-037de0669c2a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
43092024-12-02T16:49:48.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e783512e-7274-4e75-861a-037de0669c2a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
43102024-12-02T16:49:49.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fb197dac-4ea9-4a61-b8aa-329af4ab87e6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
43112024-12-02T16:49:49.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fb197dac-4ea9-4a61-b8aa-329af4ab87e6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
43122024-12-02T16:49:49.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fb197dac-4ea9-4a61-b8aa-329af4ab87e6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
43132024-12-02T16:49:49.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 404b3b70-92d8-42cb-bcf5-60a5393d163f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
43142024-12-02T16:49:49.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 404b3b70-92d8-42cb-bcf5-60a5393d163f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
43152024-12-02T16:49:49.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 404b3b70-92d8-42cb-bcf5-60a5393d163f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
43162024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
43172024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
43182024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
43192024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43202024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
43212024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43222024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
43232024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43242024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
43252024-12-02T16:49:49.791ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c575ce6d-3e43-4b59-886a-60182869b755
43262024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.04\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"c575ce6d-3e43-4b59-886a-60182869b755"}
43272024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
43282024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
43292024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
43302024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43312024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43322024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
43332024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
43342024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
43352024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
43362024-12-02T16:49:49.791ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
43372024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43382024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
43392024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43402024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43412024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43422024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
43432024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
43442024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43452024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43462024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
43472024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43482024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
43492024-12-02T16:49:49.791ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-02 16:39:49.791332812 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
43502024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
43512024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
43522024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
43532024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43542024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
43552024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43562024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
43572024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
43582024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43592024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
43602024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43612024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43622024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43632024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43642024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43652024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43662024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43672024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43682024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43692024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43702024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43712024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43722024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43732024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43742024-12-02T16:49:49.791ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5510b96c-d504-40ca-83bc-e27293be3abe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 25751, tv_nsec: 530781212 } })
43752024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43762024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43772024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43782024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43792024-12-02T16:49:49.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43802024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43812024-12-02T16:49:49.792ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a1a23f6-3701-4a53-9e08-543f9ba04e60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5030471-1797-42f6-9660-1ead64511c29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 25751, tv_nsec: 530941404 } })
43822024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
43832024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
43842024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
43852024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
43862024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
43872024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
43882024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43892024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43902024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43912024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
43922024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
43932024-12-02T16:49:49.792ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43942024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
43952024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43962024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43972024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
43982024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
43992024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
44002024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44012024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44022024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44032024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
44042024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.17688ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
44052024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44062024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44072024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44082024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
44092024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44102024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44112024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
44122024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.084119ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
44132024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44142024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44152024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44162024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
44172024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44182024-12-02T16:49:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44192024-12-02T16:49:49.794ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.350049ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44202024-12-02T16:49:49.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44212024-12-02T16:49:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44222024-12-02T16:49:49.795ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25751, tv_nsec: 534459094 } })
44232024-12-02T16:49:49.795ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25751, tv_nsec: 534714147 } })
44242024-12-02T16:49:49.795ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
44252024-12-02T16:49:49.796ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
44262024-12-02T16:49:49.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44272024-12-02T16:49:49.797ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44282024-12-02T16:49:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44292024-12-02T16:49:49.798ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44302024-12-02T16:49:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44312024-12-02T16:49:49.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44322024-12-02T16:49:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44332024-12-02T16:49:49.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
44342024-12-02T16:49:49.800ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44352024-12-02T16:49:49.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44362024-12-02T16:49:49.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44372024-12-02T16:49:49.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44382024-12-02T16:49:49.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44392024-12-02T16:49:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44402024-12-02T16:49:49.803ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44412024-12-02T16:49:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44422024-12-02T16:49:49.803ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44432024-12-02T16:49:49.803ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44442024-12-02T16:49:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44452024-12-02T16:49:49.804ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-02 16:39:49.791332812 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
44462024-12-02T16:49:49.804ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.725971ms iteration = 7 status = {"expiration":"2024-12-02T16:39:49.791332812Z","pruned":[]}
44472024-12-02T16:49:49.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44482024-12-02T16:49:49.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44492024-12-02T16:49:49.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44502024-12-02T16:49:49.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44512024-12-02T16:49:49.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.782319ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
44522024-12-02T16:49:49.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44532024-12-02T16:49:49.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44542024-12-02T16:49:49.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44552024-12-02T16:49:49.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44562024-12-02T16:49:49.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.299884ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
44572024-12-02T16:49:49.807ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.789259ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
44582024-12-02T16:49:49.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44592024-12-02T16:49:49.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44602024-12-02T16:49:49.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44612024-12-02T16:49:49.811ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44622024-12-02T16:49:49.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44632024-12-02T16:49:49.813ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44642024-12-02T16:49:49.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44652024-12-02T16:49:49.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44662024-12-02T16:49:49.814ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44672024-12-02T16:49:49.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44682024-12-02T16:49:49.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44692024-12-02T16:49:49.818ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44702024-12-02T16:49:49.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44712024-12-02T16:49:49.819ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44722024-12-02T16:49:49.819ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44732024-12-02T16:49:49.819ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44742024-12-02T16:49:49.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44752024-12-02T16:49:49.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44762024-12-02T16:49:49.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44772024-12-02T16:49:49.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44782024-12-02T16:49:49.822ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44792024-12-02T16:49:49.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44802024-12-02T16:49:49.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44812024-12-02T16:49:49.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44822024-12-02T16:49:49.823ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25751, tv_nsec: 562778712 } })
44832024-12-02T16:49:49.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44842024-12-02T16:49:49.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44852024-12-02T16:49:49.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44862024-12-02T16:49:49.824ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
44872024-12-02T16:49:49.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44882024-12-02T16:49:49.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44892024-12-02T16:49:49.826ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44902024-12-02T16:49:49.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44912024-12-02T16:49:49.828ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44922024-12-02T16:49:49.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44932024-12-02T16:49:49.829ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44942024-12-02T16:49:49.829ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44952024-12-02T16:49:49.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44962024-12-02T16:49:49.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44972024-12-02T16:49:49.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44982024-12-02T16:49:49.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
44992024-12-02T16:49:49.830ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45002024-12-02T16:49:49.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45012024-12-02T16:49:49.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45022024-12-02T16:49:49.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45032024-12-02T16:49:49.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45042024-12-02T16:49:49.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45052024-12-02T16:49:49.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
45062024-12-02T16:49:49.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45072024-12-02T16:49:49.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45082024-12-02T16:49:49.840ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45092024-12-02T16:49:49.840ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45102024-12-02T16:49:49.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45112024-12-02T16:49:49.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45122024-12-02T16:49:49.843ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45132024-12-02T16:49:49.843ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 52.344088ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45142024-12-02T16:49:49.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45152024-12-02T16:49:49.845ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45162024-12-02T16:49:49.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45172024-12-02T16:49:49.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45182024-12-02T16:49:49.847ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
45192024-12-02T16:49:49.847ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
45202024-12-02T16:49:49.847ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 55.726987ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
45212024-12-02T16:49:49.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45222024-12-02T16:49:49.853ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45232024-12-02T16:49:49.854ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45242024-12-02T16:49:49.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45252024-12-02T16:49:49.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45262024-12-02T16:49:49.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45272024-12-02T16:49:49.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45282024-12-02T16:49:49.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45292024-12-02T16:49:49.855ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45302024-12-02T16:49:49.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45312024-12-02T16:49:49.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45322024-12-02T16:49:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45332024-12-02T16:49:49.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45342024-12-02T16:49:49.856ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45352024-12-02T16:49:49.858ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
45362024-12-02T16:49:49.858ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
45372024-12-02T16:49:49.858ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 67.067716ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
45382024-12-02T16:49:49.858ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
45392024-12-02T16:49:49.858ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.348029ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
45402024-12-02T16:49:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
45412024-12-02T16:49:49.859ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
45422024-12-02T16:49:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
45432024-12-02T16:49:49.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45442024-12-02T16:49:49.860ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45452024-12-02T16:49:49.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45462024-12-02T16:49:49.862ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 70.88694ms iteration = 4 status = {"nsuccess":5}
45472024-12-02T16:49:49.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45482024-12-02T16:49:49.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 70.501096ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
45492024-12-02T16:49:49.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45502024-12-02T16:49:49.865ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45512024-12-02T16:49:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45522024-12-02T16:49:49.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45532024-12-02T16:49:49.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
45542024-12-02T16:49:49.869ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45552024-12-02T16:49:49.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45562024-12-02T16:49:49.874ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 82.182759ms iteration = 13 status = 0
45572024-12-02T16:49:49.877ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45582024-12-02T16:49:49.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45592024-12-02T16:49:49.880ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45602024-12-02T16:49:49.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45612024-12-02T16:49:49.882ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 91.405139ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45622024-12-02T16:49:49.882ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
45632024-12-02T16:49:49.882ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
45642024-12-02T16:49:49.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45652024-12-02T16:49:49.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45662024-12-02T16:49:49.883ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45672024-12-02T16:49:49.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45682024-12-02T16:49:49.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45692024-12-02T16:49:49.885ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45702024-12-02T16:49:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45712024-12-02T16:49:49.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45722024-12-02T16:49:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45732024-12-02T16:49:49.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
45742024-12-02T16:49:49.887ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45752024-12-02T16:49:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45762024-12-02T16:49:49.890ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 98.693982ms iteration = 16 status = {"physical_disks_added":0}
45772024-12-02T16:49:49.891ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
45782024-12-02T16:49:49.891ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
45792024-12-02T16:49:49.891ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-02 16:44:11.214841 UTC dns_group = internal generation = 1
45802024-12-02T16:49:49.891ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 100.548919ms iteration = 8 status = {"generation":1}
45812024-12-02T16:49:49.894ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
45822024-12-02T16:49:49.895ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45832024-12-02T16:49:49.895ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45842024-12-02T16:49:49.895ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.022749ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
45852024-12-02T16:49:49.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
45862024-12-02T16:49:49.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 104.487304ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45872024-12-02T16:49:49.896ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45882024-12-02T16:49:49.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45892024-12-02T16:49:49.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 106.312009ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
45902024-12-02T16:49:49.904ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
45912024-12-02T16:49:49.904ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
45922024-12-02T16:49:49.904ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
45932024-12-02T16:49:49.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45942024-12-02T16:49:49.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45952024-12-02T16:49:49.905ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45962024-12-02T16:49:49.908ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45972024-12-02T16:49:49.908ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45982024-12-02T16:49:49.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45992024-12-02T16:49:49.924ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-02T16:43:45.642486Z, time_modified: 2024-12-02T16:43:45.642486Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }) }
46002024-12-02T16:49:49.924ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 133.042133ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]}},"default_endpoint":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
46012024-12-02T16:49:49.926ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46022024-12-02T16:49:49.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46032024-12-02T16:49:49.928ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
46042024-12-02T16:49:49.938ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
46052024-12-02T16:49:49.938ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 0 version = 2
46062024-12-02T16:49:49.938ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46072024-12-02T16:49:49.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46082024-12-02T16:49:49.939ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46092024-12-02T16:49:49.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46102024-12-02T16:49:49.942ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46112024-12-02T16:49:49.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46122024-12-02T16:49:49.943ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 1 version = 2
46132024-12-02T16:49:49.943ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
46142024-12-02T16:49:49.943ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-02 16:44:12.116348 UTC dns_group = external generation = 2
46152024-12-02T16:49:49.943ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 152.790826ms iteration = 8 status = {"generation":2}
46162024-12-02T16:49:49.948ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
46172024-12-02T16:49:49.948ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46182024-12-02T16:49:49.948ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "46240ba5-1a98-4359-a7ec-91167845bcaa", "content-length": "26", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} })
46192024-12-02T16:49:49.948ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46202024-12-02T16:49:49.950ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46212024-12-02T16:49:49.973ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
46222024-12-02T16:49:49.973ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46232024-12-02T16:49:49.974ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e38d4c07-59cd-48ef-9830-73426d4fed17", "content-length": "26", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} })
46242024-12-02T16:49:49.974ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46252024-12-02T16:49:49.975ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
46262024-12-02T16:49:49.996ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
46272024-12-02T16:49:49.996ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 204.580719ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
46282024-12-02T16:49:50.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46292024-12-02T16:49:50.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46302024-12-02T16:49:50.039ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
46312024-12-02T16:49:50.068ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46322024-12-02T16:49:50.068ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46332024-12-02T16:49:50.069ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6de2065-9788-4b6c-8e38-0405971c6f3f", "content-length": "372", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} })
46342024-12-02T16:49:50.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46352024-12-02T16:49:50.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46362024-12-02T16:49:50.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46372024-12-02T16:49:50.070ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
46382024-12-02T16:49:50.070ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46392024-12-02T16:49:50.071ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "19d4056a-fc8a-4533-84e5-debd49f32d47", "content-length": "26", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} })
46402024-12-02T16:49:50.071ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46412024-12-02T16:49:50.072ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46422024-12-02T16:49:50.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46432024-12-02T16:49:50.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46442024-12-02T16:49:50.072ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46452024-12-02T16:49:50.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46462024-12-02T16:49:50.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46472024-12-02T16:49:50.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46482024-12-02T16:49:50.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46492024-12-02T16:49:50.083ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
46502024-12-02T16:49:50.083ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46512024-12-02T16:49:50.083ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6d8b895d-d416-4ae0-ad9e-8b22f5741cd5", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} })
46522024-12-02T16:49:50.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46532024-12-02T16:49:50.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46542024-12-02T16:49:50.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46552024-12-02T16:49:50.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46562024-12-02T16:49:50.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46572024-12-02T16:49:50.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46582024-12-02T16:49:50.092ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46592024-12-02T16:49:50.092ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46602024-12-02T16:49:50.093ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d65200df-8717-47c5-9cdf-184a02c3ee28", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} })
46612024-12-02T16:49:50.095ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 303.545653ms iteration = 14 status = {}
46622024-12-02T16:49:50.104ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 312.932655ms iteration = 13 status = {}
46632024-12-02T16:49:50.119ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
46642024-12-02T16:49:50.119ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "cc77fb6b-fb33-4e2f-a049-5cbadcb46685", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46652024-12-02T16:49:50.119ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46662024-12-02T16:49:50.121ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ee03c421-ba1d-4afc-87f9-9be785e33c7f", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46672024-12-02T16:49:50.121ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46682024-12-02T16:49:50.123ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46692024-12-02T16:49:50.123ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 331.926891ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
46702024-12-02T16:49:50.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e706ed38-4157-421e-a9a5-41f7e5e894ab roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
46712024-12-02T16:49:50.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e706ed38-4157-421e-a9a5-41f7e5e894ab resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
46722024-12-02T16:49:50.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e706ed38-4157-421e-a9a5-41f7e5e894ab response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
46732024-12-02T16:49:50.282ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
46742024-12-02T16:49:50.292ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46752024-12-02T16:49:50.292ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "34058b84-61cb-4dc8-8c45-15fe03dd3184", "content-length": "1", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} })
46762024-12-02T16:49:50.294ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46772024-12-02T16:49:50.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46782024-12-02T16:49:50.298ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46792024-12-02T16:49:50.298ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "174a4e1f-15c1-46b7-91d6-22b590bda6f4", "content-length": "691", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} })
46802024-12-02T16:49:50.298ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
46812024-12-02T16:49:50.298ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
46822024-12-02T16:49:50.298ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
46832024-12-02T16:49:50.299ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 508.479484ms iteration = 13 status = {}
46842024-12-02T16:49:50.300ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 509.367063ms iteration = 13 status = null
46852024-12-02T16:49:50.332ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
46862024-12-02T16:49:50.333ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "53d307b5-a17c-4aa3-8021-72d2049552fc", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
46872024-12-02T16:49:50.333ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
46882024-12-02T16:49:50.334ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3e8bb786-d252-4770-8599-1cad1b79903b", "date": "Mon, 02 Dec 2024 16:49:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
46892024-12-02T16:49:50.334ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
46902024-12-02T16:49:50.336ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "729a1ca0-e2dc-46aa-b057-23b9f3332a26", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
46912024-12-02T16:49:50.336ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
46922024-12-02T16:49:50.338ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
46932024-12-02T16:49:50.338ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 547.446465ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
46942024-12-02T16:49:50.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46952024-12-02T16:49:50.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46962024-12-02T16:49:50.354ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
46972024-12-02T16:49:50.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46982024-12-02T16:49:50.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46992024-12-02T16:49:50.362ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
47002024-12-02T16:49:50.363ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3fcfc05-23e5-42aa-917e-e82360374ec2", "content-length": "134", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} })
47012024-12-02T16:49:50.363ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
47022024-12-02T16:49:50.363ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
47032024-12-02T16:49:50.363ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
47042024-12-02T16:49:50.363ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
47052024-12-02T16:49:50.363ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47062024-12-02T16:49:50.363ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47072024-12-02T16:49:50.363ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47082024-12-02T16:49:50.363ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47092024-12-02T16:49:50.363ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47102024-12-02T16:49:50.363ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47112024-12-02T16:49:50.363ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
47122024-12-02T16:49:50.363ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47132024-12-02T16:49:50.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47142024-12-02T16:49:50.366ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
47152024-12-02T16:49:50.366ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc707e66-55db-4d82-8c26-0745b1953b21", "content-length": "2", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} })
47162024-12-02T16:49:50.366ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
47172024-12-02T16:49:50.366ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae566919-920b-4231-aa38-fc213af0ff78", "content-length": "52", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} })
47182024-12-02T16:49:50.366ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
47192024-12-02T16:49:50.366ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
47202024-12-02T16:49:50.457ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ff168f07-febb-4652-9a3a-fcf9a4f4e345", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} })
47212024-12-02T16:49:50.457ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
47222024-12-02T16:49:50.457ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47232024-12-02T16:49:50.457ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d5ede1c-d5ec-49a5-8022-d48a06a88191", "content-length": "682", "date": "Mon, 02 Dec 2024 16:49:49 GMT"} })
47242024-12-02T16:49:50.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47252024-12-02T16:49:50.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47262024-12-02T16:49:50.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47272024-12-02T16:49:50.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47282024-12-02T16:49:50.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47292024-12-02T16:49:50.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47302024-12-02T16:49:50.467ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47312024-12-02T16:49:50.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47322024-12-02T16:49:50.473ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 682.397355ms iteration = 13 status = {}
47332024-12-02T16:49:51.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ec8c7c44-34e8-43e4-819f-89c836576f69 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47342024-12-02T16:49:51.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ec8c7c44-34e8-43e4-819f-89c836576f69 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47352024-12-02T16:49:51.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ec8c7c44-34e8-43e4-819f-89c836576f69 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47362024-12-02T16:49:52.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 90c239b9-8e9a-4412-b59c-0125a64c10a5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47372024-12-02T16:49:52.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 90c239b9-8e9a-4412-b59c-0125a64c10a5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47382024-12-02T16:49:52.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 90c239b9-8e9a-4412-b59c-0125a64c10a5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47392024-12-02T16:49:53.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c1f43740-62f4-47fd-952c-326e44cc4f98 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47402024-12-02T16:49:53.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c1f43740-62f4-47fd-952c-326e44cc4f98 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47412024-12-02T16:49:53.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c1f43740-62f4-47fd-952c-326e44cc4f98 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47422024-12-02T16:49:54.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9dd84e6c-aba5-4405-a727-df0ce0332fca roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47432024-12-02T16:49:54.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9dd84e6c-aba5-4405-a727-df0ce0332fca resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47442024-12-02T16:49:54.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9dd84e6c-aba5-4405-a727-df0ce0332fca response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47452024-12-02T16:49:55.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1d983b01-997d-436f-83aa-2befb2fd7da4 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47462024-12-02T16:49:55.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1d983b01-997d-436f-83aa-2befb2fd7da4 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47472024-12-02T16:49:55.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1d983b01-997d-436f-83aa-2befb2fd7da4 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47482024-12-02T16:49:56.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cf5dcbee-0192-417e-9c6e-cf3ff79011b7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47492024-12-02T16:49:56.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cf5dcbee-0192-417e-9c6e-cf3ff79011b7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47502024-12-02T16:49:56.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2251 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cf5dcbee-0192-417e-9c6e-cf3ff79011b7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47512024-12-02T16:49:56.554ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1377 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 6aed7efa-6cf5-48f4-b74d-19be997b5f35 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
47522024-12-02T16:49:57.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 25419419-c5df-4c20-9787-625a30ab3d34 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47532024-12-02T16:49:57.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 25419419-c5df-4c20-9787-625a30ab3d34 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47542024-12-02T16:49:57.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 25419419-c5df-4c20-9787-625a30ab3d34 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47552024-12-02T16:49:58.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5249dc5b-9a15-499f-b038-3ca66d1866b6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47562024-12-02T16:49:58.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5249dc5b-9a15-499f-b038-3ca66d1866b6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47572024-12-02T16:49:58.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5249dc5b-9a15-499f-b038-3ca66d1866b6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47582024-12-02T16:49:59.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a6d0279c-743d-4cd4-8906-0d4a9774d819 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47592024-12-02T16:49:59.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a6d0279c-743d-4cd4-8906-0d4a9774d819 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47602024-12-02T16:49:59.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a6d0279c-743d-4cd4-8906-0d4a9774d819 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47612024-12-02T16:49:59.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
47622024-12-02T16:49:59.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47632024-12-02T16:49:59.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
47642024-12-02T16:49:59.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47652024-12-02T16:49:59.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47662024-12-02T16:49:59.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47672024-12-02T16:49:59.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47682024-12-02T16:49:59.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47692024-12-02T16:49:59.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47702024-12-02T16:49:59.795ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.761923ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47712024-12-02T16:49:59.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47722024-12-02T16:49:59.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47732024-12-02T16:49:59.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47742024-12-02T16:49:59.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47752024-12-02T16:49:59.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47762024-12-02T16:49:59.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47772024-12-02T16:49:59.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
47782024-12-02T16:49:59.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47792024-12-02T16:49:59.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47802024-12-02T16:49:59.811ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
47812024-12-02T16:49:59.811ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.771133ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
47822024-12-02T16:50:00.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ae452b62-364d-4732-9555-f780c806c4e6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47832024-12-02T16:50:00.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ae452b62-364d-4732-9555-f780c806c4e6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47842024-12-02T16:50:00.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ae452b62-364d-4732-9555-f780c806c4e6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47852024-12-02T16:50:01.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7dd23186-7721-4a60-a4ba-a03a7be57561 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47862024-12-02T16:50:01.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7dd23186-7721-4a60-a4ba-a03a7be57561 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47872024-12-02T16:50:01.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7dd23186-7721-4a60-a4ba-a03a7be57561 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47882024-12-02T16:50:01.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = d860672e-d556-46db-89e4-c89adc8e3d8b roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
47892024-12-02T16:50:01.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = d860672e-d556-46db-89e4-c89adc8e3d8b resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
47902024-12-02T16:50:01.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = d860672e-d556-46db-89e4-c89adc8e3d8b response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
47912024-12-02T16:50:01.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f375ab48-176e-4106-a491-5da2f6f2d1db roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
47922024-12-02T16:50:01.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f375ab48-176e-4106-a491-5da2f6f2d1db resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
47932024-12-02T16:50:01.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f375ab48-176e-4106-a491-5da2f6f2d1db response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
47942024-12-02T16:50:02.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 91137452-a5f2-4940-ac49-4bf196423b70 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47952024-12-02T16:50:02.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 91137452-a5f2-4940-ac49-4bf196423b70 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47962024-12-02T16:50:02.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 91137452-a5f2-4940-ac49-4bf196423b70 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47972024-12-02T16:50:03.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8cf1b275-7d5e-45ba-acb4-f13adbc347a7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47982024-12-02T16:50:03.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8cf1b275-7d5e-45ba-acb4-f13adbc347a7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
47992024-12-02T16:50:03.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8cf1b275-7d5e-45ba-acb4-f13adbc347a7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48002024-12-02T16:50:04.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 98b842f2-a2f9-415f-9b0f-9fb5330aadfc roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48012024-12-02T16:50:04.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 98b842f2-a2f9-415f-9b0f-9fb5330aadfc resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48022024-12-02T16:50:04.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 98b842f2-a2f9-415f-9b0f-9fb5330aadfc response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48032024-12-02T16:50:05.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e6813187-23ee-4e80-b3ef-8c90e71e591f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48042024-12-02T16:50:05.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e6813187-23ee-4e80-b3ef-8c90e71e591f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48052024-12-02T16:50:05.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2820 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e6813187-23ee-4e80-b3ef-8c90e71e591f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48062024-12-02T16:50:06.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a785e670-7395-4254-9950-f7755c9db07d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48072024-12-02T16:50:06.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a785e670-7395-4254-9950-f7755c9db07d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48082024-12-02T16:50:06.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a785e670-7395-4254-9950-f7755c9db07d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48092024-12-02T16:50:06.555ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1693 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 5167ffb0-085b-492f-ba8c-02a3c019a9b5 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
48102024-12-02T16:50:07.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9bbf7bbf-477c-4cb4-93bb-c08ff9b07df8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48112024-12-02T16:50:07.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9bbf7bbf-477c-4cb4-93bb-c08ff9b07df8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48122024-12-02T16:50:07.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9bbf7bbf-477c-4cb4-93bb-c08ff9b07df8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48132024-12-02T16:50:08.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 26dab43b-f929-4e60-983e-ada14fad52e3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48142024-12-02T16:50:08.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 26dab43b-f929-4e60-983e-ada14fad52e3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48152024-12-02T16:50:08.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 26dab43b-f929-4e60-983e-ada14fad52e3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48162024-12-02T16:50:09.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ce60bdc0-b387-4450-85d0-cdd1a287641e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48172024-12-02T16:50:09.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ce60bdc0-b387-4450-85d0-cdd1a287641e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48182024-12-02T16:50:09.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ce60bdc0-b387-4450-85d0-cdd1a287641e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48192024-12-02T16:50:09.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
48202024-12-02T16:50:09.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48212024-12-02T16:50:09.791ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
48222024-12-02T16:50:09.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48232024-12-02T16:50:09.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48242024-12-02T16:50:09.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48252024-12-02T16:50:09.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48262024-12-02T16:50:09.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48272024-12-02T16:50:09.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48282024-12-02T16:50:09.795ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.615351ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48292024-12-02T16:50:09.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48302024-12-02T16:50:09.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48312024-12-02T16:50:09.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48322024-12-02T16:50:09.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48332024-12-02T16:50:09.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48342024-12-02T16:50:09.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48352024-12-02T16:50:09.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
48362024-12-02T16:50:09.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48372024-12-02T16:50:09.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48382024-12-02T16:50:09.811ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
48392024-12-02T16:50:09.811ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.48756ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
48402024-12-02T16:50:10.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9eec9763-8de1-4017-be00-aed9a69c632a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48412024-12-02T16:50:10.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9eec9763-8de1-4017-be00-aed9a69c632a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48422024-12-02T16:50:10.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9eec9763-8de1-4017-be00-aed9a69c632a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48432024-12-02T16:50:11.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6b2bcb03-782e-4811-9bd8-f5066ea0be7b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48442024-12-02T16:50:11.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6b2bcb03-782e-4811-9bd8-f5066ea0be7b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48452024-12-02T16:50:11.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2758 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6b2bcb03-782e-4811-9bd8-f5066ea0be7b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48462024-12-02T16:50:12.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f17274bd-4c85-486f-9fae-21d54d86fc18 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48472024-12-02T16:50:12.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f17274bd-4c85-486f-9fae-21d54d86fc18 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48482024-12-02T16:50:12.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f17274bd-4c85-486f-9fae-21d54d86fc18 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48492024-12-02T16:50:13.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ab6ac2e3-cbf9-4738-a13f-31657ef240b3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48502024-12-02T16:50:13.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ab6ac2e3-cbf9-4738-a13f-31657ef240b3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48512024-12-02T16:50:13.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ab6ac2e3-cbf9-4738-a13f-31657ef240b3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48522024-12-02T16:50:14.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 37888d57-be44-4e8e-a875-3b2fde8bfb44 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48532024-12-02T16:50:14.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 37888d57-be44-4e8e-a875-3b2fde8bfb44 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48542024-12-02T16:50:14.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 37888d57-be44-4e8e-a875-3b2fde8bfb44 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48552024-12-02T16:50:15.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 21b384cf-a16f-4eb1-8942-0c6fb849c73c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48562024-12-02T16:50:15.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 21b384cf-a16f-4eb1-8942-0c6fb849c73c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48572024-12-02T16:50:15.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 21b384cf-a16f-4eb1-8942-0c6fb849c73c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48582024-12-02T16:50:16.554ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1301 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 6c839c36-126b-4b71-bc35-55254dd06777 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
48592024-12-02T16:50:16.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d4710810-437b-4f3f-8f6f-e21e9c1f3bbe roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48602024-12-02T16:50:16.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d4710810-437b-4f3f-8f6f-e21e9c1f3bbe resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48612024-12-02T16:50:16.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d4710810-437b-4f3f-8f6f-e21e9c1f3bbe response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48622024-12-02T16:50:17.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dc661155-123e-4b67-83ea-7aeee32f856d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48632024-12-02T16:50:17.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dc661155-123e-4b67-83ea-7aeee32f856d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48642024-12-02T16:50:17.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dc661155-123e-4b67-83ea-7aeee32f856d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48652024-12-02T16:50:18.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 49a0d21b-3348-4ce8-b9e1-1c28ec40f36b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48662024-12-02T16:50:18.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 49a0d21b-3348-4ce8-b9e1-1c28ec40f36b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48672024-12-02T16:50:18.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 49a0d21b-3348-4ce8-b9e1-1c28ec40f36b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
48682024-12-02T16:50:19.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 074b8b0f-8e90-4d1d-a0fc-fcfc2832ac1d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
48692024-12-02T16:50:19.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 074b8b0f-8e90-4d1d-a0fc-fcfc2832ac1d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
48702024-12-02T16:50:19.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 074b8b0f-8e90-4d1d-a0fc-fcfc2832ac1d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
48712024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
48722024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
48732024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48742024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48752024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48762024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
48772024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
48782024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48792024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
48802024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48812024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48822024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
48832024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48842024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
48852024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48862024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
48872024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48882024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
48892024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48902024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
48912024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
48922024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48932024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
48942024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
48952024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48962024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48972024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
48982024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48992024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
49002024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49012024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
49022024-12-02T16:50:19.792ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49032024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49042024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
49052024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49062024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49072024-12-02T16:50:19.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49082024-12-02T16:50:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49092024-12-02T16:50:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49102024-12-02T16:50:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49112024-12-02T16:50:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49122024-12-02T16:50:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49132024-12-02T16:50:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49142024-12-02T16:50:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49152024-12-02T16:50:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49162024-12-02T16:50:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49172024-12-02T16:50:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49182024-12-02T16:50:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49192024-12-02T16:50:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49202024-12-02T16:50:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49212024-12-02T16:50:19.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49222024-12-02T16:50:19.795ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.752674ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49232024-12-02T16:50:19.795ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49242024-12-02T16:50:19.795ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
49252024-12-02T16:50:19.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49262024-12-02T16:50:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49272024-12-02T16:50:19.795ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25781, tv_nsec: 534329043 } })
49282024-12-02T16:50:19.796ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
49292024-12-02T16:50:19.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49302024-12-02T16:50:19.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49312024-12-02T16:50:19.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49322024-12-02T16:50:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49332024-12-02T16:50:19.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49342024-12-02T16:50:19.798ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25781, tv_nsec: 536532902 } })
49352024-12-02T16:50:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49362024-12-02T16:50:19.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49372024-12-02T16:50:19.798ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
49382024-12-02T16:50:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49392024-12-02T16:50:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49402024-12-02T16:50:19.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49412024-12-02T16:50:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49422024-12-02T16:50:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49432024-12-02T16:50:19.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49442024-12-02T16:50:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49452024-12-02T16:50:19.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49462024-12-02T16:50:19.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49472024-12-02T16:50:19.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.746635ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
49482024-12-02T16:50:19.802ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49492024-12-02T16:50:19.802ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49502024-12-02T16:50:19.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49512024-12-02T16:50:19.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49522024-12-02T16:50:19.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49532024-12-02T16:50:19.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49542024-12-02T16:50:19.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25781, tv_nsec: 544622933 } })
49552024-12-02T16:50:19.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49562024-12-02T16:50:19.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
49572024-12-02T16:50:19.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49582024-12-02T16:50:19.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.756349ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49592024-12-02T16:50:19.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49602024-12-02T16:50:19.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49612024-12-02T16:50:19.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49622024-12-02T16:50:19.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49632024-12-02T16:50:19.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49642024-12-02T16:50:19.812ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49652024-12-02T16:50:19.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49662024-12-02T16:50:19.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49672024-12-02T16:50:19.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
49682024-12-02T16:50:19.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49692024-12-02T16:50:19.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49702024-12-02T16:50:19.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49712024-12-02T16:50:19.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49722024-12-02T16:50:19.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49732024-12-02T16:50:19.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 622456db-7bd8-4307-b2ae-44a5f7be4007 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
49742024-12-02T16:50:19.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 622456db-7bd8-4307-b2ae-44a5f7be4007 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
49752024-12-02T16:50:19.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 622456db-7bd8-4307-b2ae-44a5f7be4007 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
49762024-12-02T16:50:19.832ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
49772024-12-02T16:50:19.832ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 39.592516ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
49782024-12-02T16:50:19.834ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49792024-12-02T16:50:19.836ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49802024-12-02T16:50:19.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49812024-12-02T16:50:19.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49822024-12-02T16:50:19.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49832024-12-02T16:50:19.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49842024-12-02T16:50:19.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 46.088633ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49852024-12-02T16:50:19.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49862024-12-02T16:50:19.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49872024-12-02T16:50:19.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.474646ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
49882024-12-02T16:50:19.840ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49892024-12-02T16:50:19.840ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49902024-12-02T16:50:19.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49912024-12-02T16:50:19.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49922024-12-02T16:50:19.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49932024-12-02T16:50:19.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49942024-12-02T16:50:19.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49952024-12-02T16:50:19.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49962024-12-02T16:50:19.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49972024-12-02T16:50:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49982024-12-02T16:50:19.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49992024-12-02T16:50:19.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50002024-12-02T16:50:19.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 61.338626ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
50012024-12-02T16:50:19.858ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50022024-12-02T16:50:19.858ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.577983ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50032024-12-02T16:50:19.864ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 71.395004ms iteration = 17 status = {"physical_disks_added":0}
50042024-12-02T16:50:19.872ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50052024-12-02T16:50:19.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50062024-12-02T16:50:19.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50072024-12-02T16:50:19.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50082024-12-02T16:50:19.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50092024-12-02T16:50:19.879ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50102024-12-02T16:50:19.879ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50112024-12-02T16:50:19.879ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 86.8652ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50122024-12-02T16:50:19.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
50132024-12-02T16:50:19.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50142024-12-02T16:50:19.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50152024-12-02T16:50:19.881ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.532154ms iteration = 14 status = 0
50162024-12-02T16:50:19.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.136493ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50172024-12-02T16:50:19.905ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50182024-12-02T16:50:19.905ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50192024-12-02T16:50:19.906ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ed193b0-3b0c-40e9-a6c1-7bfdb4db951b", "content-length": "26", "date": "Mon, 02 Dec 2024 16:50:19 GMT"} })
50202024-12-02T16:50:19.906ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50212024-12-02T16:50:19.907ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50222024-12-02T16:50:19.941ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50232024-12-02T16:50:19.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50242024-12-02T16:50:19.943ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50252024-12-02T16:50:19.945ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50262024-12-02T16:50:19.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50272024-12-02T16:50:19.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50282024-12-02T16:50:19.946ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50292024-12-02T16:50:19.948ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50302024-12-02T16:50:19.948ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50312024-12-02T16:50:19.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50322024-12-02T16:50:19.976ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50332024-12-02T16:50:19.976ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50342024-12-02T16:50:19.976ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdfccc47-21a4-4217-a98b-3098b172b8c7", "content-length": "26", "date": "Mon, 02 Dec 2024 16:50:19 GMT"} })
50352024-12-02T16:50:19.976ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50362024-12-02T16:50:19.978ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50372024-12-02T16:50:20.007ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
50382024-12-02T16:50:20.007ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50392024-12-02T16:50:20.007ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f6e4df8-a204-4f1f-9a97-72c9ea8e5fdd", "content-length": "26", "date": "Mon, 02 Dec 2024 16:50:19 GMT"} })
50402024-12-02T16:50:20.007ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50412024-12-02T16:50:20.008ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
50422024-12-02T16:50:20.024ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50432024-12-02T16:50:20.024ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50442024-12-02T16:50:20.024ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf6ce9a6-b528-4c2a-8867-30362d5ec075", "content-length": "372", "date": "Mon, 02 Dec 2024 16:50:20 GMT"} })
50452024-12-02T16:50:20.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50462024-12-02T16:50:20.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50472024-12-02T16:50:20.029ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50482024-12-02T16:50:20.030ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6225ae8c-197b-4b0b-b2da-4b93dc6137f0", "content-length": "1", "date": "Mon, 02 Dec 2024 16:50:19 GMT"} })
50492024-12-02T16:50:20.031ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50502024-12-02T16:50:20.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50512024-12-02T16:50:20.032ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 240.26288ms iteration = 14 status = null
50522024-12-02T16:50:20.037ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
50532024-12-02T16:50:20.037ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
50542024-12-02T16:50:20.038ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a2b0bf48-fbec-4705-87b2-64850f0a769e", "date": "Mon, 02 Dec 2024 16:50:20 GMT"} })
50552024-12-02T16:50:20.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50562024-12-02T16:50:20.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50572024-12-02T16:50:20.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50582024-12-02T16:50:20.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50592024-12-02T16:50:20.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50602024-12-02T16:50:20.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50612024-12-02T16:50:20.045ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
50622024-12-02T16:50:20.045ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50632024-12-02T16:50:20.045ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "49afd4ed-e923-48b8-9079-05225eff6d88", "date": "Mon, 02 Dec 2024 16:50:20 GMT"} })
50642024-12-02T16:50:20.046ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 254.089281ms iteration = 15 status = {}
50652024-12-02T16:50:20.073ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 281.109137ms iteration = 14 status = {}
50662024-12-02T16:50:20.208ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50672024-12-02T16:50:20.208ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b669e16e-5a6b-4cc8-b1e4-43f66bf98bdb", "content-length": "691", "date": "Mon, 02 Dec 2024 16:50:20 GMT"} })
50682024-12-02T16:50:20.209ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
50692024-12-02T16:50:20.209ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
50702024-12-02T16:50:20.209ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
50712024-12-02T16:50:20.210ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 417.784882ms iteration = 14 status = {}
50722024-12-02T16:50:20.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50732024-12-02T16:50:20.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50742024-12-02T16:50:20.234ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
50752024-12-02T16:50:20.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50762024-12-02T16:50:20.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50772024-12-02T16:50:20.244ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50782024-12-02T16:50:20.245ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab185133-6572-40ba-b866-643c0689ba18", "content-length": "134", "date": "Mon, 02 Dec 2024 16:50:19 GMT"} })
50792024-12-02T16:50:20.245ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
50802024-12-02T16:50:20.245ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
50812024-12-02T16:50:20.245ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
50822024-12-02T16:50:20.245ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
50832024-12-02T16:50:20.245ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50842024-12-02T16:50:20.245ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50852024-12-02T16:50:20.245ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50862024-12-02T16:50:20.245ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50872024-12-02T16:50:20.245ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
50882024-12-02T16:50:20.245ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
50892024-12-02T16:50:20.245ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
50902024-12-02T16:50:20.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50912024-12-02T16:50:20.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50922024-12-02T16:50:20.248ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
50932024-12-02T16:50:20.248ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f5217c0-49c4-4211-8171-c091cdcedef1", "content-length": "2", "date": "Mon, 02 Dec 2024 16:50:19 GMT"} })
50942024-12-02T16:50:20.248ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
50952024-12-02T16:50:20.248ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6982ae3e-15fd-4fd4-ae26-c78adb6fc5db", "content-length": "52", "date": "Mon, 02 Dec 2024 16:50:19 GMT"} })
50962024-12-02T16:50:20.248ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
50972024-12-02T16:50:20.248ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
50982024-12-02T16:50:20.339ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "97bfdaa4-ff8e-4b59-a1af-09360ff3b580", "date": "Mon, 02 Dec 2024 16:50:20 GMT"} })
50992024-12-02T16:50:20.339ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
51002024-12-02T16:50:20.339ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51012024-12-02T16:50:20.339ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2ba60ff-153c-477d-8960-4c6e6cdbf254", "content-length": "682", "date": "Mon, 02 Dec 2024 16:50:20 GMT"} })
51022024-12-02T16:50:20.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51032024-12-02T16:50:20.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51042024-12-02T16:50:20.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51052024-12-02T16:50:20.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51062024-12-02T16:50:20.346ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51072024-12-02T16:50:20.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51082024-12-02T16:50:20.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51092024-12-02T16:50:20.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51102024-12-02T16:50:20.356ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 563.551975ms iteration = 14 status = {}
51112024-12-02T16:50:20.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 36bc9e99-883c-4dd7-bff6-e597e0eaaedb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51122024-12-02T16:50:20.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 36bc9e99-883c-4dd7-bff6-e597e0eaaedb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51132024-12-02T16:50:20.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 36bc9e99-883c-4dd7-bff6-e597e0eaaedb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51142024-12-02T16:50:21.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 52f22d84-c522-465d-b06c-e6431da747ec roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51152024-12-02T16:50:21.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 52f22d84-c522-465d-b06c-e6431da747ec resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51162024-12-02T16:50:21.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 52f22d84-c522-465d-b06c-e6431da747ec response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51172024-12-02T16:50:22.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 89891fdc-67e8-4939-a7ce-a4a4ad2c438e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51182024-12-02T16:50:22.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 89891fdc-67e8-4939-a7ce-a4a4ad2c438e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51192024-12-02T16:50:22.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 89891fdc-67e8-4939-a7ce-a4a4ad2c438e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51202024-12-02T16:50:23.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ef0e79e5-34e9-4e70-8d2a-2420ec5a2ed2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51212024-12-02T16:50:23.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ef0e79e5-34e9-4e70-8d2a-2420ec5a2ed2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51222024-12-02T16:50:23.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ef0e79e5-34e9-4e70-8d2a-2420ec5a2ed2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51232024-12-02T16:50:24.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 39ffc367-8c92-45aa-beb8-785870269838 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51242024-12-02T16:50:24.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 39ffc367-8c92-45aa-beb8-785870269838 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51252024-12-02T16:50:24.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 39ffc367-8c92-45aa-beb8-785870269838 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51262024-12-02T16:50:25.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 11125e5c-26bd-4292-b23b-aae124763628 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51272024-12-02T16:50:25.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 11125e5c-26bd-4292-b23b-aae124763628 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51282024-12-02T16:50:25.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 11125e5c-26bd-4292-b23b-aae124763628 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51292024-12-02T16:50:26.555ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1382 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = bedcbbcb-d838-4528-a3e3-5b5adbf2ebc6 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
51302024-12-02T16:50:26.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8c543a1a-163e-455c-a65f-4ac9c8679409 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51312024-12-02T16:50:26.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8c543a1a-163e-455c-a65f-4ac9c8679409 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51322024-12-02T16:50:26.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8c543a1a-163e-455c-a65f-4ac9c8679409 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51332024-12-02T16:50:27.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 39f5b3c3-7d50-4a9c-9979-c92a6f05ba6f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51342024-12-02T16:50:27.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 39f5b3c3-7d50-4a9c-9979-c92a6f05ba6f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51352024-12-02T16:50:27.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 39f5b3c3-7d50-4a9c-9979-c92a6f05ba6f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51362024-12-02T16:50:29.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72f50ddf-8400-4457-91bf-76dd3735aee8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51372024-12-02T16:50:29.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72f50ddf-8400-4457-91bf-76dd3735aee8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51382024-12-02T16:50:29.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72f50ddf-8400-4457-91bf-76dd3735aee8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51392024-12-02T16:50:29.791ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
51402024-12-02T16:50:29.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51412024-12-02T16:50:29.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
51422024-12-02T16:50:29.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51432024-12-02T16:50:29.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51442024-12-02T16:50:29.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51452024-12-02T16:50:29.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51462024-12-02T16:50:29.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51472024-12-02T16:50:29.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51482024-12-02T16:50:29.795ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.768313ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51492024-12-02T16:50:29.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51502024-12-02T16:50:29.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51512024-12-02T16:50:29.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51522024-12-02T16:50:29.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51532024-12-02T16:50:29.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51542024-12-02T16:50:29.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51552024-12-02T16:50:29.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
51562024-12-02T16:50:29.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51572024-12-02T16:50:29.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51582024-12-02T16:50:29.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
51592024-12-02T16:50:29.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.305574ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
51602024-12-02T16:50:30.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ae54e23f-501b-476d-b0f2-90e4ea05a97c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51612024-12-02T16:50:30.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ae54e23f-501b-476d-b0f2-90e4ea05a97c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51622024-12-02T16:50:30.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2814 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ae54e23f-501b-476d-b0f2-90e4ea05a97c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51632024-12-02T16:50:31.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 70d82d40-4249-498d-93fb-76e88b5e286d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51642024-12-02T16:50:31.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 70d82d40-4249-498d-93fb-76e88b5e286d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51652024-12-02T16:50:31.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 70d82d40-4249-498d-93fb-76e88b5e286d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51662024-12-02T16:50:31.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 1c7dcc1c-e0d0-45db-96c4-57631a281136 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
51672024-12-02T16:50:31.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 1c7dcc1c-e0d0-45db-96c4-57631a281136 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
51682024-12-02T16:50:31.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 1c7dcc1c-e0d0-45db-96c4-57631a281136 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
51692024-12-02T16:50:31.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = ec4f266c-065c-4c73-8dc3-ebf30c6a16a6 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
51702024-12-02T16:50:31.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = ec4f266c-065c-4c73-8dc3-ebf30c6a16a6 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
51712024-12-02T16:50:31.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = ec4f266c-065c-4c73-8dc3-ebf30c6a16a6 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
51722024-12-02T16:50:32.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 16186eaa-3357-4dc7-a1b0-b2d6490389b5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51732024-12-02T16:50:32.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 16186eaa-3357-4dc7-a1b0-b2d6490389b5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51742024-12-02T16:50:32.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 16186eaa-3357-4dc7-a1b0-b2d6490389b5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51752024-12-02T16:50:33.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 997c01e9-4b45-4eed-8b8c-2fdc04aaa1ce roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51762024-12-02T16:50:33.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 997c01e9-4b45-4eed-8b8c-2fdc04aaa1ce resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51772024-12-02T16:50:33.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 997c01e9-4b45-4eed-8b8c-2fdc04aaa1ce response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51782024-12-02T16:50:34.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 70232b71-545d-4b46-ba68-c580eb997269 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51792024-12-02T16:50:34.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 70232b71-545d-4b46-ba68-c580eb997269 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51802024-12-02T16:50:34.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 70232b71-545d-4b46-ba68-c580eb997269 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51812024-12-02T16:50:35.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ad9a1e3-dc14-4330-a9fc-d84411ba990b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51822024-12-02T16:50:35.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ad9a1e3-dc14-4330-a9fc-d84411ba990b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51832024-12-02T16:50:35.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3ad9a1e3-dc14-4330-a9fc-d84411ba990b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51842024-12-02T16:50:36.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 215a00ad-b1a8-4966-b2d6-403cde997b7d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51852024-12-02T16:50:36.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 215a00ad-b1a8-4966-b2d6-403cde997b7d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51862024-12-02T16:50:36.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 215a00ad-b1a8-4966-b2d6-403cde997b7d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51872024-12-02T16:50:36.555ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1669 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = f32b4dc2-b23b-4339-aad8-146ced1ee75c response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
51882024-12-02T16:50:37.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b9b58712-7511-4d52-a694-4250265c8022 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51892024-12-02T16:50:37.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b9b58712-7511-4d52-a694-4250265c8022 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51902024-12-02T16:50:37.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b9b58712-7511-4d52-a694-4250265c8022 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51912024-12-02T16:50:38.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c7e58ab1-189e-4881-a221-caeac510c42e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51922024-12-02T16:50:38.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c7e58ab1-189e-4881-a221-caeac510c42e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51932024-12-02T16:50:38.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c7e58ab1-189e-4881-a221-caeac510c42e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51942024-12-02T16:50:39.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 04451974-4859-4ff6-b029-310ab5a0d02d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51952024-12-02T16:50:39.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 04451974-4859-4ff6-b029-310ab5a0d02d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51962024-12-02T16:50:39.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 04451974-4859-4ff6-b029-310ab5a0d02d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
51972024-12-02T16:50:39.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
51982024-12-02T16:50:39.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
51992024-12-02T16:50:39.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52002024-12-02T16:50:39.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52012024-12-02T16:50:39.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52022024-12-02T16:50:39.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52032024-12-02T16:50:39.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52042024-12-02T16:50:39.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52052024-12-02T16:50:39.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52062024-12-02T16:50:39.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.377738ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52072024-12-02T16:50:39.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52082024-12-02T16:50:39.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52092024-12-02T16:50:39.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52102024-12-02T16:50:39.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52112024-12-02T16:50:39.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52122024-12-02T16:50:39.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52132024-12-02T16:50:39.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
52142024-12-02T16:50:39.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52152024-12-02T16:50:39.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52162024-12-02T16:50:39.812ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
52172024-12-02T16:50:39.812ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.378978ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
52182024-12-02T16:50:40.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6a6999d7-c8bb-4791-b929-135884d22e3c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52192024-12-02T16:50:40.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6a6999d7-c8bb-4791-b929-135884d22e3c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52202024-12-02T16:50:40.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6a6999d7-c8bb-4791-b929-135884d22e3c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52212024-12-02T16:50:41.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 95090063-fe74-4ac2-be07-4469a935bddc roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52222024-12-02T16:50:41.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 95090063-fe74-4ac2-be07-4469a935bddc resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52232024-12-02T16:50:41.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 95090063-fe74-4ac2-be07-4469a935bddc response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52242024-12-02T16:50:42.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 17c1179f-2a2f-4c81-8804-6008be09db51 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52252024-12-02T16:50:42.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 17c1179f-2a2f-4c81-8804-6008be09db51 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52262024-12-02T16:50:42.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 17c1179f-2a2f-4c81-8804-6008be09db51 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52272024-12-02T16:50:43.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd622d2a-3408-49bb-b1ba-bd6201dea3c4 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52282024-12-02T16:50:43.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd622d2a-3408-49bb-b1ba-bd6201dea3c4 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52292024-12-02T16:50:43.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd622d2a-3408-49bb-b1ba-bd6201dea3c4 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52302024-12-02T16:50:44.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 84675153-cc8a-4fb4-8d3c-dbcea136829b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52312024-12-02T16:50:44.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 84675153-cc8a-4fb4-8d3c-dbcea136829b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52322024-12-02T16:50:44.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 84675153-cc8a-4fb4-8d3c-dbcea136829b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52332024-12-02T16:50:45.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 62a6e905-b6cb-4140-836a-752faf002d7f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52342024-12-02T16:50:45.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 62a6e905-b6cb-4140-836a-752faf002d7f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52352024-12-02T16:50:45.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 62a6e905-b6cb-4140-836a-752faf002d7f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52362024-12-02T16:50:46.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 12f7dcf6-2408-46dc-816c-3c99d2636dbf roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52372024-12-02T16:50:46.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 12f7dcf6-2408-46dc-816c-3c99d2636dbf resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52382024-12-02T16:50:46.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 12f7dcf6-2408-46dc-816c-3c99d2636dbf response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52392024-12-02T16:50:46.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f5111d5f-cf89-40ab-9ce9-2fff78801a97 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
52402024-12-02T16:50:46.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f5111d5f-cf89-40ab-9ce9-2fff78801a97 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
52412024-12-02T16:50:46.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f5111d5f-cf89-40ab-9ce9-2fff78801a97 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
52422024-12-02T16:50:46.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = a4f0060d-2bcf-46cd-89e3-682cffc7b647 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
52432024-12-02T16:50:46.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = a4f0060d-2bcf-46cd-89e3-682cffc7b647 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
52442024-12-02T16:50:46.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = a4f0060d-2bcf-46cd-89e3-682cffc7b647 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
52452024-12-02T16:50:46.555ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1419 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = edfa449f-e441-4af6-b0ef-b51459983502 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
52462024-12-02T16:50:47.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b5a88a88-864b-4f2e-852a-75921d91a678 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52472024-12-02T16:50:47.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b5a88a88-864b-4f2e-852a-75921d91a678 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52482024-12-02T16:50:47.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b5a88a88-864b-4f2e-852a-75921d91a678 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52492024-12-02T16:50:48.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 95702b82-64d5-4f7c-af8d-04a038099a59 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52502024-12-02T16:50:48.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 95702b82-64d5-4f7c-af8d-04a038099a59 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52512024-12-02T16:50:48.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 95702b82-64d5-4f7c-af8d-04a038099a59 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52522024-12-02T16:50:49.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a7ed6161-2302-4c8c-a2d2-f0658d8dea09 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52532024-12-02T16:50:49.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a7ed6161-2302-4c8c-a2d2-f0658d8dea09 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52542024-12-02T16:50:49.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a7ed6161-2302-4c8c-a2d2-f0658d8dea09 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
52552024-12-02T16:50:49.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 98d4904d-e554-48dd-a709-91b2c2603afc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
52562024-12-02T16:50:49.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 98d4904d-e554-48dd-a709-91b2c2603afc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
52572024-12-02T16:50:49.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3558 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 98d4904d-e554-48dd-a709-91b2c2603afc response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
52582024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
52592024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
52602024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52612024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
52622024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
52632024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52642024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
52652024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52662024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
52672024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52682024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
52692024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
52702024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52712024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
52722024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
52732024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52742024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
52752024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52762024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
52772024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
52782024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52792024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
52802024-12-02T16:50:49.792ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
52812024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
52822024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52832024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52842024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52852024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
52862024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52872024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
52882024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
52892024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
52902024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52912024-12-02T16:50:49.792ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c575ce6d-3e43-4b59-886a-60182869b755
52922024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
52932024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.14\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"c575ce6d-3e43-4b59-886a-60182869b755"}
52942024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
52952024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
52962024-12-02T16:50:49.792ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-02 16:40:49.792608003 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52972024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
52982024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52992024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
53002024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53012024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53022024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53032024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53042024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53052024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53062024-12-02T16:50:49.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53072024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53082024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53092024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53102024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53112024-12-02T16:50:49.793ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5510b96c-d504-40ca-83bc-e27293be3abe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 25811, tv_nsec: 530871853 } })
53122024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53132024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53142024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53152024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53162024-12-02T16:50:49.793ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a1a23f6-3701-4a53-9e08-543f9ba04e60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5030471-1797-42f6-9660-1ead64511c29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 25811, tv_nsec: 530929414 } })
53172024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53182024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
53192024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53202024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
53212024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
53222024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53232024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
53242024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53252024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
53262024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
53272024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53282024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
53292024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53302024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
53312024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
53322024-12-02T16:50:49.793ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53332024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53342024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
53352024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53362024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53372024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
53382024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53392024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53402024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53412024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53422024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53432024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53442024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
53452024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53462024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.063169ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
53472024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53482024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
53492024-12-02T16:50:49.793ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.312561ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
53502024-12-02T16:50:49.795ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53512024-12-02T16:50:49.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53522024-12-02T16:50:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53532024-12-02T16:50:49.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53542024-12-02T16:50:49.796ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.029425ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53552024-12-02T16:50:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53562024-12-02T16:50:49.797ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53572024-12-02T16:50:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53582024-12-02T16:50:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53592024-12-02T16:50:49.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53602024-12-02T16:50:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53612024-12-02T16:50:49.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53622024-12-02T16:50:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53632024-12-02T16:50:49.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53642024-12-02T16:50:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53652024-12-02T16:50:49.800ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53662024-12-02T16:50:49.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53672024-12-02T16:50:49.801ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-02 16:40:49.792608003 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
53682024-12-02T16:50:49.801ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.722606ms iteration = 8 status = {"expiration":"2024-12-02T16:40:49.792608003Z","pruned":[]}
53692024-12-02T16:50:49.802ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25811, tv_nsec: 540111004 } })
53702024-12-02T16:50:49.802ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53712024-12-02T16:50:49.802ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53722024-12-02T16:50:49.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53732024-12-02T16:50:49.802ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
53742024-12-02T16:50:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53752024-12-02T16:50:49.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53762024-12-02T16:50:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
53772024-12-02T16:50:49.803ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53782024-12-02T16:50:49.803ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53792024-12-02T16:50:49.803ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53802024-12-02T16:50:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53812024-12-02T16:50:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53822024-12-02T16:50:49.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53832024-12-02T16:50:49.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53842024-12-02T16:50:49.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25811, tv_nsec: 543198701 } })
53852024-12-02T16:50:49.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53862024-12-02T16:50:49.805ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.425818ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
53872024-12-02T16:50:49.805ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
53882024-12-02T16:50:49.805ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.670401ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
53892024-12-02T16:50:49.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53902024-12-02T16:50:49.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.214414ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
53912024-12-02T16:50:49.808ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
53922024-12-02T16:50:49.808ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
53932024-12-02T16:50:49.808ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 15.308664ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
53942024-12-02T16:50:49.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53952024-12-02T16:50:49.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53962024-12-02T16:50:49.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53972024-12-02T16:50:49.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53982024-12-02T16:50:49.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25811, tv_nsec: 548767880 } })
53992024-12-02T16:50:49.811ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
54002024-12-02T16:50:49.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54012024-12-02T16:50:49.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54022024-12-02T16:50:49.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54032024-12-02T16:50:49.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54042024-12-02T16:50:49.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54052024-12-02T16:50:49.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54062024-12-02T16:50:49.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54072024-12-02T16:50:49.813ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54082024-12-02T16:50:49.813ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54092024-12-02T16:50:49.813ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
54102024-12-02T16:50:49.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54112024-12-02T16:50:49.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54122024-12-02T16:50:49.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54132024-12-02T16:50:49.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 22.354735ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54142024-12-02T16:50:49.815ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54152024-12-02T16:50:49.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54162024-12-02T16:50:49.816ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54172024-12-02T16:50:49.816ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54182024-12-02T16:50:49.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54192024-12-02T16:50:49.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54202024-12-02T16:50:49.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54212024-12-02T16:50:49.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54222024-12-02T16:50:49.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54232024-12-02T16:50:49.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54242024-12-02T16:50:49.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54252024-12-02T16:50:49.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54262024-12-02T16:50:49.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54272024-12-02T16:50:49.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54282024-12-02T16:50:49.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54292024-12-02T16:50:49.819ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
54302024-12-02T16:50:49.819ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
54312024-12-02T16:50:49.819ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
54322024-12-02T16:50:49.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54332024-12-02T16:50:49.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54342024-12-02T16:50:49.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54352024-12-02T16:50:49.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54362024-12-02T16:50:49.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54372024-12-02T16:50:49.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54382024-12-02T16:50:49.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54392024-12-02T16:50:49.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54402024-12-02T16:50:49.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54412024-12-02T16:50:49.824ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54422024-12-02T16:50:49.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54432024-12-02T16:50:49.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
54442024-12-02T16:50:49.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54452024-12-02T16:50:49.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54462024-12-02T16:50:49.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54472024-12-02T16:50:49.827ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54482024-12-02T16:50:49.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54492024-12-02T16:50:49.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54502024-12-02T16:50:49.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54512024-12-02T16:50:49.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54522024-12-02T16:50:49.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54532024-12-02T16:50:49.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54542024-12-02T16:50:49.830ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
54552024-12-02T16:50:49.830ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
54562024-12-02T16:50:49.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54572024-12-02T16:50:49.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54582024-12-02T16:50:49.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54592024-12-02T16:50:49.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54602024-12-02T16:50:49.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54612024-12-02T16:50:49.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54622024-12-02T16:50:49.836ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54632024-12-02T16:50:49.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54642024-12-02T16:50:49.837ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54652024-12-02T16:50:49.837ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 44.937793ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54662024-12-02T16:50:49.837ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54672024-12-02T16:50:49.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54682024-12-02T16:50:49.839ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
54692024-12-02T16:50:49.839ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
54702024-12-02T16:50:49.839ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-02 16:44:11.214841 UTC dns_group = internal generation = 1
54712024-12-02T16:50:49.839ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 46.822009ms iteration = 9 status = {"generation":1}
54722024-12-02T16:50:49.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
54732024-12-02T16:50:49.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.064758ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
54742024-12-02T16:50:49.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54752024-12-02T16:50:49.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54762024-12-02T16:50:49.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54772024-12-02T16:50:49.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54782024-12-02T16:50:49.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54792024-12-02T16:50:49.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54802024-12-02T16:50:49.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54812024-12-02T16:50:49.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
54822024-12-02T16:50:49.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54832024-12-02T16:50:49.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54842024-12-02T16:50:49.856ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54852024-12-02T16:50:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54862024-12-02T16:50:49.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 65.465832ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54872024-12-02T16:50:49.859ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 65.877506ms iteration = 15 status = 0
54882024-12-02T16:50:49.862ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
54892024-12-02T16:50:49.862ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
54902024-12-02T16:50:49.862ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 69.534728ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
54912024-12-02T16:50:49.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54922024-12-02T16:50:49.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54932024-12-02T16:50:49.868ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54942024-12-02T16:50:49.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54952024-12-02T16:50:49.872ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
54962024-12-02T16:50:49.872ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 0 version = 2
54972024-12-02T16:50:49.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54982024-12-02T16:50:49.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54992024-12-02T16:50:49.873ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55002024-12-02T16:50:49.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55012024-12-02T16:50:49.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55022024-12-02T16:50:49.874ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55032024-12-02T16:50:49.874ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55042024-12-02T16:50:49.874ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 81.994227ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55052024-12-02T16:50:49.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55062024-12-02T16:50:49.876ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55072024-12-02T16:50:49.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55082024-12-02T16:50:49.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55092024-12-02T16:50:49.877ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55102024-12-02T16:50:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
55112024-12-02T16:50:49.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55122024-12-02T16:50:49.878ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55132024-12-02T16:50:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55142024-12-02T16:50:49.880ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 1 version = 2
55152024-12-02T16:50:49.880ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
55162024-12-02T16:50:49.880ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-02 16:44:12.116348 UTC dns_group = external generation = 2
55172024-12-02T16:50:49.880ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 88.140881ms iteration = 9 status = {"generation":2}
55182024-12-02T16:50:49.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.647423ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55192024-12-02T16:50:49.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55202024-12-02T16:50:49.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55212024-12-02T16:50:49.907ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
55222024-12-02T16:50:49.909ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
55232024-12-02T16:50:49.923ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 130.139438ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55242024-12-02T16:50:49.925ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-02T16:43:45.642486Z, time_modified: 2024-12-02T16:43:45.642486Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }) }
55252024-12-02T16:50:49.925ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 132.856141ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]}},"default_endpoint":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
55262024-12-02T16:50:49.942ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 150.464795ms iteration = 18 status = {"physical_disks_added":0}
55272024-12-02T16:50:49.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55282024-12-02T16:50:49.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55292024-12-02T16:50:49.949ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55302024-12-02T16:50:49.951ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55312024-12-02T16:50:49.951ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55322024-12-02T16:50:49.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55332024-12-02T16:50:49.953ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55342024-12-02T16:50:49.955ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55352024-12-02T16:50:49.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55362024-12-02T16:50:49.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55372024-12-02T16:50:49.983ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55382024-12-02T16:50:49.983ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55392024-12-02T16:50:49.984ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "af59531f-f433-4105-b2e1-46ba9c2e8546", "content-length": "26", "date": "Mon, 02 Dec 2024 16:50:49 GMT"} })
55402024-12-02T16:50:49.984ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55412024-12-02T16:50:49.984ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
55422024-12-02T16:50:49.984ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 190.96888ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
55432024-12-02T16:50:49.986ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
55442024-12-02T16:50:49.986ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55452024-12-02T16:50:49.986ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55462024-12-02T16:50:49.986ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e732e38c-2bbf-487b-8084-846196281ff7", "content-length": "26", "date": "Mon, 02 Dec 2024 16:50:49 GMT"} })
55472024-12-02T16:50:49.986ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55482024-12-02T16:50:49.987ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55492024-12-02T16:50:49.987ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55502024-12-02T16:50:49.987ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d49ea28-2e05-42fc-a6ea-0c1656f9a411", "content-length": "26", "date": "Mon, 02 Dec 2024 16:50:49 GMT"} })
55512024-12-02T16:50:49.987ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55522024-12-02T16:50:49.989ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
55532024-12-02T16:50:49.989ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55542024-12-02T16:50:50.076ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
55552024-12-02T16:50:50.076ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "355f89f0-d0d0-41de-a8ea-1b51dd07e823", "date": "Mon, 02 Dec 2024 16:50:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55562024-12-02T16:50:50.076ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55572024-12-02T16:50:50.077ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "668c15e8-e41c-42e4-945a-c0225a43d98f", "date": "Mon, 02 Dec 2024 16:50:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55582024-12-02T16:50:50.077ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55592024-12-02T16:50:50.079ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55602024-12-02T16:50:50.079ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 286.949767ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
55612024-12-02T16:50:50.167ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55622024-12-02T16:50:50.167ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa36a430-b7c6-48dd-9b59-55e1b9b68915", "content-length": "1", "date": "Mon, 02 Dec 2024 16:50:49 GMT"} })
55632024-12-02T16:50:50.169ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55642024-12-02T16:50:50.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55652024-12-02T16:50:50.172ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 379.89874ms iteration = 15 status = {}
55662024-12-02T16:50:50.191ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55672024-12-02T16:50:50.191ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbdb2e3d-0d84-47d6-8163-0898f7a9fdd8", "content-length": "691", "date": "Mon, 02 Dec 2024 16:50:50 GMT"} })
55682024-12-02T16:50:50.191ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
55692024-12-02T16:50:50.191ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
55702024-12-02T16:50:50.191ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
55712024-12-02T16:50:50.193ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 401.222587ms iteration = 15 status = {}
55722024-12-02T16:50:50.220ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
55732024-12-02T16:50:50.221ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55742024-12-02T16:50:50.221ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55752024-12-02T16:50:50.221ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "68254119-fdfe-4f4a-847c-00a656351185", "content-length": "372", "date": "Mon, 02 Dec 2024 16:50:50 GMT"} })
55762024-12-02T16:50:50.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55772024-12-02T16:50:50.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55782024-12-02T16:50:50.223ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 430.798555ms iteration = 15 status = null
55792024-12-02T16:50:50.235ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
55802024-12-02T16:50:50.235ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55812024-12-02T16:50:50.235ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "821d6709-a51d-4b4b-b870-ce074cf39318", "date": "Mon, 02 Dec 2024 16:50:50 GMT"} })
55822024-12-02T16:50:50.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55832024-12-02T16:50:50.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55842024-12-02T16:50:50.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55852024-12-02T16:50:50.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55862024-12-02T16:50:50.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55872024-12-02T16:50:50.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55882024-12-02T16:50:50.243ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55892024-12-02T16:50:50.243ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55902024-12-02T16:50:50.243ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3beef228-f00e-4861-b47b-b1c770655aec", "date": "Mon, 02 Dec 2024 16:50:50 GMT"} })
55912024-12-02T16:50:50.245ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 452.308213ms iteration = 16 status = {}
55922024-12-02T16:50:50.283ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
55932024-12-02T16:50:50.284ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b70ac7ec-3c77-4cd1-b509-fa81bed60f14", "date": "Mon, 02 Dec 2024 16:50:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
55942024-12-02T16:50:50.284ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
55952024-12-02T16:50:50.286ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9b4ffe1b-38a3-4204-b892-d773880bfe04", "date": "Mon, 02 Dec 2024 16:50:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
55962024-12-02T16:50:50.286ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
55972024-12-02T16:50:50.287ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "52c444c9-c026-4627-b925-91e8b175af8f", "date": "Mon, 02 Dec 2024 16:50:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
55982024-12-02T16:50:50.287ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
55992024-12-02T16:50:50.289ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
56002024-12-02T16:50:50.289ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 497.058504ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56012024-12-02T16:50:50.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56022024-12-02T16:50:50.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56032024-12-02T16:50:50.298ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
56042024-12-02T16:50:50.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56052024-12-02T16:50:50.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56062024-12-02T16:50:50.307ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56072024-12-02T16:50:50.307ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fc36fd2b-4714-4e77-bbd6-e6356a85f7a3", "content-length": "134", "date": "Mon, 02 Dec 2024 16:50:49 GMT"} })
56082024-12-02T16:50:50.307ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56092024-12-02T16:50:50.307ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
56102024-12-02T16:50:50.307ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56112024-12-02T16:50:50.307ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56122024-12-02T16:50:50.307ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56132024-12-02T16:50:50.307ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56142024-12-02T16:50:50.307ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56152024-12-02T16:50:50.307ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56162024-12-02T16:50:50.307ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56172024-12-02T16:50:50.307ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56182024-12-02T16:50:50.308ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
56192024-12-02T16:50:50.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56202024-12-02T16:50:50.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56212024-12-02T16:50:50.309ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56222024-12-02T16:50:50.309ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b186ae69-5de7-4f6f-a135-d897d28b568b", "content-length": "2", "date": "Mon, 02 Dec 2024 16:50:49 GMT"} })
56232024-12-02T16:50:50.309ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56242024-12-02T16:50:50.309ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "91a56291-a03a-4e5c-8991-c4f3637615d4", "content-length": "52", "date": "Mon, 02 Dec 2024 16:50:49 GMT"} })
56252024-12-02T16:50:50.309ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
56262024-12-02T16:50:50.309ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56272024-12-02T16:50:50.396ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "18c98c5e-791d-4989-8ec6-8df108c67ccc", "date": "Mon, 02 Dec 2024 16:50:50 GMT"} })
56282024-12-02T16:50:50.396ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
56292024-12-02T16:50:50.396ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56302024-12-02T16:50:50.396ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "add54f76-2f89-4f9d-9134-0b91ed92a93c", "content-length": "682", "date": "Mon, 02 Dec 2024 16:50:50 GMT"} })
56312024-12-02T16:50:50.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56322024-12-02T16:50:50.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56332024-12-02T16:50:50.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56342024-12-02T16:50:50.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56352024-12-02T16:50:50.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56362024-12-02T16:50:50.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56372024-12-02T16:50:50.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56382024-12-02T16:50:50.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56392024-12-02T16:50:50.411ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 619.496145ms iteration = 15 status = {}
56402024-12-02T16:50:50.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3682eeff-7d3c-4fb5-bb50-f410e3a4f500 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56412024-12-02T16:50:50.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3682eeff-7d3c-4fb5-bb50-f410e3a4f500 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56422024-12-02T16:50:50.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3682eeff-7d3c-4fb5-bb50-f410e3a4f500 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56432024-12-02T16:50:51.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 608a3392-5884-4ad1-85d0-7666a921ba7b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56442024-12-02T16:50:51.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 608a3392-5884-4ad1-85d0-7666a921ba7b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56452024-12-02T16:50:51.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 608a3392-5884-4ad1-85d0-7666a921ba7b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56462024-12-02T16:50:52.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 643ed9d1-3e69-4082-894b-29f682454f41 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56472024-12-02T16:50:52.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 643ed9d1-3e69-4082-894b-29f682454f41 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56482024-12-02T16:50:52.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 643ed9d1-3e69-4082-894b-29f682454f41 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56492024-12-02T16:50:53.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e6d05e41-464f-4ba3-8e20-08cc25c7872d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56502024-12-02T16:50:53.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e6d05e41-464f-4ba3-8e20-08cc25c7872d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56512024-12-02T16:50:53.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e6d05e41-464f-4ba3-8e20-08cc25c7872d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56522024-12-02T16:50:54.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bcc52b92-1f7d-4541-9b56-f3167512cd5f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56532024-12-02T16:50:54.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bcc52b92-1f7d-4541-9b56-f3167512cd5f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56542024-12-02T16:50:54.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bcc52b92-1f7d-4541-9b56-f3167512cd5f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56552024-12-02T16:50:55.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d67dc039-840b-41c5-a3dc-9fc1e7839880 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56562024-12-02T16:50:55.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d67dc039-840b-41c5-a3dc-9fc1e7839880 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56572024-12-02T16:50:55.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2613 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d67dc039-840b-41c5-a3dc-9fc1e7839880 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56582024-12-02T16:50:56.555ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1299 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = d27758c1-afe8-494a-b195-040fb00efc5c response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
56592024-12-02T16:50:56.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1f68fcac-c105-47ff-8b48-4ddaf8274696 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56602024-12-02T16:50:56.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1f68fcac-c105-47ff-8b48-4ddaf8274696 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56612024-12-02T16:50:56.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1f68fcac-c105-47ff-8b48-4ddaf8274696 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56622024-12-02T16:50:57.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4fe73577-9199-45f7-ac9a-203ebc662338 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56632024-12-02T16:50:57.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4fe73577-9199-45f7-ac9a-203ebc662338 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56642024-12-02T16:50:57.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4fe73577-9199-45f7-ac9a-203ebc662338 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56652024-12-02T16:50:58.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1c014cfb-c390-4c3e-b9fc-7fd3962041bf roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56662024-12-02T16:50:58.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1c014cfb-c390-4c3e-b9fc-7fd3962041bf resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56672024-12-02T16:50:58.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1c014cfb-c390-4c3e-b9fc-7fd3962041bf response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56682024-12-02T16:50:59.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a7deda84-d0f1-4b0f-b9ac-338d6df92ccb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56692024-12-02T16:50:59.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a7deda84-d0f1-4b0f-b9ac-338d6df92ccb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56702024-12-02T16:50:59.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a7deda84-d0f1-4b0f-b9ac-338d6df92ccb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56712024-12-02T16:50:59.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
56722024-12-02T16:50:59.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56732024-12-02T16:50:59.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
56742024-12-02T16:50:59.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56752024-12-02T16:50:59.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56762024-12-02T16:50:59.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56772024-12-02T16:50:59.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56782024-12-02T16:50:59.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56792024-12-02T16:50:59.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56802024-12-02T16:50:59.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.332518ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56812024-12-02T16:50:59.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56822024-12-02T16:50:59.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56832024-12-02T16:50:59.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56842024-12-02T16:50:59.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56852024-12-02T16:50:59.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56862024-12-02T16:50:59.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56872024-12-02T16:50:59.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
56882024-12-02T16:50:59.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56892024-12-02T16:50:59.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56902024-12-02T16:50:59.814ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
56912024-12-02T16:50:59.814ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.70641ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
56922024-12-02T16:51:00.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3c72e89e-0da9-4fe2-ba84-b77e618720ca roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56932024-12-02T16:51:00.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3c72e89e-0da9-4fe2-ba84-b77e618720ca resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56942024-12-02T16:51:00.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3c72e89e-0da9-4fe2-ba84-b77e618720ca response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
56952024-12-02T16:51:01.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 5c38b35a-f323-4b7b-9440-0dcd5464c073 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
56962024-12-02T16:51:01.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 5c38b35a-f323-4b7b-9440-0dcd5464c073 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
56972024-12-02T16:51:01.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 5c38b35a-f323-4b7b-9440-0dcd5464c073 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
56982024-12-02T16:51:01.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 60c7dea7-a178-48aa-a1cd-a3e1bf1fb23d roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
56992024-12-02T16:51:01.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 60c7dea7-a178-48aa-a1cd-a3e1bf1fb23d resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
57002024-12-02T16:51:01.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 60c7dea7-a178-48aa-a1cd-a3e1bf1fb23d response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
57012024-12-02T16:51:01.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ff256589-6a87-46ee-a82f-1ade84acfcdb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57022024-12-02T16:51:01.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ff256589-6a87-46ee-a82f-1ade84acfcdb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57032024-12-02T16:51:01.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ff256589-6a87-46ee-a82f-1ade84acfcdb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57042024-12-02T16:51:02.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 550eec29-434c-46ca-ab51-0b1d155af5ba roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57052024-12-02T16:51:02.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 550eec29-434c-46ca-ab51-0b1d155af5ba resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57062024-12-02T16:51:02.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 550eec29-434c-46ca-ab51-0b1d155af5ba response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57072024-12-02T16:51:03.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 009b178d-02ac-47fe-869c-4284d418d824 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57082024-12-02T16:51:03.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 009b178d-02ac-47fe-869c-4284d418d824 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57092024-12-02T16:51:03.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 009b178d-02ac-47fe-869c-4284d418d824 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57102024-12-02T16:51:04.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 30c472fc-fd3a-44b3-a138-218fdfc179c5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57112024-12-02T16:51:04.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 30c472fc-fd3a-44b3-a138-218fdfc179c5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57122024-12-02T16:51:04.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 30c472fc-fd3a-44b3-a138-218fdfc179c5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57132024-12-02T16:51:05.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 37d642f2-2dff-4935-944b-1f7b03e8f4f4 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57142024-12-02T16:51:05.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 37d642f2-2dff-4935-944b-1f7b03e8f4f4 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57152024-12-02T16:51:05.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 37d642f2-2dff-4935-944b-1f7b03e8f4f4 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57162024-12-02T16:51:06.556ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1396 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = b83a8c5b-2043-4e35-940e-0c5c0ef33a46 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
57172024-12-02T16:51:06.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2b0bbd05-e5ad-4c0a-990c-2a8a74c8d7f2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57182024-12-02T16:51:06.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2b0bbd05-e5ad-4c0a-990c-2a8a74c8d7f2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57192024-12-02T16:51:06.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2b0bbd05-e5ad-4c0a-990c-2a8a74c8d7f2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57202024-12-02T16:51:07.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c1ee68cc-f577-448b-8142-6bd7d4cb27f7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57212024-12-02T16:51:07.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c1ee68cc-f577-448b-8142-6bd7d4cb27f7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57222024-12-02T16:51:07.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c1ee68cc-f577-448b-8142-6bd7d4cb27f7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57232024-12-02T16:51:08.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f961c737-5e2d-4969-a799-8627c8ec046d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57242024-12-02T16:51:08.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f961c737-5e2d-4969-a799-8627c8ec046d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57252024-12-02T16:51:08.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f961c737-5e2d-4969-a799-8627c8ec046d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57262024-12-02T16:51:09.792ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
57272024-12-02T16:51:09.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57282024-12-02T16:51:09.792ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
57292024-12-02T16:51:09.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57302024-12-02T16:51:09.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57312024-12-02T16:51:09.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57322024-12-02T16:51:09.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57332024-12-02T16:51:09.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57342024-12-02T16:51:09.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57352024-12-02T16:51:09.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.657492ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57362024-12-02T16:51:09.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57372024-12-02T16:51:09.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57382024-12-02T16:51:09.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57392024-12-02T16:51:09.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57402024-12-02T16:51:09.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57412024-12-02T16:51:09.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57422024-12-02T16:51:09.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
57432024-12-02T16:51:09.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57442024-12-02T16:51:09.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57452024-12-02T16:51:09.812ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
57462024-12-02T16:51:09.812ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.213298ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
57472024-12-02T16:51:09.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 39e33da2-33c3-4f54-8247-c676f27ab561 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57482024-12-02T16:51:09.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 39e33da2-33c3-4f54-8247-c676f27ab561 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57492024-12-02T16:51:09.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 39e33da2-33c3-4f54-8247-c676f27ab561 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57502024-12-02T16:51:10.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f99a786d-1ce8-4bef-848c-bf402f2c2fbc roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57512024-12-02T16:51:10.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f99a786d-1ce8-4bef-848c-bf402f2c2fbc resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57522024-12-02T16:51:10.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f99a786d-1ce8-4bef-848c-bf402f2c2fbc response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57532024-12-02T16:51:11.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8fc04b1b-3446-404e-9648-8fdccbeb55e5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57542024-12-02T16:51:11.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8fc04b1b-3446-404e-9648-8fdccbeb55e5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57552024-12-02T16:51:11.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8fc04b1b-3446-404e-9648-8fdccbeb55e5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57562024-12-02T16:51:12.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 01645bbd-7fba-4f9f-b5cb-55b932f185e8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57572024-12-02T16:51:12.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 01645bbd-7fba-4f9f-b5cb-55b932f185e8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57582024-12-02T16:51:12.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 01645bbd-7fba-4f9f-b5cb-55b932f185e8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57592024-12-02T16:51:13.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a49232c3-d67b-4bac-9128-39be4162d488 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57602024-12-02T16:51:13.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a49232c3-d67b-4bac-9128-39be4162d488 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57612024-12-02T16:51:13.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a49232c3-d67b-4bac-9128-39be4162d488 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57622024-12-02T16:51:14.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 95d939a3-179d-4ace-89d9-3ccba708b2b4 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57632024-12-02T16:51:14.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 95d939a3-179d-4ace-89d9-3ccba708b2b4 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57642024-12-02T16:51:14.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 95d939a3-179d-4ace-89d9-3ccba708b2b4 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57652024-12-02T16:51:16.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e0968280-0435-4063-8fb1-2bb8236eddf0 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57662024-12-02T16:51:16.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e0968280-0435-4063-8fb1-2bb8236eddf0 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57672024-12-02T16:51:16.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e0968280-0435-4063-8fb1-2bb8236eddf0 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57682024-12-02T16:51:16.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 788e7e5a-d53e-4648-b7d9-733b0a30264e roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
57692024-12-02T16:51:16.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 788e7e5a-d53e-4648-b7d9-733b0a30264e resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
57702024-12-02T16:51:16.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2822 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 788e7e5a-d53e-4648-b7d9-733b0a30264e response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
57712024-12-02T16:51:16.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 013a415b-9954-4233-8410-1246b09c8acc roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
57722024-12-02T16:51:16.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 013a415b-9954-4233-8410-1246b09c8acc resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
57732024-12-02T16:51:16.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1750 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 013a415b-9954-4233-8410-1246b09c8acc response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
57742024-12-02T16:51:16.555ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1554 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = af078df1-4f55-4499-96b8-70667309f1f9 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
57752024-12-02T16:51:17.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 272c3df5-603d-4bb0-8a05-6d85540b6ef8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57762024-12-02T16:51:17.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 272c3df5-603d-4bb0-8a05-6d85540b6ef8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57772024-12-02T16:51:17.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 272c3df5-603d-4bb0-8a05-6d85540b6ef8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57782024-12-02T16:51:17.616ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:58630
57792024-12-02T16:51:17.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58630 req_id = 19744c91-beb7-4754-b9f4-581a327ab8fb roles = RoleSet { roles: {} } uri = /metrics/producers
57802024-12-02T16:51:17.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58630 req_id = 19744c91-beb7-4754-b9f4-581a327ab8fb resource = Database result = Ok(()) uri = /metrics/producers
57812024-12-02T16:51:17.657ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = d6743efc-3f8c-4f9c-82eb-c8c8561c254a
57822024-12-02T16:51:17.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41669 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:58630 req_id = 19744c91-beb7-4754-b9f4-581a327ab8fb response_code = 201 uri = /metrics/producers
57832024-12-02T16:51:18.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ceaea70e-2e74-4c41-a6d1-fa9c47ca06e8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57842024-12-02T16:51:18.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ceaea70e-2e74-4c41-a6d1-fa9c47ca06e8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57852024-12-02T16:51:18.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ceaea70e-2e74-4c41-a6d1-fa9c47ca06e8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57862024-12-02T16:51:19.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 23f94868-b22a-44ba-950a-5229238d88b3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57872024-12-02T16:51:19.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 23f94868-b22a-44ba-950a-5229238d88b3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57882024-12-02T16:51:19.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 23f94868-b22a-44ba-950a-5229238d88b3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
57892024-12-02T16:51:19.609ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:44837
57902024-12-02T16:51:19.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44837 req_id = 9c3b445e-55c0-4f53-8d1d-b53aa09abb3f roles = RoleSet { roles: {} } uri = /metrics/producers
57912024-12-02T16:51:19.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44837 req_id = 9c3b445e-55c0-4f53-8d1d-b53aa09abb3f resource = Database result = Ok(()) uri = /metrics/producers
57922024-12-02T16:51:19.652ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = 999318be-e8de-4392-9ed9-30887ef5bc8f
57932024-12-02T16:51:19.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43256 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44837 req_id = 9c3b445e-55c0-4f53-8d1d-b53aa09abb3f response_code = 201 uri = /metrics/producers
57942024-12-02T16:51:19.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = e902e2de-3a26-4af3-b8d6-f611f8d4d7b4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
57952024-12-02T16:51:19.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = e902e2de-3a26-4af3-b8d6-f611f8d4d7b4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
57962024-12-02T16:51:19.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = e902e2de-3a26-4af3-b8d6-f611f8d4d7b4 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
57972024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
57982024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
57992024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58002024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58012024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58022024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
58032024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
58042024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58052024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58062024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
58072024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58082024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
58092024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58102024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
58112024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58122024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
58132024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
58142024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58152024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58162024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
58172024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
58182024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58192024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
58202024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58212024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
58222024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
58232024-12-02T16:51:19.793ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58242024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58252024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
58262024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58272024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58282024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
58292024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58302024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
58312024-12-02T16:51:19.793ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58322024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58332024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58342024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58352024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58362024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58372024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58382024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58392024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58402024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58412024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58422024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58432024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58442024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58452024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58462024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58472024-12-02T16:51:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58482024-12-02T16:51:19.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58492024-12-02T16:51:19.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58502024-12-02T16:51:19.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58512024-12-02T16:51:19.797ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.581142ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58522024-12-02T16:51:19.797ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58532024-12-02T16:51:19.797ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58542024-12-02T16:51:19.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58552024-12-02T16:51:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58562024-12-02T16:51:19.798ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58572024-12-02T16:51:19.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58582024-12-02T16:51:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58592024-12-02T16:51:19.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58602024-12-02T16:51:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58612024-12-02T16:51:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58622024-12-02T16:51:19.800ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58632024-12-02T16:51:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58642024-12-02T16:51:19.800ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58652024-12-02T16:51:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58662024-12-02T16:51:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58672024-12-02T16:51:19.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58682024-12-02T16:51:19.802ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25841, tv_nsec: 539547359 } })
58692024-12-02T16:51:19.802ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
58702024-12-02T16:51:19.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58712024-12-02T16:51:19.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58722024-12-02T16:51:19.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58732024-12-02T16:51:19.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58742024-12-02T16:51:19.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58752024-12-02T16:51:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58762024-12-02T16:51:19.808ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25841, tv_nsec: 545990725 } })
58772024-12-02T16:51:19.809ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
58782024-12-02T16:51:19.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58792024-12-02T16:51:19.809ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58802024-12-02T16:51:19.809ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58812024-12-02T16:51:19.809ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58822024-12-02T16:51:19.809ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58832024-12-02T16:51:19.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58842024-12-02T16:51:19.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58852024-12-02T16:51:19.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58862024-12-02T16:51:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58872024-12-02T16:51:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58882024-12-02T16:51:19.810ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58892024-12-02T16:51:19.810ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25841, tv_nsec: 547808941 } })
58902024-12-02T16:51:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58912024-12-02T16:51:19.810ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
58922024-12-02T16:51:19.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58932024-12-02T16:51:19.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58942024-12-02T16:51:19.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58952024-12-02T16:51:19.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58962024-12-02T16:51:19.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58972024-12-02T16:51:19.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58982024-12-02T16:51:19.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58992024-12-02T16:51:19.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59002024-12-02T16:51:19.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59012024-12-02T16:51:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59022024-12-02T16:51:19.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59032024-12-02T16:51:19.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59042024-12-02T16:51:19.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59052024-12-02T16:51:19.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59062024-12-02T16:51:19.818ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59072024-12-02T16:51:19.818ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.482964ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59082024-12-02T16:51:19.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59092024-12-02T16:51:19.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59102024-12-02T16:51:19.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59112024-12-02T16:51:19.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59122024-12-02T16:51:19.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
59132024-12-02T16:51:19.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59142024-12-02T16:51:19.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59152024-12-02T16:51:19.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 42.579932ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
59162024-12-02T16:51:19.838ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59172024-12-02T16:51:19.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59182024-12-02T16:51:19.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.405768ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
59192024-12-02T16:51:19.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
59202024-12-02T16:51:19.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.841338ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
59212024-12-02T16:51:19.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.13846ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59222024-12-02T16:51:19.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 52.919552ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59232024-12-02T16:51:19.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 53.327227ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59242024-12-02T16:51:19.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59252024-12-02T16:51:19.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59262024-12-02T16:51:19.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59272024-12-02T16:51:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59282024-12-02T16:51:19.851ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59292024-12-02T16:51:19.851ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59302024-12-02T16:51:19.851ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 57.738595ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59312024-12-02T16:51:19.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59322024-12-02T16:51:19.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
59332024-12-02T16:51:19.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59342024-12-02T16:51:19.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59352024-12-02T16:51:19.855ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.959702ms iteration = 16 status = 0
59362024-12-02T16:51:19.866ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59372024-12-02T16:51:19.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59382024-12-02T16:51:19.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 77.072063ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59392024-12-02T16:51:19.886ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59402024-12-02T16:51:19.886ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59412024-12-02T16:51:19.886ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "16ca2e91-006f-4c52-b862-5f389ba9e976", "content-length": "26", "date": "Mon, 02 Dec 2024 16:51:19 GMT"} })
59422024-12-02T16:51:19.886ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59432024-12-02T16:51:19.891ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59442024-12-02T16:51:19.908ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
59452024-12-02T16:51:19.908ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59462024-12-02T16:51:19.908ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef14df90-3d5c-4fee-868e-261d4f1ca302", "content-length": "26", "date": "Mon, 02 Dec 2024 16:51:19 GMT"} })
59472024-12-02T16:51:19.908ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59482024-12-02T16:51:19.909ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59492024-12-02T16:51:19.909ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59502024-12-02T16:51:19.910ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3e26eff-346e-4a10-a330-24608a6ef8c8", "content-length": "26", "date": "Mon, 02 Dec 2024 16:51:19 GMT"} })
59512024-12-02T16:51:19.910ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59522024-12-02T16:51:19.910ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
59532024-12-02T16:51:19.912ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59542024-12-02T16:51:19.914ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59552024-12-02T16:51:19.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59562024-12-02T16:51:19.922ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 128.676465ms iteration = 19 status = {"physical_disks_added":0}
59572024-12-02T16:51:20.008ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 214.981479ms iteration = 16 status = {}
59582024-12-02T16:51:20.010ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59592024-12-02T16:51:20.010ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59602024-12-02T16:51:20.011ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7041ad1f-2a2f-4567-aada-1e0e1b1c02ae", "content-length": "372", "date": "Mon, 02 Dec 2024 16:51:20 GMT"} })
59612024-12-02T16:51:20.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59622024-12-02T16:51:20.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59632024-12-02T16:51:20.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59642024-12-02T16:51:20.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59652024-12-02T16:51:20.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59662024-12-02T16:51:20.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59672024-12-02T16:51:20.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59682024-12-02T16:51:20.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59692024-12-02T16:51:20.016ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59702024-12-02T16:51:20.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59712024-12-02T16:51:20.025ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
59722024-12-02T16:51:20.025ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
59732024-12-02T16:51:20.025ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "32900ada-dbe0-4549-9e96-43638383ec77", "date": "Mon, 02 Dec 2024 16:51:20 GMT"} })
59742024-12-02T16:51:20.025ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59752024-12-02T16:51:20.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59762024-12-02T16:51:20.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59772024-12-02T16:51:20.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59782024-12-02T16:51:20.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59792024-12-02T16:51:20.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59802024-12-02T16:51:20.035ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
59812024-12-02T16:51:20.035ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59822024-12-02T16:51:20.035ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "11d3791b-6f17-44f6-b980-623b575292ba", "date": "Mon, 02 Dec 2024 16:51:20 GMT"} })
59832024-12-02T16:51:20.037ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 243.923741ms iteration = 17 status = {}
59842024-12-02T16:51:20.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7862ddca-9940-43b2-9bb9-0150fbcd0683 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
59852024-12-02T16:51:20.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7862ddca-9940-43b2-9bb9-0150fbcd0683 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
59862024-12-02T16:51:20.099ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59872024-12-02T16:51:20.100ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6c1b913-2121-42a4-85e2-cd4f1db81b74", "content-length": "691", "date": "Mon, 02 Dec 2024 16:51:20 GMT"} })
59882024-12-02T16:51:20.100ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
59892024-12-02T16:51:20.100ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
59902024-12-02T16:51:20.100ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
59912024-12-02T16:51:20.101ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 307.74515ms iteration = 16 status = {}
59922024-12-02T16:51:20.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7862ddca-9940-43b2-9bb9-0150fbcd0683 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
59932024-12-02T16:51:20.119ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59942024-12-02T16:51:20.119ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e98d46db-c1dd-404d-a6fe-de26a07304c9", "content-length": "1", "date": "Mon, 02 Dec 2024 16:51:19 GMT"} })
59952024-12-02T16:51:20.121ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59962024-12-02T16:51:20.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59972024-12-02T16:51:20.126ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 332.330744ms iteration = 16 status = null
59982024-12-02T16:51:20.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59992024-12-02T16:51:20.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60002024-12-02T16:51:20.178ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
60012024-12-02T16:51:20.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60022024-12-02T16:51:20.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60032024-12-02T16:51:20.188ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60042024-12-02T16:51:20.188ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "86cba925-bb5b-43a6-8204-9a7d4309b7ff", "content-length": "134", "date": "Mon, 02 Dec 2024 16:51:19 GMT"} })
60052024-12-02T16:51:20.188ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60062024-12-02T16:51:20.188ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
60072024-12-02T16:51:20.189ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60082024-12-02T16:51:20.189ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60092024-12-02T16:51:20.189ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60102024-12-02T16:51:20.189ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60112024-12-02T16:51:20.189ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60122024-12-02T16:51:20.189ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60132024-12-02T16:51:20.189ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60142024-12-02T16:51:20.189ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60152024-12-02T16:51:20.189ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
60162024-12-02T16:51:20.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60172024-12-02T16:51:20.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60182024-12-02T16:51:20.191ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60192024-12-02T16:51:20.191ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8350614-75e7-4cca-8ce7-8d2ecb457eed", "content-length": "2", "date": "Mon, 02 Dec 2024 16:51:19 GMT"} })
60202024-12-02T16:51:20.191ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60212024-12-02T16:51:20.191ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f153cca1-ddeb-43c5-ba9f-20f0313234fe", "content-length": "52", "date": "Mon, 02 Dec 2024 16:51:19 GMT"} })
60222024-12-02T16:51:20.191ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
60232024-12-02T16:51:20.191ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60242024-12-02T16:51:20.281ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "82f36629-1f36-45d5-a8cc-2af62124063b", "date": "Mon, 02 Dec 2024 16:51:20 GMT"} })
60252024-12-02T16:51:20.281ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
60262024-12-02T16:51:20.281ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60272024-12-02T16:51:20.281ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "83c42860-6802-4b49-91fe-2d0e46d0dc72", "content-length": "682", "date": "Mon, 02 Dec 2024 16:51:20 GMT"} })
60282024-12-02T16:51:20.281ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60292024-12-02T16:51:20.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60302024-12-02T16:51:20.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60312024-12-02T16:51:20.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60322024-12-02T16:51:20.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60332024-12-02T16:51:20.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60342024-12-02T16:51:20.291ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60352024-12-02T16:51:20.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60362024-12-02T16:51:20.300ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 506.515018ms iteration = 16 status = {}
60372024-12-02T16:51:21.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bdcd70d0-3551-42ee-af22-035a01b76b55 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60382024-12-02T16:51:21.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bdcd70d0-3551-42ee-af22-035a01b76b55 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60392024-12-02T16:51:21.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bdcd70d0-3551-42ee-af22-035a01b76b55 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60402024-12-02T16:51:22.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b51ed05e-8119-4e42-b576-97b29cdc78ea roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60412024-12-02T16:51:22.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b51ed05e-8119-4e42-b576-97b29cdc78ea resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60422024-12-02T16:51:22.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b51ed05e-8119-4e42-b576-97b29cdc78ea response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60432024-12-02T16:51:23.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8af89762-1847-48f4-a7e3-c2be2fea0acb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60442024-12-02T16:51:23.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8af89762-1847-48f4-a7e3-c2be2fea0acb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60452024-12-02T16:51:23.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8af89762-1847-48f4-a7e3-c2be2fea0acb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60462024-12-02T16:51:24.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d2e6470d-f75c-4d65-ade9-fdd4aa74349c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60472024-12-02T16:51:24.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d2e6470d-f75c-4d65-ade9-fdd4aa74349c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60482024-12-02T16:51:24.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d2e6470d-f75c-4d65-ade9-fdd4aa74349c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60492024-12-02T16:51:25.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fb0be644-ae7a-454a-9fac-ffad4ac141ec roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60502024-12-02T16:51:25.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fb0be644-ae7a-454a-9fac-ffad4ac141ec resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60512024-12-02T16:51:25.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fb0be644-ae7a-454a-9fac-ffad4ac141ec response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60522024-12-02T16:51:25.365ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:51920
60532024-12-02T16:51:25.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51920 req_id = 60874f1b-9629-417a-97d8-4b0bca874f95 roles = RoleSet { roles: {} } uri = /metrics/producers
60542024-12-02T16:51:25.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51920 req_id = 60874f1b-9629-417a-97d8-4b0bca874f95 resource = Database result = Ok(()) uri = /metrics/producers
60552024-12-02T16:51:25.405ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = c94a6654-1297-4865-84af-bb83693635c3
60562024-12-02T16:51:25.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39864 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51920 req_id = 60874f1b-9629-417a-97d8-4b0bca874f95 response_code = 201 uri = /metrics/producers
60572024-12-02T16:51:26.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0c3cf660-dc57-45d3-9532-da8fb8c9e1dc roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60582024-12-02T16:51:26.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0c3cf660-dc57-45d3-9532-da8fb8c9e1dc resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60592024-12-02T16:51:26.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0c3cf660-dc57-45d3-9532-da8fb8c9e1dc response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60602024-12-02T16:51:26.556ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1521 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = f4414f4c-0125-4a6e-9d39-76e29a4479d2 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
60612024-12-02T16:51:27.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 12e68002-4717-49ba-9e2c-d0ea66c05a30 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60622024-12-02T16:51:27.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 12e68002-4717-49ba-9e2c-d0ea66c05a30 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60632024-12-02T16:51:27.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 12e68002-4717-49ba-9e2c-d0ea66c05a30 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60642024-12-02T16:51:28.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 81a1319b-e8f3-444a-bc25-1164189098b8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60652024-12-02T16:51:28.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 81a1319b-e8f3-444a-bc25-1164189098b8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60662024-12-02T16:51:28.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 81a1319b-e8f3-444a-bc25-1164189098b8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60672024-12-02T16:51:29.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d0654a37-da7b-4e1c-84cd-b707c7a1edc7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60682024-12-02T16:51:29.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d0654a37-da7b-4e1c-84cd-b707c7a1edc7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60692024-12-02T16:51:29.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d0654a37-da7b-4e1c-84cd-b707c7a1edc7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60702024-12-02T16:51:29.793ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
60712024-12-02T16:51:29.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60722024-12-02T16:51:29.793ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
60732024-12-02T16:51:29.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60742024-12-02T16:51:29.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60752024-12-02T16:51:29.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60762024-12-02T16:51:29.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60772024-12-02T16:51:29.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60782024-12-02T16:51:29.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60792024-12-02T16:51:29.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.362758ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60802024-12-02T16:51:29.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60812024-12-02T16:51:29.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60822024-12-02T16:51:29.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60832024-12-02T16:51:29.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60842024-12-02T16:51:29.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60852024-12-02T16:51:29.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60862024-12-02T16:51:29.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
60872024-12-02T16:51:29.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60882024-12-02T16:51:29.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60892024-12-02T16:51:29.816ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
60902024-12-02T16:51:29.816ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.751769ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
60912024-12-02T16:51:30.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ec30f5e8-1106-4467-8ff0-66ecf9448723 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60922024-12-02T16:51:30.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ec30f5e8-1106-4467-8ff0-66ecf9448723 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60932024-12-02T16:51:30.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ec30f5e8-1106-4467-8ff0-66ecf9448723 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60942024-12-02T16:51:31.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 736767f2-f428-4a9d-bff0-8f0b4c74300e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60952024-12-02T16:51:31.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 736767f2-f428-4a9d-bff0-8f0b4c74300e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60962024-12-02T16:51:31.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 736767f2-f428-4a9d-bff0-8f0b4c74300e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60972024-12-02T16:51:32.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 43156a56-39fd-40c0-806d-64c732ed2828 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60982024-12-02T16:51:32.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 43156a56-39fd-40c0-806d-64c732ed2828 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
60992024-12-02T16:51:32.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 43156a56-39fd-40c0-806d-64c732ed2828 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61002024-12-02T16:51:32.846ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:45728
61012024-12-02T16:51:32.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45728 req_id = 76e1945a-f13f-4c25-a810-71e1b88e15e0 roles = RoleSet { roles: {} } uri = /metrics/producers
61022024-12-02T16:51:32.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45728 req_id = 76e1945a-f13f-4c25-a810-71e1b88e15e0 resource = Database result = Ok(()) uri = /metrics/producers
61032024-12-02T16:51:32.880ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61042024-12-02T16:51:32.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34131 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45728 req_id = 76e1945a-f13f-4c25-a810-71e1b88e15e0 response_code = 201 uri = /metrics/producers
61052024-12-02T16:51:33.031ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:44089
61062024-12-02T16:51:33.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44089 req_id = 87f8824d-eec7-45ca-b463-fb8a33c72980 roles = RoleSet { roles: {} } uri = /metrics/producers
61072024-12-02T16:51:33.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44089 req_id = 87f8824d-eec7-45ca-b463-fb8a33c72980 resource = Database result = Ok(()) uri = /metrics/producers
61082024-12-02T16:51:33.040ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = f1994180-91a5-4667-ac8f-de00c9b09458
61092024-12-02T16:51:33.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8864 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44089 req_id = 87f8824d-eec7-45ca-b463-fb8a33c72980 response_code = 201 uri = /metrics/producers
61102024-12-02T16:51:33.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 27916985-40a5-44ab-85ec-22182b34d5a1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61112024-12-02T16:51:33.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 27916985-40a5-44ab-85ec-22182b34d5a1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61122024-12-02T16:51:33.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 27916985-40a5-44ab-85ec-22182b34d5a1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61132024-12-02T16:51:34.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 52bfd3d1-55cd-4d24-855f-508ef8bcbab3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61142024-12-02T16:51:34.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 52bfd3d1-55cd-4d24-855f-508ef8bcbab3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61152024-12-02T16:51:34.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 52bfd3d1-55cd-4d24-855f-508ef8bcbab3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61162024-12-02T16:51:35.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 81143679-e729-41eb-b577-b4203e6c29fa roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61172024-12-02T16:51:35.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 81143679-e729-41eb-b577-b4203e6c29fa resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61182024-12-02T16:51:35.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 81143679-e729-41eb-b577-b4203e6c29fa response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61192024-12-02T16:51:36.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8b94cc80-25a8-460b-9e6c-3971f3b80964 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61202024-12-02T16:51:36.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8b94cc80-25a8-460b-9e6c-3971f3b80964 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61212024-12-02T16:51:36.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8b94cc80-25a8-460b-9e6c-3971f3b80964 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61222024-12-02T16:51:36.464ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:41655
61232024-12-02T16:51:36.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41655 req_id = 7f776e86-381d-45fd-a1d3-45f51ff04df1 roles = RoleSet { roles: {} } uri = /metrics/producers
61242024-12-02T16:51:36.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41655 req_id = 7f776e86-381d-45fd-a1d3-45f51ff04df1 resource = Database result = Ok(()) uri = /metrics/producers
61252024-12-02T16:51:36.476ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = bcacf9eb-c8be-49ce-bc71-4d5ced99f0ed
61262024-12-02T16:51:36.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12130 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41655 req_id = 7f776e86-381d-45fd-a1d3-45f51ff04df1 response_code = 201 uri = /metrics/producers
61272024-12-02T16:51:36.556ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1523 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = a506724c-2872-4791-b9fe-ef2542dd2166 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
61282024-12-02T16:51:37.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 59df2cfa-db35-48bd-b246-50c36e3081bf roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61292024-12-02T16:51:37.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 59df2cfa-db35-48bd-b246-50c36e3081bf resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61302024-12-02T16:51:37.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 59df2cfa-db35-48bd-b246-50c36e3081bf response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61312024-12-02T16:51:38.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5587b1ad-f58f-4f7c-8d0a-4511d37e4bd8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61322024-12-02T16:51:38.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5587b1ad-f58f-4f7c-8d0a-4511d37e4bd8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61332024-12-02T16:51:38.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5587b1ad-f58f-4f7c-8d0a-4511d37e4bd8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61342024-12-02T16:51:39.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bd217c70-8452-402b-89b1-3842415c7577 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61352024-12-02T16:51:39.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bd217c70-8452-402b-89b1-3842415c7577 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61362024-12-02T16:51:39.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bd217c70-8452-402b-89b1-3842415c7577 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61372024-12-02T16:51:39.793ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
61382024-12-02T16:51:39.793ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
61392024-12-02T16:51:39.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61402024-12-02T16:51:39.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61412024-12-02T16:51:39.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61422024-12-02T16:51:39.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61432024-12-02T16:51:39.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61442024-12-02T16:51:39.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61452024-12-02T16:51:39.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61462024-12-02T16:51:39.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.4697ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61472024-12-02T16:51:39.797ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61482024-12-02T16:51:39.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61492024-12-02T16:51:39.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61502024-12-02T16:51:39.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61512024-12-02T16:51:39.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61522024-12-02T16:51:39.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61532024-12-02T16:51:39.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
61542024-12-02T16:51:39.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61552024-12-02T16:51:39.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61562024-12-02T16:51:39.811ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
61572024-12-02T16:51:39.811ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.754354ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
61582024-12-02T16:51:40.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6582d4ad-42e7-449f-b884-7e881f6e0e38 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61592024-12-02T16:51:40.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6582d4ad-42e7-449f-b884-7e881f6e0e38 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61602024-12-02T16:51:40.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6582d4ad-42e7-449f-b884-7e881f6e0e38 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61612024-12-02T16:51:41.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ab8287e9-bc8c-4a76-b49e-3eb4eb78b7c6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61622024-12-02T16:51:41.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ab8287e9-bc8c-4a76-b49e-3eb4eb78b7c6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61632024-12-02T16:51:41.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ab8287e9-bc8c-4a76-b49e-3eb4eb78b7c6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61642024-12-02T16:51:42.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 516c617a-716f-4cab-8b47-f55385d8e774 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61652024-12-02T16:51:42.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 516c617a-716f-4cab-8b47-f55385d8e774 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61662024-12-02T16:51:42.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 516c617a-716f-4cab-8b47-f55385d8e774 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61672024-12-02T16:51:43.089ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
61682024-12-02T16:51:43.089ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
61692024-12-02T16:51:43.120ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
61702024-12-02T16:51:43.120ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:42441
61712024-12-02T16:51:43.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42441 req_id = 49d77a9b-9fbe-4404-bdbc-1c88349b0ff6 roles = RoleSet { roles: {} } uri = /metrics/producers
61722024-12-02T16:51:43.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42441 req_id = 49d77a9b-9fbe-4404-bdbc-1c88349b0ff6 resource = Database result = Ok(()) uri = /metrics/producers
61732024-12-02T16:51:43.155ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
61742024-12-02T16:51:43.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35412 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:42441 req_id = 49d77a9b-9fbe-4404-bdbc-1c88349b0ff6 response_code = 201 uri = /metrics/producers
61752024-12-02T16:51:43.155ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "49d77a9b-9fbe-4404-bdbc-1c88349b0ff6", "content-length": "41", "date": "Mon, 02 Dec 2024 16:51:43 GMT"} })
61762024-12-02T16:51:43.157ZDEBGnexus (producer-registration-task): registered with nexus successfully
61772024-12-02T16:51:43.157ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
61782024-12-02T16:51:43.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d61454af-361d-4fb0-92fe-b921d3df7458 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61792024-12-02T16:51:43.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d61454af-361d-4fb0-92fe-b921d3df7458 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61802024-12-02T16:51:43.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1827 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d61454af-361d-4fb0-92fe-b921d3df7458 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61812024-12-02T16:51:44.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 572d2c08-68ba-4315-bfd3-c213d4160ad1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61822024-12-02T16:51:44.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 572d2c08-68ba-4315-bfd3-c213d4160ad1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61832024-12-02T16:51:44.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 572d2c08-68ba-4315-bfd3-c213d4160ad1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61842024-12-02T16:51:45.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 66f5134f-1ba6-46d1-9a3b-0e5db17d14b9 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61852024-12-02T16:51:45.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 66f5134f-1ba6-46d1-9a3b-0e5db17d14b9 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61862024-12-02T16:51:45.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 66f5134f-1ba6-46d1-9a3b-0e5db17d14b9 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61872024-12-02T16:51:46.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = d1047735-2a97-4a29-b761-4c79f4010798 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
61882024-12-02T16:51:46.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = d1047735-2a97-4a29-b761-4c79f4010798 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
61892024-12-02T16:51:46.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = d1047735-2a97-4a29-b761-4c79f4010798 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
61902024-12-02T16:51:46.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f0631ec0-9062-4c67-a50b-a535425210d5 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
61912024-12-02T16:51:46.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f0631ec0-9062-4c67-a50b-a535425210d5 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
61922024-12-02T16:51:46.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = f0631ec0-9062-4c67-a50b-a535425210d5 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
61932024-12-02T16:51:46.557ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1461 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 9be8df0f-8c5a-4c8f-bcde-8e3804d65dad response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
61942024-12-02T16:51:46.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a09b2511-ec24-47fb-bf27-cf174ebe8145 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61952024-12-02T16:51:46.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a09b2511-ec24-47fb-bf27-cf174ebe8145 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61962024-12-02T16:51:46.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a09b2511-ec24-47fb-bf27-cf174ebe8145 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61972024-12-02T16:51:47.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 43391e4b-c3f3-469b-b8ea-024fb901c2d7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61982024-12-02T16:51:47.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 43391e4b-c3f3-469b-b8ea-024fb901c2d7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
61992024-12-02T16:51:47.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1593 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 43391e4b-c3f3-469b-b8ea-024fb901c2d7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
62002024-12-02T16:51:48.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2c9054ee-ae3c-4000-9a78-8434e8bb1f90 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
62012024-12-02T16:51:48.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2c9054ee-ae3c-4000-9a78-8434e8bb1f90 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
62022024-12-02T16:51:48.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2c9054ee-ae3c-4000-9a78-8434e8bb1f90 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
62032024-12-02T16:51:49.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 9ab5975f-aa69-48d4-adcf-34b49996abc3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
62042024-12-02T16:51:49.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 9ab5975f-aa69-48d4-adcf-34b49996abc3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
62052024-12-02T16:51:49.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 9ab5975f-aa69-48d4-adcf-34b49996abc3 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
62062024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
62072024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
62082024-12-02T16:51:49.793ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-02 16:41:49.793827444 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
62092024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
62102024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
62112024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62122024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
62132024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
62142024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62152024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
62162024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
62172024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62182024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
62192024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62202024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
62212024-12-02T16:51:49.793ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c575ce6d-3e43-4b59-886a-60182869b755
62222024-12-02T16:51:49.793ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
62232024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.36\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"c575ce6d-3e43-4b59-886a-60182869b755"}
62242024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
62252024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62262024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
62272024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62282024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62292024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
62302024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62312024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
62322024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62332024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
62342024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62352024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
62362024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
62372024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62382024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
62392024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
62402024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
62412024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
62422024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62432024-12-02T16:51:49.794ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
62442024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62452024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
62462024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62472024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62482024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
62492024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
62502024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62512024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62522024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62532024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62542024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62552024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
62562024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62572024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
62582024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62592024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
62602024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62612024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62622024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
62632024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62642024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
62652024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
62662024-12-02T16:51:49.794ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62672024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62682024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
62692024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62702024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
62712024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62722024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
62732024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
62742024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62752024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62762024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
62772024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
62782024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62792024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62802024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62812024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62822024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62832024-12-02T16:51:49.794ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5510b96c-d504-40ca-83bc-e27293be3abe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 25871, tv_nsec: 531272397 } })
62842024-12-02T16:51:49.794ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a1a23f6-3701-4a53-9e08-543f9ba04e60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5030471-1797-42f6-9660-1ead64511c29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 25871, tv_nsec: 531284257 } })
62852024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62862024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62872024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
62882024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62892024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62902024-12-02T16:51:49.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62912024-12-02T16:51:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
62922024-12-02T16:51:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62932024-12-02T16:51:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62942024-12-02T16:51:49.795ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
62952024-12-02T16:51:49.795ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 977.438\u{b5}s iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
62962024-12-02T16:51:49.795ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
62972024-12-02T16:51:49.795ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.123909ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
62982024-12-02T16:51:49.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62992024-12-02T16:51:49.797ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-02 16:41:49.793827444 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
63002024-12-02T16:51:49.797ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.626831ms iteration = 9 status = {"expiration":"2024-12-02T16:41:49.793827444Z","pruned":[]}
63012024-12-02T16:51:49.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63022024-12-02T16:51:49.798ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.344538ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
63032024-12-02T16:51:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63042024-12-02T16:51:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63052024-12-02T16:51:49.799ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63062024-12-02T16:51:49.799ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63072024-12-02T16:51:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63082024-12-02T16:51:49.800ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25871, tv_nsec: 537038417 } })
63092024-12-02T16:51:49.800ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
63102024-12-02T16:51:49.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63112024-12-02T16:51:49.800ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63122024-12-02T16:51:49.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63132024-12-02T16:51:49.801ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25871, tv_nsec: 537833384 } })
63142024-12-02T16:51:49.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63152024-12-02T16:51:49.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63162024-12-02T16:51:49.801ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
63172024-12-02T16:51:49.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63182024-12-02T16:51:49.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63192024-12-02T16:51:49.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63202024-12-02T16:51:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63212024-12-02T16:51:49.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63222024-12-02T16:51:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63232024-12-02T16:51:49.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63242024-12-02T16:51:49.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63252024-12-02T16:51:49.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63262024-12-02T16:51:49.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63272024-12-02T16:51:49.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63282024-12-02T16:51:49.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63292024-12-02T16:51:49.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63302024-12-02T16:51:49.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63312024-12-02T16:51:49.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 427d757a-8438-44ab-85f2-b4b94326a479 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
63322024-12-02T16:51:49.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 427d757a-8438-44ab-85f2-b4b94326a479 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
63332024-12-02T16:51:49.806ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63342024-12-02T16:51:49.807ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63352024-12-02T16:51:49.807ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63362024-12-02T16:51:49.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63372024-12-02T16:51:49.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63382024-12-02T16:51:49.807ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63392024-12-02T16:51:49.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63402024-12-02T16:51:49.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
63412024-12-02T16:51:49.808ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.664959ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
63422024-12-02T16:51:49.808ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
63432024-12-02T16:51:49.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63442024-12-02T16:51:49.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
63452024-12-02T16:51:49.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63462024-12-02T16:51:49.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63472024-12-02T16:51:49.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63482024-12-02T16:51:49.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.658257ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
63492024-12-02T16:51:49.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63502024-12-02T16:51:49.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63512024-12-02T16:51:49.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63522024-12-02T16:51:49.812ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
63532024-12-02T16:51:49.812ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
63542024-12-02T16:51:49.812ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 17.523143ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
63552024-12-02T16:51:49.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.607283ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
63562024-12-02T16:51:49.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63572024-12-02T16:51:49.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63582024-12-02T16:51:49.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63592024-12-02T16:51:49.815ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63602024-12-02T16:51:49.815ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63612024-12-02T16:51:49.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63622024-12-02T16:51:49.816ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63632024-12-02T16:51:49.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63642024-12-02T16:51:49.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63652024-12-02T16:51:49.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63662024-12-02T16:51:49.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63672024-12-02T16:51:49.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63682024-12-02T16:51:49.818ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25871, tv_nsec: 554938964 } })
63692024-12-02T16:51:49.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 427d757a-8438-44ab-85f2-b4b94326a479 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
63702024-12-02T16:51:49.818ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
63712024-12-02T16:51:49.818ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63722024-12-02T16:51:49.818ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.871667ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63732024-12-02T16:51:49.819ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
63742024-12-02T16:51:49.819ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
63752024-12-02T16:51:49.819ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
63762024-12-02T16:51:49.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63772024-12-02T16:51:49.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63782024-12-02T16:51:49.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63792024-12-02T16:51:49.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63802024-12-02T16:51:49.824ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63812024-12-02T16:51:49.824ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63822024-12-02T16:51:49.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63832024-12-02T16:51:49.824ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63842024-12-02T16:51:49.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63852024-12-02T16:51:49.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63862024-12-02T16:51:49.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63872024-12-02T16:51:49.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63882024-12-02T16:51:49.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63892024-12-02T16:51:49.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63902024-12-02T16:51:49.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63912024-12-02T16:51:49.827ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63922024-12-02T16:51:49.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63932024-12-02T16:51:49.831ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63942024-12-02T16:51:49.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63952024-12-02T16:51:49.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63962024-12-02T16:51:49.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63972024-12-02T16:51:49.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.765174ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63982024-12-02T16:51:49.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63992024-12-02T16:51:49.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
64002024-12-02T16:51:49.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 58.734353ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
64012024-12-02T16:51:49.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64022024-12-02T16:51:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64032024-12-02T16:51:49.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.384429ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
64042024-12-02T16:51:49.861ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64052024-12-02T16:51:49.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64062024-12-02T16:51:49.863ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
64072024-12-02T16:51:49.863ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
64082024-12-02T16:51:49.863ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
64092024-12-02T16:51:49.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64102024-12-02T16:51:49.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64112024-12-02T16:51:49.864ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64122024-12-02T16:51:49.864ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
64132024-12-02T16:51:49.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64142024-12-02T16:51:49.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64152024-12-02T16:51:49.864ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64162024-12-02T16:51:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64172024-12-02T16:51:49.866ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64182024-12-02T16:51:49.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 72.792596ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
64192024-12-02T16:51:49.867ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64202024-12-02T16:51:49.867ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64212024-12-02T16:51:49.867ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 73.436272ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
64222024-12-02T16:51:49.870ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64232024-12-02T16:51:49.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64242024-12-02T16:51:49.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64252024-12-02T16:51:49.872ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
64262024-12-02T16:51:49.872ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
64272024-12-02T16:51:49.872ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.327624ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
64282024-12-02T16:51:49.872ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64292024-12-02T16:51:49.874ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64302024-12-02T16:51:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64312024-12-02T16:51:49.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64322024-12-02T16:51:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64332024-12-02T16:51:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
64342024-12-02T16:51:49.878ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64352024-12-02T16:51:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64362024-12-02T16:51:49.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64372024-12-02T16:51:49.883ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
64382024-12-02T16:51:49.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
64392024-12-02T16:51:49.883ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64402024-12-02T16:51:49.883ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64412024-12-02T16:51:49.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64422024-12-02T16:51:49.894ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
64432024-12-02T16:51:49.894ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.291207ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
64442024-12-02T16:51:49.895ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-02T16:43:45.642486Z, time_modified: 2024-12-02T16:43:45.642486Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }) }
64452024-12-02T16:51:49.895ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 101.714259ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]}},"default_endpoint":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64462024-12-02T16:51:49.903ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64472024-12-02T16:51:49.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
64482024-12-02T16:51:49.907ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64492024-12-02T16:51:49.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64502024-12-02T16:51:49.913ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
64512024-12-02T16:51:49.913ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 0 version = 2
64522024-12-02T16:51:49.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64532024-12-02T16:51:49.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64542024-12-02T16:51:49.917ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
64552024-12-02T16:51:49.919ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
64562024-12-02T16:51:49.919ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
64572024-12-02T16:51:49.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64582024-12-02T16:51:49.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64592024-12-02T16:51:49.921ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
64602024-12-02T16:51:49.934ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 140.606689ms iteration = 20 status = {"physical_disks_added":0}
64612024-12-02T16:51:49.935ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
64622024-12-02T16:51:49.935ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64632024-12-02T16:51:49.936ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fefb2f7-4593-430a-a06d-d100ea0dfada", "content-length": "26", "date": "Mon, 02 Dec 2024 16:51:49 GMT"} })
64642024-12-02T16:51:49.936ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64652024-12-02T16:51:49.938ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64662024-12-02T16:51:49.951ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64672024-12-02T16:51:49.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64682024-12-02T16:51:49.964ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
64692024-12-02T16:51:49.964ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64702024-12-02T16:51:49.964ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "26e5cb4a-3d0c-4cf8-8177-173d04d93766", "content-length": "26", "date": "Mon, 02 Dec 2024 16:51:49 GMT"} })
64712024-12-02T16:51:49.964ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64722024-12-02T16:51:49.967ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64732024-12-02T16:51:49.971ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
64742024-12-02T16:51:49.971ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64752024-12-02T16:51:49.971ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae42ba4a-0334-4686-b661-de6eb8204730", "content-length": "26", "date": "Mon, 02 Dec 2024 16:51:49 GMT"} })
64762024-12-02T16:51:49.971ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64772024-12-02T16:51:49.974ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
64782024-12-02T16:51:49.976ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
64792024-12-02T16:51:49.976ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 181.633568ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
64802024-12-02T16:51:50.080ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
64812024-12-02T16:51:50.080ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e0704a17-f2d1-4ecc-bf08-bee637a02bd8", "date": "Mon, 02 Dec 2024 16:51:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64822024-12-02T16:51:50.080ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64832024-12-02T16:51:50.082ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e3ce3188-7dd2-4efe-9ddd-ef152eba6ad4", "date": "Mon, 02 Dec 2024 16:51:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64842024-12-02T16:51:50.082ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64852024-12-02T16:51:50.083ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
64862024-12-02T16:51:50.083ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 289.465469ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
64872024-12-02T16:51:50.132ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 338.140335ms iteration = 17 status = {}
64882024-12-02T16:51:50.158ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64892024-12-02T16:51:50.158ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64902024-12-02T16:51:50.159ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6190409-45df-40c1-a984-266a93d0caf4", "content-length": "372", "date": "Mon, 02 Dec 2024 16:51:50 GMT"} })
64912024-12-02T16:51:50.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64922024-12-02T16:51:50.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64932024-12-02T16:51:50.161ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 366.520283ms iteration = 17 status = 0
64942024-12-02T16:51:50.161ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64952024-12-02T16:51:50.161ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64962024-12-02T16:51:50.161ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
64972024-12-02T16:51:50.162ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64982024-12-02T16:51:50.164ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64992024-12-02T16:51:50.164ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65002024-12-02T16:51:50.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
65012024-12-02T16:51:50.164ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65022024-12-02T16:51:50.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
65032024-12-02T16:51:50.164ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65042024-12-02T16:51:50.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65052024-12-02T16:51:50.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65062024-12-02T16:51:50.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65072024-12-02T16:51:50.165ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65082024-12-02T16:51:50.166ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
65092024-12-02T16:51:50.166ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
65102024-12-02T16:51:50.166ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-02 16:44:11.214841 UTC dns_group = internal generation = 1
65112024-12-02T16:51:50.166ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 372.817108ms iteration = 10 status = {"generation":1}
65122024-12-02T16:51:50.167ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 1 version = 2
65132024-12-02T16:51:50.167ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
65142024-12-02T16:51:50.167ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-02 16:44:12.116348 UTC dns_group = external generation = 2
65152024-12-02T16:51:50.167ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 373.12481ms iteration = 10 status = {"generation":2}
65162024-12-02T16:51:50.167ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65172024-12-02T16:51:50.167ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65182024-12-02T16:51:50.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65192024-12-02T16:51:50.203ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
65202024-12-02T16:51:50.203ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
65212024-12-02T16:51:50.203ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c660dcdb-9b2b-490b-bf99-76cd75ab760b", "date": "Mon, 02 Dec 2024 16:51:50 GMT"} })
65222024-12-02T16:51:50.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65232024-12-02T16:51:50.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65242024-12-02T16:51:50.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65252024-12-02T16:51:50.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65262024-12-02T16:51:50.206ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
65272024-12-02T16:51:50.207ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "810bd0cf-ff6e-430b-b9eb-aa1cd08eb90e", "content-length": "1", "date": "Mon, 02 Dec 2024 16:51:49 GMT"} })
65282024-12-02T16:51:50.208ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65292024-12-02T16:51:50.208ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65302024-12-02T16:51:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65312024-12-02T16:51:50.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65322024-12-02T16:51:50.211ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
65332024-12-02T16:51:50.211ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65342024-12-02T16:51:50.211ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d2187ff1-5990-46e6-9da5-a159b9c09095", "date": "Mon, 02 Dec 2024 16:51:50 GMT"} })
65352024-12-02T16:51:50.213ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 418.884011ms iteration = 18 status = {}
65362024-12-02T16:51:50.288ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65372024-12-02T16:51:50.288ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "71b02ad0-83b0-47c0-9eed-84855e56a1af", "content-length": "691", "date": "Mon, 02 Dec 2024 16:51:50 GMT"} })
65382024-12-02T16:51:50.288ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
65392024-12-02T16:51:50.288ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
65402024-12-02T16:51:50.288ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
65412024-12-02T16:51:50.290ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 496.304178ms iteration = 17 status = {}
65422024-12-02T16:51:50.290ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 496.64662ms iteration = 17 status = null
65432024-12-02T16:51:50.333ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
65442024-12-02T16:51:50.334ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a5880a82-2e0a-49a4-99ca-8ddce03fd867", "date": "Mon, 02 Dec 2024 16:51:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
65452024-12-02T16:51:50.334ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
65462024-12-02T16:51:50.336ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7f1ca4c9-976e-44fc-96b3-6c49e8808b2b", "date": "Mon, 02 Dec 2024 16:51:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
65472024-12-02T16:51:50.336ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
65482024-12-02T16:51:50.338ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a68c6f6b-7e01-4355-bdfb-6de635734c27", "date": "Mon, 02 Dec 2024 16:51:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
65492024-12-02T16:51:50.338ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
65502024-12-02T16:51:50.339ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
65512024-12-02T16:51:50.339ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 545.367917ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
65522024-12-02T16:51:50.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65532024-12-02T16:51:50.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65542024-12-02T16:51:50.382ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
65552024-12-02T16:51:50.382ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65562024-12-02T16:51:50.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65572024-12-02T16:51:50.392ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
65582024-12-02T16:51:50.392ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7532b2ad-b4be-430b-accd-a18ef1a2e51d", "content-length": "134", "date": "Mon, 02 Dec 2024 16:51:49 GMT"} })
65592024-12-02T16:51:50.392ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
65602024-12-02T16:51:50.392ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
65612024-12-02T16:51:50.392ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
65622024-12-02T16:51:50.393ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
65632024-12-02T16:51:50.393ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65642024-12-02T16:51:50.393ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65652024-12-02T16:51:50.393ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65662024-12-02T16:51:50.393ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65672024-12-02T16:51:50.393ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65682024-12-02T16:51:50.393ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65692024-12-02T16:51:50.393ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
65702024-12-02T16:51:50.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65712024-12-02T16:51:50.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65722024-12-02T16:51:50.395ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65732024-12-02T16:51:50.395ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd44e9e0-ddc0-4e72-801a-ed506e51a904", "content-length": "2", "date": "Mon, 02 Dec 2024 16:51:49 GMT"} })
65742024-12-02T16:51:50.395ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65752024-12-02T16:51:50.395ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7369f64a-0f60-4e67-9305-300396c6d382", "content-length": "52", "date": "Mon, 02 Dec 2024 16:51:49 GMT"} })
65762024-12-02T16:51:50.395ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
65772024-12-02T16:51:50.395ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
65782024-12-02T16:51:50.484ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "db4e92fa-6c09-4a14-90ab-87d3311026dd", "date": "Mon, 02 Dec 2024 16:51:50 GMT"} })
65792024-12-02T16:51:50.484ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
65802024-12-02T16:51:50.484ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65812024-12-02T16:51:50.484ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddf58f6f-04a7-4d34-9687-a1905c516973", "content-length": "682", "date": "Mon, 02 Dec 2024 16:51:50 GMT"} })
65822024-12-02T16:51:50.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65832024-12-02T16:51:50.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65842024-12-02T16:51:50.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65852024-12-02T16:51:50.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65862024-12-02T16:51:50.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65872024-12-02T16:51:50.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65882024-12-02T16:51:50.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65892024-12-02T16:51:50.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65902024-12-02T16:51:50.501ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 707.171541ms iteration = 17 status = {}
65912024-12-02T16:51:50.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7c9d0b36-d0cb-4a21-b1c4-375ca4cada2f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
65922024-12-02T16:51:50.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7c9d0b36-d0cb-4a21-b1c4-375ca4cada2f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
65932024-12-02T16:51:50.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7c9d0b36-d0cb-4a21-b1c4-375ca4cada2f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
65942024-12-02T16:51:51.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fdb48adb-efe7-4dc5-87ce-af52155af17f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
65952024-12-02T16:51:51.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fdb48adb-efe7-4dc5-87ce-af52155af17f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
65962024-12-02T16:51:51.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fdb48adb-efe7-4dc5-87ce-af52155af17f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
65972024-12-02T16:51:52.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a2802ce2-0d6e-43ae-aff4-e2a48b5704d4 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
65982024-12-02T16:51:52.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a2802ce2-0d6e-43ae-aff4-e2a48b5704d4 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
65992024-12-02T16:51:52.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1781 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a2802ce2-0d6e-43ae-aff4-e2a48b5704d4 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66002024-12-02T16:51:53.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 85af1887-9a76-4ade-81e0-d007888cef87 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66012024-12-02T16:51:53.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 85af1887-9a76-4ade-81e0-d007888cef87 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66022024-12-02T16:51:53.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 85af1887-9a76-4ade-81e0-d007888cef87 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66032024-12-02T16:51:54.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 73d1b845-805a-4d59-89f0-596d950a6a01 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66042024-12-02T16:51:54.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 73d1b845-805a-4d59-89f0-596d950a6a01 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66052024-12-02T16:51:54.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 73d1b845-805a-4d59-89f0-596d950a6a01 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66062024-12-02T16:51:55.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 13f2e1f6-e3fa-42e5-b5fd-ba2ced84edbb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66072024-12-02T16:51:55.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 13f2e1f6-e3fa-42e5-b5fd-ba2ced84edbb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66082024-12-02T16:51:55.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 13f2e1f6-e3fa-42e5-b5fd-ba2ced84edbb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66092024-12-02T16:51:56.556ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1478 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = cdcb463f-c67c-4dbb-ba96-5bcd76766c58 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
66102024-12-02T16:51:56.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 672bb795-c2fd-417d-bef2-1e1e1c8ccff9 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66112024-12-02T16:51:56.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 672bb795-c2fd-417d-bef2-1e1e1c8ccff9 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66122024-12-02T16:51:56.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1693 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 672bb795-c2fd-417d-bef2-1e1e1c8ccff9 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66132024-12-02T16:51:57.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d1e23502-3ae3-401b-a4d8-262cd7982ce7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66142024-12-02T16:51:57.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d1e23502-3ae3-401b-a4d8-262cd7982ce7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66152024-12-02T16:51:57.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d1e23502-3ae3-401b-a4d8-262cd7982ce7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66162024-12-02T16:51:59.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d4256a22-f88d-4f5b-a9e7-c936f3ff7f6a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66172024-12-02T16:51:59.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d4256a22-f88d-4f5b-a9e7-c936f3ff7f6a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66182024-12-02T16:51:59.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d4256a22-f88d-4f5b-a9e7-c936f3ff7f6a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66192024-12-02T16:51:59.794ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
66202024-12-02T16:51:59.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66212024-12-02T16:51:59.794ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
66222024-12-02T16:51:59.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66232024-12-02T16:51:59.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66242024-12-02T16:51:59.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66252024-12-02T16:51:59.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66262024-12-02T16:51:59.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66272024-12-02T16:51:59.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66282024-12-02T16:51:59.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.322058ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66292024-12-02T16:51:59.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66302024-12-02T16:51:59.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66312024-12-02T16:51:59.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66322024-12-02T16:51:59.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66332024-12-02T16:51:59.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66342024-12-02T16:51:59.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66352024-12-02T16:51:59.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
66362024-12-02T16:51:59.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66372024-12-02T16:51:59.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66382024-12-02T16:51:59.814ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
66392024-12-02T16:51:59.814ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.794343ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
66402024-12-02T16:52:00.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 77a34c39-5af4-40cb-9fcd-16dd626d41bc roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66412024-12-02T16:52:00.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 77a34c39-5af4-40cb-9fcd-16dd626d41bc resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66422024-12-02T16:52:00.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 77a34c39-5af4-40cb-9fcd-16dd626d41bc response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66432024-12-02T16:52:01.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = da2ff962-9ec1-429b-856b-5de222ab987a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66442024-12-02T16:52:01.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = da2ff962-9ec1-429b-856b-5de222ab987a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66452024-12-02T16:52:01.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = da2ff962-9ec1-429b-856b-5de222ab987a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66462024-12-02T16:52:01.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 21892e59-ccc6-439e-b1ea-3591ee31ce3e roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
66472024-12-02T16:52:01.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 21892e59-ccc6-439e-b1ea-3591ee31ce3e resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
66482024-12-02T16:52:01.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2690 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 21892e59-ccc6-439e-b1ea-3591ee31ce3e response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
66492024-12-02T16:52:01.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 241b1dab-4380-44be-a4a9-a400ff2ba9e7 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
66502024-12-02T16:52:01.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 241b1dab-4380-44be-a4a9-a400ff2ba9e7 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
66512024-12-02T16:52:01.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 241b1dab-4380-44be-a4a9-a400ff2ba9e7 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
66522024-12-02T16:52:02.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1e7b57fe-320d-4f0b-bdc5-f724493a0740 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66532024-12-02T16:52:02.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1e7b57fe-320d-4f0b-bdc5-f724493a0740 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66542024-12-02T16:52:02.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1e7b57fe-320d-4f0b-bdc5-f724493a0740 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66552024-12-02T16:52:03.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3183025e-e629-4fc0-a842-48e7d5c4272e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66562024-12-02T16:52:03.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3183025e-e629-4fc0-a842-48e7d5c4272e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66572024-12-02T16:52:03.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3183025e-e629-4fc0-a842-48e7d5c4272e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66582024-12-02T16:52:04.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f2d2d5f5-e113-4e4e-8cc0-516f0fddbe4d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66592024-12-02T16:52:04.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f2d2d5f5-e113-4e4e-8cc0-516f0fddbe4d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66602024-12-02T16:52:04.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f2d2d5f5-e113-4e4e-8cc0-516f0fddbe4d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66612024-12-02T16:52:05.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9515fb52-5427-47f2-b255-62cc38dc5f30 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66622024-12-02T16:52:05.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9515fb52-5427-47f2-b255-62cc38dc5f30 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66632024-12-02T16:52:05.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9515fb52-5427-47f2-b255-62cc38dc5f30 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66642024-12-02T16:52:06.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ac1ac2a1-7bfb-4bc2-867e-e7d1681ff581 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66652024-12-02T16:52:06.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ac1ac2a1-7bfb-4bc2-867e-e7d1681ff581 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66662024-12-02T16:52:06.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ac1ac2a1-7bfb-4bc2-867e-e7d1681ff581 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66672024-12-02T16:52:06.557ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1739 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = e4dfd29b-6a5d-42a3-82ae-30f945f33e62 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
66682024-12-02T16:52:07.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 127dbbb1-bd36-454d-b095-19eee7e7fa68 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66692024-12-02T16:52:07.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 127dbbb1-bd36-454d-b095-19eee7e7fa68 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66702024-12-02T16:52:07.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 127dbbb1-bd36-454d-b095-19eee7e7fa68 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66712024-12-02T16:52:08.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6b3499c6-a371-43fe-91dd-75244966f973 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66722024-12-02T16:52:08.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6b3499c6-a371-43fe-91dd-75244966f973 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66732024-12-02T16:52:08.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6b3499c6-a371-43fe-91dd-75244966f973 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66742024-12-02T16:52:09.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8898ab05-1495-469d-b96a-60a588914478 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66752024-12-02T16:52:09.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8898ab05-1495-469d-b96a-60a588914478 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66762024-12-02T16:52:09.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8898ab05-1495-469d-b96a-60a588914478 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66772024-12-02T16:52:09.793ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
66782024-12-02T16:52:09.793ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
66792024-12-02T16:52:09.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66802024-12-02T16:52:09.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66812024-12-02T16:52:09.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66822024-12-02T16:52:09.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66832024-12-02T16:52:09.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66842024-12-02T16:52:09.798ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66852024-12-02T16:52:09.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66862024-12-02T16:52:09.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66872024-12-02T16:52:09.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66882024-12-02T16:52:09.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66892024-12-02T16:52:09.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66902024-12-02T16:52:09.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
66912024-12-02T16:52:09.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66922024-12-02T16:52:09.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66932024-12-02T16:52:09.813ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
66942024-12-02T16:52:09.813ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.742482ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
66952024-12-02T16:52:09.822ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66962024-12-02T16:52:09.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66972024-12-02T16:52:09.824ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.220904ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66982024-12-02T16:52:10.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 094c0fff-c6f2-412c-a78b-41e6d22bdbee roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
66992024-12-02T16:52:10.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 094c0fff-c6f2-412c-a78b-41e6d22bdbee resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67002024-12-02T16:52:10.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 094c0fff-c6f2-412c-a78b-41e6d22bdbee response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67012024-12-02T16:52:11.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 765352a6-6c03-4b4b-9cad-01257b22f6f5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67022024-12-02T16:52:11.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 765352a6-6c03-4b4b-9cad-01257b22f6f5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67032024-12-02T16:52:11.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 765352a6-6c03-4b4b-9cad-01257b22f6f5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67042024-12-02T16:52:12.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c8885a86-7366-4680-8f9a-e1b9aeb9229e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67052024-12-02T16:52:12.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c8885a86-7366-4680-8f9a-e1b9aeb9229e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67062024-12-02T16:52:12.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c8885a86-7366-4680-8f9a-e1b9aeb9229e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67072024-12-02T16:52:13.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2973e5bb-6d27-45b2-aeb4-2099f9556d51 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67082024-12-02T16:52:13.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2973e5bb-6d27-45b2-aeb4-2099f9556d51 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67092024-12-02T16:52:13.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2973e5bb-6d27-45b2-aeb4-2099f9556d51 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67102024-12-02T16:52:14.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cdf4a861-f874-49cf-86c4-e37592dd53d2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67112024-12-02T16:52:14.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cdf4a861-f874-49cf-86c4-e37592dd53d2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67122024-12-02T16:52:14.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cdf4a861-f874-49cf-86c4-e37592dd53d2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67132024-12-02T16:52:15.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b7774345-4d7f-441f-b157-48e6212a8894 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67142024-12-02T16:52:15.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b7774345-4d7f-441f-b157-48e6212a8894 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67152024-12-02T16:52:15.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1742 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b7774345-4d7f-441f-b157-48e6212a8894 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67162024-12-02T16:52:16.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 07f93d70-bdc4-4c2c-9cec-fb27e9de5459 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67172024-12-02T16:52:16.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 07f93d70-bdc4-4c2c-9cec-fb27e9de5459 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67182024-12-02T16:52:16.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 07f93d70-bdc4-4c2c-9cec-fb27e9de5459 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67192024-12-02T16:52:16.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = c0cb5d84-a087-4df2-87c8-391a21f14b06 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
67202024-12-02T16:52:16.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = c0cb5d84-a087-4df2-87c8-391a21f14b06 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
67212024-12-02T16:52:16.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = c0cb5d84-a087-4df2-87c8-391a21f14b06 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
67222024-12-02T16:52:16.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 5bbaa413-759f-4874-bf16-df1a86a70c35 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
67232024-12-02T16:52:16.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 5bbaa413-759f-4874-bf16-df1a86a70c35 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
67242024-12-02T16:52:16.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36178 req_id = 5bbaa413-759f-4874-bf16-df1a86a70c35 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
67252024-12-02T16:52:16.557ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1532 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 8e5c19d0-f982-4cd7-91cf-64926927a76c response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
67262024-12-02T16:52:17.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1bd1efbe-f098-4b08-b95e-2cdf0d5630bc roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67272024-12-02T16:52:17.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1bd1efbe-f098-4b08-b95e-2cdf0d5630bc resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67282024-12-02T16:52:17.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1bd1efbe-f098-4b08-b95e-2cdf0d5630bc response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67292024-12-02T16:52:18.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3025cf50-1b8a-40df-b458-67c6f2c2bcda roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67302024-12-02T16:52:18.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3025cf50-1b8a-40df-b458-67c6f2c2bcda resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67312024-12-02T16:52:18.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3025cf50-1b8a-40df-b458-67c6f2c2bcda response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67322024-12-02T16:52:19.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = be2dc01b-21a9-4091-b07d-e1372496d098 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67332024-12-02T16:52:19.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = be2dc01b-21a9-4091-b07d-e1372496d098 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67342024-12-02T16:52:19.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = be2dc01b-21a9-4091-b07d-e1372496d098 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
67352024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
67362024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
67372024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67382024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67392024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67402024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
67412024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
67422024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67432024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
67442024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67452024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
67462024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67472024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67482024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
67492024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
67502024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67512024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
67522024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
67532024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
67542024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
67552024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67562024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67572024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67582024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67592024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67602024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67612024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67622024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67632024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67642024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67652024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67662024-12-02T16:52:19.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67672024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
67682024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
67692024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
67702024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67712024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
67722024-12-02T16:52:19.795ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67732024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
67742024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67752024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67762024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
67772024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67782024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
67792024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67802024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67812024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67822024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67832024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67842024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67852024-12-02T16:52:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67862024-12-02T16:52:19.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67872024-12-02T16:52:19.797ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67882024-12-02T16:52:19.797ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
67892024-12-02T16:52:19.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67902024-12-02T16:52:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67912024-12-02T16:52:19.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67922024-12-02T16:52:19.798ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.202756ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67932024-12-02T16:52:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67942024-12-02T16:52:19.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67952024-12-02T16:52:19.798ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25901, tv_nsec: 534989709 } })
67962024-12-02T16:52:19.799ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
67972024-12-02T16:52:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67982024-12-02T16:52:19.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67992024-12-02T16:52:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68002024-12-02T16:52:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
68012024-12-02T16:52:19.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68022024-12-02T16:52:19.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68032024-12-02T16:52:19.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68042024-12-02T16:52:19.802ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25901, tv_nsec: 538911274 } })
68052024-12-02T16:52:19.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68062024-12-02T16:52:19.803ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
68072024-12-02T16:52:19.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68082024-12-02T16:52:19.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
68092024-12-02T16:52:19.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68102024-12-02T16:52:19.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68112024-12-02T16:52:19.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68122024-12-02T16:52:19.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68132024-12-02T16:52:19.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68142024-12-02T16:52:19.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
68152024-12-02T16:52:19.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68162024-12-02T16:52:19.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68172024-12-02T16:52:19.807ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68182024-12-02T16:52:19.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68192024-12-02T16:52:19.807ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68202024-12-02T16:52:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68212024-12-02T16:52:19.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68222024-12-02T16:52:19.809ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68232024-12-02T16:52:19.809ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68242024-12-02T16:52:19.809ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68252024-12-02T16:52:19.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68262024-12-02T16:52:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68272024-12-02T16:52:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68282024-12-02T16:52:19.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68292024-12-02T16:52:19.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68302024-12-02T16:52:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68312024-12-02T16:52:19.813ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25901, tv_nsec: 549034432 } })
68322024-12-02T16:52:19.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68332024-12-02T16:52:19.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 17.892287ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
68342024-12-02T16:52:19.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 394c7f86-bb47-4b70-85e4-e507b29b7eb8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
68352024-12-02T16:52:19.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
68362024-12-02T16:52:19.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68372024-12-02T16:52:19.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 394c7f86-bb47-4b70-85e4-e507b29b7eb8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
68382024-12-02T16:52:19.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68392024-12-02T16:52:19.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68402024-12-02T16:52:19.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68412024-12-02T16:52:19.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68422024-12-02T16:52:19.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 394c7f86-bb47-4b70-85e4-e507b29b7eb8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
68432024-12-02T16:52:19.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68442024-12-02T16:52:19.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68452024-12-02T16:52:19.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68462024-12-02T16:52:19.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68472024-12-02T16:52:19.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68482024-12-02T16:52:19.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68492024-12-02T16:52:19.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68502024-12-02T16:52:19.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68512024-12-02T16:52:19.843ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.159241ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
68522024-12-02T16:52:19.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68532024-12-02T16:52:19.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68542024-12-02T16:52:19.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68552024-12-02T16:52:19.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68562024-12-02T16:52:19.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68572024-12-02T16:52:19.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68582024-12-02T16:52:19.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.124984ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
68592024-12-02T16:52:19.848ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68602024-12-02T16:52:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68612024-12-02T16:52:19.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68622024-12-02T16:52:19.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 56.907198ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
68632024-12-02T16:52:19.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
68642024-12-02T16:52:19.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68652024-12-02T16:52:19.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.036496ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68662024-12-02T16:52:19.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68672024-12-02T16:52:19.854ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68682024-12-02T16:52:19.854ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68692024-12-02T16:52:19.854ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 60.6964ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68702024-12-02T16:52:19.855ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 60.138215ms iteration = 18 status = 0
68712024-12-02T16:52:19.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68722024-12-02T16:52:19.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68732024-12-02T16:52:19.857ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68742024-12-02T16:52:19.857ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.974781ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68752024-12-02T16:52:19.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68762024-12-02T16:52:19.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68772024-12-02T16:52:19.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68782024-12-02T16:52:19.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68792024-12-02T16:52:19.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68802024-12-02T16:52:19.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
68812024-12-02T16:52:19.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68822024-12-02T16:52:19.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68832024-12-02T16:52:19.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68842024-12-02T16:52:19.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68852024-12-02T16:52:19.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68862024-12-02T16:52:19.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68872024-12-02T16:52:19.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
68882024-12-02T16:52:19.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.836724ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
68892024-12-02T16:52:19.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.694746ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68902024-12-02T16:52:19.888ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
68912024-12-02T16:52:19.888ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68922024-12-02T16:52:19.888ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "370d9cbd-bcc9-4290-a9d4-84f46fdeb033", "content-length": "26", "date": "Mon, 02 Dec 2024 16:52:19 GMT"} })
68932024-12-02T16:52:19.888ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68942024-12-02T16:52:19.890ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68952024-12-02T16:52:19.898ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
68962024-12-02T16:52:19.898ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68972024-12-02T16:52:19.899ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6661d0d-604b-4bcc-8497-57143b382fe8", "content-length": "26", "date": "Mon, 02 Dec 2024 16:52:19 GMT"} })
68982024-12-02T16:52:19.899ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68992024-12-02T16:52:19.900ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69002024-12-02T16:52:19.913ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
69012024-12-02T16:52:19.913ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69022024-12-02T16:52:19.913ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "22d95b35-be0a-4186-b4d6-519c59d9a584", "content-length": "26", "date": "Mon, 02 Dec 2024 16:52:19 GMT"} })
69032024-12-02T16:52:19.913ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69042024-12-02T16:52:19.914ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
69052024-12-02T16:52:19.918ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 124.628389ms iteration = 21 status = {"physical_disks_added":0}
69062024-12-02T16:52:19.981ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69072024-12-02T16:52:19.982ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b15b2b04-9ece-4f54-9acf-326cbdd2f732", "content-length": "691", "date": "Mon, 02 Dec 2024 16:52:19 GMT"} })
69082024-12-02T16:52:19.982ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
69092024-12-02T16:52:19.982ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
69102024-12-02T16:52:19.982ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
69112024-12-02T16:52:19.983ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 189.506577ms iteration = 18 status = {}
69122024-12-02T16:52:20.005ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
69132024-12-02T16:52:20.005ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "be6c29d2-b052-40e9-aa2f-994f7d0ae03b", "content-length": "1", "date": "Mon, 02 Dec 2024 16:52:19 GMT"} })
69142024-12-02T16:52:20.007ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69152024-12-02T16:52:20.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69162024-12-02T16:52:20.104ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
69172024-12-02T16:52:20.104ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69182024-12-02T16:52:20.104ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e4163bc-157a-4325-8a80-42dd59401099", "content-length": "372", "date": "Mon, 02 Dec 2024 16:52:19 GMT"} })
69192024-12-02T16:52:20.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69202024-12-02T16:52:20.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69212024-12-02T16:52:20.106ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 312.000907ms iteration = 18 status = null
69222024-12-02T16:52:20.107ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 313.279288ms iteration = 18 status = {}
69232024-12-02T16:52:20.137ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69242024-12-02T16:52:20.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69252024-12-02T16:52:20.139ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
69262024-12-02T16:52:20.139ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69272024-12-02T16:52:20.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69282024-12-02T16:52:20.147ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
69292024-12-02T16:52:20.147ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69302024-12-02T16:52:20.147ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2a910a3a-4d65-4cfa-aed6-24c79984d113", "date": "Mon, 02 Dec 2024 16:52:19 GMT"} })
69312024-12-02T16:52:20.147ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69322024-12-02T16:52:20.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69332024-12-02T16:52:20.148ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
69342024-12-02T16:52:20.148ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bec92f47-70c5-4c9a-80c9-d6b3c47232e8", "content-length": "134", "date": "Mon, 02 Dec 2024 16:52:19 GMT"} })
69352024-12-02T16:52:20.148ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
69362024-12-02T16:52:20.148ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
69372024-12-02T16:52:20.148ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69382024-12-02T16:52:20.148ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69392024-12-02T16:52:20.148ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69402024-12-02T16:52:20.148ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69412024-12-02T16:52:20.148ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69422024-12-02T16:52:20.148ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69432024-12-02T16:52:20.149ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69442024-12-02T16:52:20.149ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69452024-12-02T16:52:20.149ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
69462024-12-02T16:52:20.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69472024-12-02T16:52:20.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69482024-12-02T16:52:20.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69492024-12-02T16:52:20.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69502024-12-02T16:52:20.151ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
69512024-12-02T16:52:20.151ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a6d3eec-da47-4a20-b0f5-648af011835e", "content-length": "2", "date": "Mon, 02 Dec 2024 16:52:19 GMT"} })
69522024-12-02T16:52:20.151ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69532024-12-02T16:52:20.151ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2670d0ce-32aa-4ca8-8514-d0ab4d017ab3", "content-length": "52", "date": "Mon, 02 Dec 2024 16:52:19 GMT"} })
69542024-12-02T16:52:20.151ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
69552024-12-02T16:52:20.151ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69562024-12-02T16:52:20.152ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69572024-12-02T16:52:20.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69582024-12-02T16:52:20.156ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
69592024-12-02T16:52:20.156ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69602024-12-02T16:52:20.237ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "466ab341-dbc0-4f49-ad1c-c18d3d312fc7", "date": "Mon, 02 Dec 2024 16:52:19 GMT"} })
69612024-12-02T16:52:20.237ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
69622024-12-02T16:52:20.237ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69632024-12-02T16:52:20.237ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c3244e9e-e167-4410-a6b4-f3e02ee792f3", "date": "Mon, 02 Dec 2024 16:52:19 GMT"} })
69642024-12-02T16:52:20.239ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 444.487185ms iteration = 19 status = {}
69652024-12-02T16:52:20.239ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f0638f7-fbcc-44a6-91cd-21713a3d32bd", "content-length": "682", "date": "Mon, 02 Dec 2024 16:52:19 GMT"} })
69662024-12-02T16:52:20.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69672024-12-02T16:52:20.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69682024-12-02T16:52:20.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69692024-12-02T16:52:20.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69702024-12-02T16:52:20.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69712024-12-02T16:52:20.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69722024-12-02T16:52:20.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69732024-12-02T16:52:20.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69742024-12-02T16:52:20.256ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 462.030078ms iteration = 18 status = {}
69752024-12-02T16:52:20.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 28820cd9-d778-49e8-b8c7-2b088ece0f58 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69762024-12-02T16:52:20.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 28820cd9-d778-49e8-b8c7-2b088ece0f58 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69772024-12-02T16:52:20.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 28820cd9-d778-49e8-b8c7-2b088ece0f58 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69782024-12-02T16:52:21.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5f0d8321-cee4-48d1-94e2-c29dcc21f6b9 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69792024-12-02T16:52:21.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5f0d8321-cee4-48d1-94e2-c29dcc21f6b9 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69802024-12-02T16:52:21.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1804 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5f0d8321-cee4-48d1-94e2-c29dcc21f6b9 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69812024-12-02T16:52:22.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9c00ff60-7f7a-4cde-aa94-75b34f5fd0e2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69822024-12-02T16:52:22.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9c00ff60-7f7a-4cde-aa94-75b34f5fd0e2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69832024-12-02T16:52:22.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9c00ff60-7f7a-4cde-aa94-75b34f5fd0e2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69842024-12-02T16:52:23.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e62ef75b-8a08-4bc5-80e8-cfeb8e171d5f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69852024-12-02T16:52:23.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e62ef75b-8a08-4bc5-80e8-cfeb8e171d5f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69862024-12-02T16:52:23.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e62ef75b-8a08-4bc5-80e8-cfeb8e171d5f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69872024-12-02T16:52:24.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fe8a7888-a23b-4d0d-89db-49cc2d3aad06 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69882024-12-02T16:52:24.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fe8a7888-a23b-4d0d-89db-49cc2d3aad06 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69892024-12-02T16:52:24.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fe8a7888-a23b-4d0d-89db-49cc2d3aad06 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69902024-12-02T16:52:25.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 862cfb21-2482-478c-b276-206adf98cc88 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69912024-12-02T16:52:25.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 862cfb21-2482-478c-b276-206adf98cc88 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69922024-12-02T16:52:25.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 862cfb21-2482-478c-b276-206adf98cc88 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69932024-12-02T16:52:26.557ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1314 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 3ff4025b-51fd-43ee-9823-26465ed19b67 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
69942024-12-02T16:52:26.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = acf8ede9-2219-49be-a77f-2383f2522e68 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69952024-12-02T16:52:26.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = acf8ede9-2219-49be-a77f-2383f2522e68 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69962024-12-02T16:52:26.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2535 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = acf8ede9-2219-49be-a77f-2383f2522e68 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69972024-12-02T16:52:27.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9b0ce2bd-56dd-4095-8bd4-95c59edbe526 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69982024-12-02T16:52:27.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9b0ce2bd-56dd-4095-8bd4-95c59edbe526 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
69992024-12-02T16:52:27.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9b0ce2bd-56dd-4095-8bd4-95c59edbe526 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70002024-12-02T16:52:28.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cdcc4b0a-7083-4aa1-a62e-c727ca47fcf2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70012024-12-02T16:52:28.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cdcc4b0a-7083-4aa1-a62e-c727ca47fcf2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70022024-12-02T16:52:28.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cdcc4b0a-7083-4aa1-a62e-c727ca47fcf2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70032024-12-02T16:52:29.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 010fdf21-0a23-4b57-8269-bb2280b60e2e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70042024-12-02T16:52:29.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 010fdf21-0a23-4b57-8269-bb2280b60e2e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70052024-12-02T16:52:29.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 010fdf21-0a23-4b57-8269-bb2280b60e2e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70062024-12-02T16:52:29.794ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
70072024-12-02T16:52:29.794ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
70082024-12-02T16:52:29.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70092024-12-02T16:52:29.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70102024-12-02T16:52:29.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70112024-12-02T16:52:29.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70122024-12-02T16:52:29.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70132024-12-02T16:52:29.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70142024-12-02T16:52:29.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70152024-12-02T16:52:29.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.081426ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70162024-12-02T16:52:29.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70172024-12-02T16:52:29.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70182024-12-02T16:52:29.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70192024-12-02T16:52:29.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70202024-12-02T16:52:29.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70212024-12-02T16:52:29.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70222024-12-02T16:52:29.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
70232024-12-02T16:52:29.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70242024-12-02T16:52:29.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70252024-12-02T16:52:29.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
70262024-12-02T16:52:29.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.465829ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
70272024-12-02T16:52:30.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e51217fb-bb42-4bbe-9967-fae373188756 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70282024-12-02T16:52:30.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e51217fb-bb42-4bbe-9967-fae373188756 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70292024-12-02T16:52:30.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e51217fb-bb42-4bbe-9967-fae373188756 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70302024-12-02T16:52:31.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 60ff5a1e-e45c-4423-898b-157137a3245d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70312024-12-02T16:52:31.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 60ff5a1e-e45c-4423-898b-157137a3245d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70322024-12-02T16:52:31.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 60ff5a1e-e45c-4423-898b-157137a3245d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70332024-12-02T16:52:32.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 016aee5e-6ac7-4c39-9570-14131089e324 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70342024-12-02T16:52:32.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 016aee5e-6ac7-4c39-9570-14131089e324 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70352024-12-02T16:52:32.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 016aee5e-6ac7-4c39-9570-14131089e324 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70362024-12-02T16:52:33.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = aaa4b291-875a-40ba-861e-fbaa3a2ac594 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70372024-12-02T16:52:33.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = aaa4b291-875a-40ba-861e-fbaa3a2ac594 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70382024-12-02T16:52:33.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = aaa4b291-875a-40ba-861e-fbaa3a2ac594 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70392024-12-02T16:52:34.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e39fac16-635f-4b38-acc5-8d4d96580aee roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70402024-12-02T16:52:34.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e39fac16-635f-4b38-acc5-8d4d96580aee resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70412024-12-02T16:52:34.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e39fac16-635f-4b38-acc5-8d4d96580aee response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70422024-12-02T16:52:35.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7833dbd6-c989-4406-8141-cee389d468e1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70432024-12-02T16:52:35.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7833dbd6-c989-4406-8141-cee389d468e1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70442024-12-02T16:52:35.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7833dbd6-c989-4406-8141-cee389d468e1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70452024-12-02T16:52:36.558ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = a814674b-a036-4eac-8328-361112b1f47a response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
70462024-12-02T16:52:36.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4446f99b-4e87-4283-b056-ede28f3121f7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70472024-12-02T16:52:36.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4446f99b-4e87-4283-b056-ede28f3121f7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70482024-12-02T16:52:36.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1807 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4446f99b-4e87-4283-b056-ede28f3121f7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70492024-12-02T16:52:37.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5e60cd71-832c-4aaa-9ecc-ae795fdaf3b1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70502024-12-02T16:52:37.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5e60cd71-832c-4aaa-9ecc-ae795fdaf3b1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70512024-12-02T16:52:37.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5e60cd71-832c-4aaa-9ecc-ae795fdaf3b1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70522024-12-02T16:52:38.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5ad5fd44-f27e-48d7-bc67-8fb8b71659ed roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70532024-12-02T16:52:38.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5ad5fd44-f27e-48d7-bc67-8fb8b71659ed resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70542024-12-02T16:52:38.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5ad5fd44-f27e-48d7-bc67-8fb8b71659ed response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70552024-12-02T16:52:39.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
70562024-12-02T16:52:39.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
70572024-12-02T16:52:39.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70582024-12-02T16:52:39.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70592024-12-02T16:52:39.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70602024-12-02T16:52:39.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70612024-12-02T16:52:39.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70622024-12-02T16:52:39.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70632024-12-02T16:52:39.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70642024-12-02T16:52:39.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70652024-12-02T16:52:39.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70662024-12-02T16:52:39.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70672024-12-02T16:52:39.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.933093ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70682024-12-02T16:52:39.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70692024-12-02T16:52:39.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70702024-12-02T16:52:39.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70712024-12-02T16:52:39.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
70722024-12-02T16:52:39.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70732024-12-02T16:52:39.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70742024-12-02T16:52:39.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
70752024-12-02T16:52:39.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.115736ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
70762024-12-02T16:52:39.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c55cab25-3e85-400a-82b5-15db179ec97c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70772024-12-02T16:52:39.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c55cab25-3e85-400a-82b5-15db179ec97c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70782024-12-02T16:52:39.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c55cab25-3e85-400a-82b5-15db179ec97c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70792024-12-02T16:52:40.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dbc7af93-760a-4fa4-8026-9f4fb1420078 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70802024-12-02T16:52:40.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dbc7af93-760a-4fa4-8026-9f4fb1420078 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70812024-12-02T16:52:40.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dbc7af93-760a-4fa4-8026-9f4fb1420078 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70822024-12-02T16:52:41.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 22867526-870c-45a0-b510-46eab9bd301a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70832024-12-02T16:52:41.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 22867526-870c-45a0-b510-46eab9bd301a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70842024-12-02T16:52:42.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 22867526-870c-45a0-b510-46eab9bd301a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70852024-12-02T16:52:43.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a3f763f2-6248-4aa5-9bd9-e88ccf27f922 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70862024-12-02T16:52:43.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a3f763f2-6248-4aa5-9bd9-e88ccf27f922 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70872024-12-02T16:52:43.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a3f763f2-6248-4aa5-9bd9-e88ccf27f922 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70882024-12-02T16:52:44.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1abc20ff-b33a-42e6-ae22-98fb8b25b33a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70892024-12-02T16:52:44.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1abc20ff-b33a-42e6-ae22-98fb8b25b33a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70902024-12-02T16:52:44.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1abc20ff-b33a-42e6-ae22-98fb8b25b33a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70912024-12-02T16:52:45.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1ecd8469-95f4-4451-8b75-991b5b2473ec roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70922024-12-02T16:52:45.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1ecd8469-95f4-4451-8b75-991b5b2473ec resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70932024-12-02T16:52:45.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1ecd8469-95f4-4451-8b75-991b5b2473ec response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70942024-12-02T16:52:46.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d4ff198f-cc6d-4313-8f58-705e9ad9b0e2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70952024-12-02T16:52:46.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d4ff198f-cc6d-4313-8f58-705e9ad9b0e2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70962024-12-02T16:52:46.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d4ff198f-cc6d-4313-8f58-705e9ad9b0e2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70972024-12-02T16:52:46.558ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1368 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 0d90259b-d7c4-46a8-a986-bc3e62268d2f response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
70982024-12-02T16:52:47.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6bee7e36-ca10-45c9-9199-7cc8ceeea8da roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
70992024-12-02T16:52:47.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6bee7e36-ca10-45c9-9199-7cc8ceeea8da resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
71002024-12-02T16:52:47.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6bee7e36-ca10-45c9-9199-7cc8ceeea8da response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
71012024-12-02T16:52:48.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = beca9d23-b598-4bae-8f28-db276cad7d1b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
71022024-12-02T16:52:48.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = beca9d23-b598-4bae-8f28-db276cad7d1b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
71032024-12-02T16:52:48.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = beca9d23-b598-4bae-8f28-db276cad7d1b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
71042024-12-02T16:52:49.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 74d20ade-71c4-4a19-b7bd-a7d19df13cd9 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
71052024-12-02T16:52:49.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 74d20ade-71c4-4a19-b7bd-a7d19df13cd9 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
71062024-12-02T16:52:49.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 74d20ade-71c4-4a19-b7bd-a7d19df13cd9 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
71072024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
71082024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
71092024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
71102024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
71112024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
71122024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
71132024-12-02T16:52:49.795ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
71142024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
71152024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
71162024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71172024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71182024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71192024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71202024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71212024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
71222024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
71232024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71242024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
71252024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
71262024-12-02T16:52:49.795ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-02 16:42:49.795264696 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
71272024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
71282024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
71292024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
71302024-12-02T16:52:49.795ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c575ce6d-3e43-4b59-886a-60182869b755
71312024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71322024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.271\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"c575ce6d-3e43-4b59-886a-60182869b755"}
71332024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
71342024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
71352024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
71362024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71372024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
71382024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
71392024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71402024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71412024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
71422024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71432024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
71442024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71452024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71462024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
71472024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71482024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
71492024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
71502024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71512024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
71522024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71532024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71542024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71552024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71562024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71572024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71582024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71592024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
71602024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
71612024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
71622024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
71632024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71642024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
71652024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
71662024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
71672024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71682024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71692024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
71702024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
71712024-12-02T16:52:49.795ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
71722024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
71732024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
71742024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
71752024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71762024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71772024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71782024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71792024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71802024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
71812024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
71822024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71832024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71842024-12-02T16:52:49.795ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71852024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71862024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71872024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71882024-12-02T16:52:49.796ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5510b96c-d504-40ca-83bc-e27293be3abe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 25931, tv_nsec: 531365887 } })
71892024-12-02T16:52:49.796ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a1a23f6-3701-4a53-9e08-543f9ba04e60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5030471-1797-42f6-9660-1ead64511c29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 25931, tv_nsec: 531375908 } })
71902024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71912024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71922024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
71932024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
71942024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71952024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71962024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71972024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71982024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
71992024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72002024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72012024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72022024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72032024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72042024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72052024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
72062024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.21408ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
72072024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
72082024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.392392ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
72092024-12-02T16:52:49.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72102024-12-02T16:52:49.799ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25931, tv_nsec: 534620446 } })
72112024-12-02T16:52:49.799ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72122024-12-02T16:52:49.799ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
72132024-12-02T16:52:49.799ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72142024-12-02T16:52:49.799ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.000585ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72152024-12-02T16:52:49.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72162024-12-02T16:52:49.799ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
72172024-12-02T16:52:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72182024-12-02T16:52:49.799ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72192024-12-02T16:52:49.799ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72202024-12-02T16:52:49.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72212024-12-02T16:52:49.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72222024-12-02T16:52:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72232024-12-02T16:52:49.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72242024-12-02T16:52:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72252024-12-02T16:52:49.802ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72262024-12-02T16:52:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
72272024-12-02T16:52:49.802ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
72282024-12-02T16:52:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72292024-12-02T16:52:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
72302024-12-02T16:52:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72312024-12-02T16:52:49.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72322024-12-02T16:52:49.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72332024-12-02T16:52:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72342024-12-02T16:52:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72352024-12-02T16:52:49.804ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-02 16:42:49.795264696 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
72362024-12-02T16:52:49.804ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.094229ms iteration = 10 status = {"expiration":"2024-12-02T16:42:49.795264696Z","pruned":[]}
72372024-12-02T16:52:49.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72382024-12-02T16:52:49.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72392024-12-02T16:52:49.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72402024-12-02T16:52:49.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25931, tv_nsec: 541296554 } })
72412024-12-02T16:52:49.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
72422024-12-02T16:52:49.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72432024-12-02T16:52:49.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72442024-12-02T16:52:49.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72452024-12-02T16:52:49.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72462024-12-02T16:52:49.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72472024-12-02T16:52:49.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72482024-12-02T16:52:49.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72492024-12-02T16:52:49.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72502024-12-02T16:52:49.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72512024-12-02T16:52:49.809ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72522024-12-02T16:52:49.809ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.829541ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
72532024-12-02T16:52:49.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72542024-12-02T16:52:49.810ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72552024-12-02T16:52:49.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72562024-12-02T16:52:49.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72572024-12-02T16:52:49.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72582024-12-02T16:52:49.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72592024-12-02T16:52:49.811ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72602024-12-02T16:52:49.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72612024-12-02T16:52:49.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 16.236422ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
72622024-12-02T16:52:49.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72632024-12-02T16:52:49.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72642024-12-02T16:52:49.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 18.251329ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
72652024-12-02T16:52:49.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72662024-12-02T16:52:49.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72672024-12-02T16:52:49.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72682024-12-02T16:52:49.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72692024-12-02T16:52:49.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72702024-12-02T16:52:49.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72712024-12-02T16:52:49.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72722024-12-02T16:52:49.817ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72732024-12-02T16:52:49.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72742024-12-02T16:52:49.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72752024-12-02T16:52:49.817ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72762024-12-02T16:52:49.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72772024-12-02T16:52:49.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72782024-12-02T16:52:49.818ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72792024-12-02T16:52:49.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72802024-12-02T16:52:49.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72812024-12-02T16:52:49.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72822024-12-02T16:52:49.821ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72832024-12-02T16:52:49.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72842024-12-02T16:52:49.821ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72852024-12-02T16:52:49.822ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25931, tv_nsec: 557482616 } })
72862024-12-02T16:52:49.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
72872024-12-02T16:52:49.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72882024-12-02T16:52:49.823ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72892024-12-02T16:52:49.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72902024-12-02T16:52:49.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72912024-12-02T16:52:49.826ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72922024-12-02T16:52:49.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72932024-12-02T16:52:49.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72942024-12-02T16:52:49.830ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
72952024-12-02T16:52:49.830ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 34.723044ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
72962024-12-02T16:52:49.830ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
72972024-12-02T16:52:49.830ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
72982024-12-02T16:52:49.830ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
72992024-12-02T16:52:49.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73002024-12-02T16:52:49.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73012024-12-02T16:52:49.831ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73022024-12-02T16:52:49.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73032024-12-02T16:52:49.832ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73042024-12-02T16:52:49.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73052024-12-02T16:52:49.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73062024-12-02T16:52:49.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73072024-12-02T16:52:49.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73082024-12-02T16:52:49.833ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73092024-12-02T16:52:49.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73102024-12-02T16:52:49.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73112024-12-02T16:52:49.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73122024-12-02T16:52:49.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73132024-12-02T16:52:49.840ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 44.356398ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
73142024-12-02T16:52:49.843ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73152024-12-02T16:52:49.844ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73162024-12-02T16:52:49.846ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 51.095917ms iteration = 5 status = {"nsuccess":5}
73172024-12-02T16:52:49.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73182024-12-02T16:52:49.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73192024-12-02T16:52:49.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73202024-12-02T16:52:49.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73212024-12-02T16:52:49.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73222024-12-02T16:52:49.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
73232024-12-02T16:52:49.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73242024-12-02T16:52:49.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73252024-12-02T16:52:49.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = fa7ff502-e906-4695-8952-9bd94ec595b7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
73262024-12-02T16:52:49.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = fa7ff502-e906-4695-8952-9bd94ec595b7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
73272024-12-02T16:52:49.853ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73282024-12-02T16:52:49.853ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
73292024-12-02T16:52:49.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73302024-12-02T16:52:49.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73312024-12-02T16:52:49.854ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
73322024-12-02T16:52:49.854ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
73332024-12-02T16:52:49.854ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.954345ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
73342024-12-02T16:52:49.858ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73352024-12-02T16:52:49.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73362024-12-02T16:52:49.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.870373ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73372024-12-02T16:52:49.865ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
73382024-12-02T16:52:49.865ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
73392024-12-02T16:52:49.865ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.403216ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
73402024-12-02T16:52:49.868ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73412024-12-02T16:52:49.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73422024-12-02T16:52:49.870ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.42292ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73432024-12-02T16:52:49.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73442024-12-02T16:52:49.878ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
73452024-12-02T16:52:49.878ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
73462024-12-02T16:52:49.878ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
73472024-12-02T16:52:49.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73482024-12-02T16:52:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73492024-12-02T16:52:49.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73502024-12-02T16:52:49.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73512024-12-02T16:52:49.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73522024-12-02T16:52:49.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73532024-12-02T16:52:49.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
73542024-12-02T16:52:49.884ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73552024-12-02T16:52:49.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73562024-12-02T16:52:49.888ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 93.008154ms iteration = 22 status = {"physical_disks_added":0}
73572024-12-02T16:52:49.896ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
73582024-12-02T16:52:49.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
73592024-12-02T16:52:49.977ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
73602024-12-02T16:52:49.977ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73612024-12-02T16:52:49.978ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7d7613b-7512-41e4-8400-53414ee01191", "content-length": "26", "date": "Mon, 02 Dec 2024 16:52:49 GMT"} })
73622024-12-02T16:52:49.978ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73632024-12-02T16:52:49.980ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73642024-12-02T16:52:50.004ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
73652024-12-02T16:52:50.005ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73662024-12-02T16:52:50.005ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7bf1112-4ec3-4b5b-b1cf-cbdcb154d826", "content-length": "26", "date": "Mon, 02 Dec 2024 16:52:49 GMT"} })
73672024-12-02T16:52:50.005ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73682024-12-02T16:52:50.007ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
73692024-12-02T16:52:50.044ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
73702024-12-02T16:52:50.044ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73712024-12-02T16:52:50.044ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d7ba297-35f4-4d0b-9b22-efd9b9894ee3", "content-length": "26", "date": "Mon, 02 Dec 2024 16:52:49 GMT"} })
73722024-12-02T16:52:50.045ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73732024-12-02T16:52:50.046ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73742024-12-02T16:52:50.099ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
73752024-12-02T16:52:50.119ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73762024-12-02T16:52:50.119ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73772024-12-02T16:52:50.119ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "006ebd80-06a9-4e8e-aae9-811f32646532", "content-length": "372", "date": "Mon, 02 Dec 2024 16:52:50 GMT"} })
73782024-12-02T16:52:50.119ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73792024-12-02T16:52:50.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73802024-12-02T16:52:50.120ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
73812024-12-02T16:52:50.121ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73822024-12-02T16:52:50.123ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73832024-12-02T16:52:50.123ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73842024-12-02T16:52:50.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73852024-12-02T16:52:50.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = fa7ff502-e906-4695-8952-9bd94ec595b7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
73862024-12-02T16:52:50.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73872024-12-02T16:52:50.126ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73882024-12-02T16:52:50.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73892024-12-02T16:52:50.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73902024-12-02T16:52:50.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73912024-12-02T16:52:50.129ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73922024-12-02T16:52:50.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73932024-12-02T16:52:50.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
73942024-12-02T16:52:50.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73952024-12-02T16:52:50.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73962024-12-02T16:52:50.135ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 339.79353ms iteration = 19 status = 0
73972024-12-02T16:52:50.140ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
73982024-12-02T16:52:50.140ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 344.683472ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
73992024-12-02T16:52:50.156ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74002024-12-02T16:52:50.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74012024-12-02T16:52:50.157ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
74022024-12-02T16:52:50.157ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "12be16aa-bffb-4727-90be-3cf648355c9e", "content-length": "1", "date": "Mon, 02 Dec 2024 16:52:50 GMT"} })
74032024-12-02T16:52:50.157ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74042024-12-02T16:52:50.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74052024-12-02T16:52:50.159ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74062024-12-02T16:52:50.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74072024-12-02T16:52:50.162ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 367.235169ms iteration = 19 status = null
74082024-12-02T16:52:50.163ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74092024-12-02T16:52:50.163ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
74102024-12-02T16:52:50.163ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 368.209999ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
74112024-12-02T16:52:50.168ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
74122024-12-02T16:52:50.168ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 0 version = 2
74132024-12-02T16:52:50.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74142024-12-02T16:52:50.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74152024-12-02T16:52:50.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74162024-12-02T16:52:50.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74172024-12-02T16:52:50.171ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74182024-12-02T16:52:50.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74192024-12-02T16:52:50.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74202024-12-02T16:52:50.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
74212024-12-02T16:52:50.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74222024-12-02T16:52:50.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74232024-12-02T16:52:50.175ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 1 version = 2
74242024-12-02T16:52:50.175ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
74252024-12-02T16:52:50.175ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-02 16:44:12.116348 UTC dns_group = external generation = 2
74262024-12-02T16:52:50.175ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 380.207333ms iteration = 11 status = {"generation":2}
74272024-12-02T16:52:50.177ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
74282024-12-02T16:52:50.177ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
74292024-12-02T16:52:50.177ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a3e6b7df-0d08-4729-8530-378beeafd6b8", "date": "Mon, 02 Dec 2024 16:52:50 GMT"} })
74302024-12-02T16:52:50.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74312024-12-02T16:52:50.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74322024-12-02T16:52:50.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1ce28221-e3c9-40b3-ad5c-5d7cceb5e60b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
74332024-12-02T16:52:50.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1ce28221-e3c9-40b3-ad5c-5d7cceb5e60b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
74342024-12-02T16:52:50.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74352024-12-02T16:52:50.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74362024-12-02T16:52:50.180ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
74372024-12-02T16:52:50.180ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
74382024-12-02T16:52:50.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74392024-12-02T16:52:50.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1ce28221-e3c9-40b3-ad5c-5d7cceb5e60b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
74402024-12-02T16:52:50.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74412024-12-02T16:52:50.181ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74422024-12-02T16:52:50.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74432024-12-02T16:52:50.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74442024-12-02T16:52:50.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
74452024-12-02T16:52:50.185ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74462024-12-02T16:52:50.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74472024-12-02T16:52:50.186ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74482024-12-02T16:52:50.186ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74492024-12-02T16:52:50.187ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
74502024-12-02T16:52:50.187ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
74512024-12-02T16:52:50.187ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-02 16:44:11.214841 UTC dns_group = internal generation = 1
74522024-12-02T16:52:50.187ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 392.349439ms iteration = 11 status = {"generation":1}
74532024-12-02T16:52:50.188ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "30f213e1-17e0-4d7c-9e00-f9572337fc3d", "date": "Mon, 02 Dec 2024 16:52:50 GMT"} })
74542024-12-02T16:52:50.189ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 393.780112ms iteration = 20 status = {}
74552024-12-02T16:52:50.190ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 394.520528ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
74562024-12-02T16:52:50.197ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74572024-12-02T16:52:50.198ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
74582024-12-02T16:52:50.198ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74592024-12-02T16:52:50.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74602024-12-02T16:52:50.204ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 408.952824ms iteration = 19 status = {}
74612024-12-02T16:52:50.230ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
74622024-12-02T16:52:50.230ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 434.161285ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
74632024-12-02T16:52:50.236ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-02T16:43:45.642486Z, time_modified: 2024-12-02T16:43:45.642486Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }) }
74642024-12-02T16:52:50.236ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 440.957094ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]}},"default_endpoint":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
74652024-12-02T16:52:50.342ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
74662024-12-02T16:52:50.343ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "85e5e515-3a5f-498a-b368-ffacac443922", "date": "Mon, 02 Dec 2024 16:52:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74672024-12-02T16:52:50.343ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74682024-12-02T16:52:50.345ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "db6898c4-8433-435a-9d31-5bcd08415293", "date": "Mon, 02 Dec 2024 16:52:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74692024-12-02T16:52:50.345ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74702024-12-02T16:52:50.347ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74712024-12-02T16:52:50.347ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 552.192336ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
74722024-12-02T16:52:50.348ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74732024-12-02T16:52:50.349ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc1bd443-ad06-4608-88ad-356a787654d3", "content-length": "691", "date": "Mon, 02 Dec 2024 16:52:50 GMT"} })
74742024-12-02T16:52:50.349ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
74752024-12-02T16:52:50.349ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
74762024-12-02T16:52:50.349ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
74772024-12-02T16:52:50.350ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 555.180902ms iteration = 19 status = {}
74782024-12-02T16:52:50.352ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
74792024-12-02T16:52:50.366ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74802024-12-02T16:52:50.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74812024-12-02T16:52:50.367ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
74822024-12-02T16:52:50.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74832024-12-02T16:52:50.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74842024-12-02T16:52:50.377ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
74852024-12-02T16:52:50.377ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f53393d8-b8c0-4eb6-8562-ece48156d2fe", "content-length": "134", "date": "Mon, 02 Dec 2024 16:52:50 GMT"} })
74862024-12-02T16:52:50.377ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
74872024-12-02T16:52:50.377ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
74882024-12-02T16:52:50.378ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
74892024-12-02T16:52:50.378ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74902024-12-02T16:52:50.378ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74912024-12-02T16:52:50.378ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74922024-12-02T16:52:50.378ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74932024-12-02T16:52:50.378ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74942024-12-02T16:52:50.378ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74952024-12-02T16:52:50.378ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74962024-12-02T16:52:50.378ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
74972024-12-02T16:52:50.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74982024-12-02T16:52:50.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74992024-12-02T16:52:50.380ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
75002024-12-02T16:52:50.381ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bab74ccc-f534-4535-979e-129316836cd3", "content-length": "2", "date": "Mon, 02 Dec 2024 16:52:50 GMT"} })
75012024-12-02T16:52:50.381ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
75022024-12-02T16:52:50.381ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "97dbbedb-9540-4913-8e61-87013b232c89", "content-length": "52", "date": "Mon, 02 Dec 2024 16:52:50 GMT"} })
75032024-12-02T16:52:50.381ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
75042024-12-02T16:52:50.381ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
75052024-12-02T16:52:50.390ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
75062024-12-02T16:52:50.391ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1ce08e54-c89e-46a1-ad26-c20f20256a0e", "date": "Mon, 02 Dec 2024 16:52:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
75072024-12-02T16:52:50.391ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
75082024-12-02T16:52:50.393ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "70d61280-2d66-4722-ade2-cd9813da8948", "date": "Mon, 02 Dec 2024 16:52:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
75092024-12-02T16:52:50.393ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
75102024-12-02T16:52:50.394ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "71b9cc5e-cdab-4037-814b-0c260f575a16", "date": "Mon, 02 Dec 2024 16:52:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
75112024-12-02T16:52:50.394ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
75122024-12-02T16:52:50.396ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
75132024-12-02T16:52:50.396ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 601.521078ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
75142024-12-02T16:52:50.472ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "90f55066-06fe-41b6-8194-5b98e3e7a985", "date": "Mon, 02 Dec 2024 16:52:50 GMT"} })
75152024-12-02T16:52:50.472ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
75162024-12-02T16:52:50.472ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
75172024-12-02T16:52:50.473ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9331b89-1cb3-4b6e-a1b6-208a2a5898ce", "content-length": "682", "date": "Mon, 02 Dec 2024 16:52:50 GMT"} })
75182024-12-02T16:52:50.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75192024-12-02T16:52:50.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75202024-12-02T16:52:50.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75212024-12-02T16:52:50.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75222024-12-02T16:52:50.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75232024-12-02T16:52:50.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75242024-12-02T16:52:50.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75252024-12-02T16:52:50.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75262024-12-02T16:52:50.491ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 696.092264ms iteration = 19 status = {}
75272024-12-02T16:52:51.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ceb09c1d-bfbc-4e58-97c7-59b69086f36a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75282024-12-02T16:52:51.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ceb09c1d-bfbc-4e58-97c7-59b69086f36a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75292024-12-02T16:52:51.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ceb09c1d-bfbc-4e58-97c7-59b69086f36a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75302024-12-02T16:52:52.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ff64f15c-6ce4-4ea3-b2a6-e631d6e581d9 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75312024-12-02T16:52:52.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ff64f15c-6ce4-4ea3-b2a6-e631d6e581d9 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75322024-12-02T16:52:52.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ff64f15c-6ce4-4ea3-b2a6-e631d6e581d9 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75332024-12-02T16:52:53.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6f00ad81-4233-489d-a7d3-f27b14e0acf3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75342024-12-02T16:52:53.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6f00ad81-4233-489d-a7d3-f27b14e0acf3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75352024-12-02T16:52:53.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6f00ad81-4233-489d-a7d3-f27b14e0acf3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75362024-12-02T16:52:54.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 068a418a-bd9e-4e9a-8003-8e2fb1a558ce roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75372024-12-02T16:52:54.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 068a418a-bd9e-4e9a-8003-8e2fb1a558ce resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75382024-12-02T16:52:54.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 068a418a-bd9e-4e9a-8003-8e2fb1a558ce response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75392024-12-02T16:52:55.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c8d2cb75-a9a2-4d7a-aefe-94f7a0686524 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75402024-12-02T16:52:55.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c8d2cb75-a9a2-4d7a-aefe-94f7a0686524 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75412024-12-02T16:52:55.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c8d2cb75-a9a2-4d7a-aefe-94f7a0686524 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75422024-12-02T16:52:56.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f3099e0d-afb1-4cdb-9b37-719b1986e1cb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75432024-12-02T16:52:56.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f3099e0d-afb1-4cdb-9b37-719b1986e1cb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75442024-12-02T16:52:56.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f3099e0d-afb1-4cdb-9b37-719b1986e1cb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75452024-12-02T16:52:56.558ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1374 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 18223755-5dce-4d28-bf13-6764fd67132c response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
75462024-12-02T16:52:57.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 506479b3-35fb-439f-b7c6-99d70d672c7c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75472024-12-02T16:52:57.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 506479b3-35fb-439f-b7c6-99d70d672c7c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75482024-12-02T16:52:57.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 506479b3-35fb-439f-b7c6-99d70d672c7c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75492024-12-02T16:52:58.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0765239a-5942-4f79-b858-c92be2154a1f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75502024-12-02T16:52:58.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0765239a-5942-4f79-b858-c92be2154a1f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75512024-12-02T16:52:58.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0765239a-5942-4f79-b858-c92be2154a1f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75522024-12-02T16:52:59.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 24b63686-b2f6-4a1c-a3f5-2ecff0732723 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75532024-12-02T16:52:59.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 24b63686-b2f6-4a1c-a3f5-2ecff0732723 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75542024-12-02T16:52:59.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 24b63686-b2f6-4a1c-a3f5-2ecff0732723 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75552024-12-02T16:52:59.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
75562024-12-02T16:52:59.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75572024-12-02T16:52:59.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
75582024-12-02T16:52:59.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75592024-12-02T16:52:59.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75602024-12-02T16:52:59.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75612024-12-02T16:52:59.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75622024-12-02T16:52:59.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75632024-12-02T16:52:59.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75642024-12-02T16:52:59.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75652024-12-02T16:52:59.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75662024-12-02T16:52:59.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75672024-12-02T16:52:59.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75682024-12-02T16:52:59.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75692024-12-02T16:52:59.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75702024-12-02T16:52:59.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
75712024-12-02T16:52:59.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75722024-12-02T16:52:59.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75732024-12-02T16:52:59.818ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
75742024-12-02T16:52:59.818ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.920631ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
75752024-12-02T16:52:59.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.562417ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75762024-12-02T16:53:00.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 90a89055-4d86-4f0c-873e-42ba3eea731b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75772024-12-02T16:53:00.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 90a89055-4d86-4f0c-873e-42ba3eea731b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75782024-12-02T16:53:00.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 90a89055-4d86-4f0c-873e-42ba3eea731b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75792024-12-02T16:53:01.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5a29e15d-2366-4218-99c9-cfa94a2fce2f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75802024-12-02T16:53:01.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5a29e15d-2366-4218-99c9-cfa94a2fce2f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75812024-12-02T16:53:01.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5a29e15d-2366-4218-99c9-cfa94a2fce2f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75822024-12-02T16:53:02.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 875f917e-9a77-4422-931d-7cafb30d580c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75832024-12-02T16:53:02.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 875f917e-9a77-4422-931d-7cafb30d580c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75842024-12-02T16:53:02.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 875f917e-9a77-4422-931d-7cafb30d580c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75852024-12-02T16:53:03.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9e9d5c60-f606-48f1-ba24-3a38c9f53935 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75862024-12-02T16:53:03.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9e9d5c60-f606-48f1-ba24-3a38c9f53935 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75872024-12-02T16:53:03.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1587 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9e9d5c60-f606-48f1-ba24-3a38c9f53935 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75882024-12-02T16:53:04.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fdad2bbf-9e6d-423a-9e7f-a3db0a929e4e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75892024-12-02T16:53:04.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fdad2bbf-9e6d-423a-9e7f-a3db0a929e4e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75902024-12-02T16:53:04.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fdad2bbf-9e6d-423a-9e7f-a3db0a929e4e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75912024-12-02T16:53:05.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 35171856-5ff6-4815-9417-19bea82b4c16 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75922024-12-02T16:53:05.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 35171856-5ff6-4815-9417-19bea82b4c16 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75932024-12-02T16:53:05.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2782 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 35171856-5ff6-4815-9417-19bea82b4c16 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75942024-12-02T16:53:06.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 77fe64ca-ba6c-41bd-bf15-cc09e16bdde5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75952024-12-02T16:53:06.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 77fe64ca-ba6c-41bd-bf15-cc09e16bdde5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75962024-12-02T16:53:06.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 77fe64ca-ba6c-41bd-bf15-cc09e16bdde5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75972024-12-02T16:53:06.559ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1642 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = a00f5a2d-0844-4fb1-85cb-93873896b5d1 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
75982024-12-02T16:53:07.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 985c4ae9-07d8-494b-b87d-0be1c3197da2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
75992024-12-02T16:53:07.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 985c4ae9-07d8-494b-b87d-0be1c3197da2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76002024-12-02T16:53:07.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 985c4ae9-07d8-494b-b87d-0be1c3197da2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76012024-12-02T16:53:08.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 619d07cf-aa36-4555-a184-9468b441776f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76022024-12-02T16:53:08.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 619d07cf-aa36-4555-a184-9468b441776f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76032024-12-02T16:53:08.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 619d07cf-aa36-4555-a184-9468b441776f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76042024-12-02T16:53:09.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bfca1357-6124-4a91-a0aa-b341de31f539 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76052024-12-02T16:53:09.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bfca1357-6124-4a91-a0aa-b341de31f539 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76062024-12-02T16:53:09.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bfca1357-6124-4a91-a0aa-b341de31f539 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76072024-12-02T16:53:09.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
76082024-12-02T16:53:09.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76092024-12-02T16:53:09.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
76102024-12-02T16:53:09.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76112024-12-02T16:53:09.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76122024-12-02T16:53:09.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76132024-12-02T16:53:09.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76142024-12-02T16:53:09.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76152024-12-02T16:53:09.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76162024-12-02T16:53:09.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76172024-12-02T16:53:09.827ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76182024-12-02T16:53:09.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76192024-12-02T16:53:09.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76202024-12-02T16:53:09.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76212024-12-02T16:53:09.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.997654ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76222024-12-02T16:53:09.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76232024-12-02T16:53:09.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
76242024-12-02T16:53:09.866ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76252024-12-02T16:53:09.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76262024-12-02T16:53:09.879ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
76272024-12-02T16:53:09.879ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.285408ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
76282024-12-02T16:53:10.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 75a264db-dcaf-43f1-8f39-b2aba92b5f15 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76292024-12-02T16:53:10.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 75a264db-dcaf-43f1-8f39-b2aba92b5f15 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76302024-12-02T16:53:10.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4922 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 75a264db-dcaf-43f1-8f39-b2aba92b5f15 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76312024-12-02T16:53:11.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7f0b66f7-0651-4f5b-a272-80018a99dc81 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76322024-12-02T16:53:11.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7f0b66f7-0651-4f5b-a272-80018a99dc81 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76332024-12-02T16:53:11.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7f0b66f7-0651-4f5b-a272-80018a99dc81 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76342024-12-02T16:53:12.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = af57e068-9e59-46dc-a3a6-026a0afb5782 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76352024-12-02T16:53:12.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = af57e068-9e59-46dc-a3a6-026a0afb5782 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76362024-12-02T16:53:12.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1962 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = af57e068-9e59-46dc-a3a6-026a0afb5782 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76372024-12-02T16:53:13.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cf3531a7-f907-4a43-9033-47d93c90d035 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76382024-12-02T16:53:13.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cf3531a7-f907-4a43-9033-47d93c90d035 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76392024-12-02T16:53:13.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cf3531a7-f907-4a43-9033-47d93c90d035 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76402024-12-02T16:53:14.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1aebbc6d-0a0a-4f1f-93b6-345b7e1bcec7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76412024-12-02T16:53:14.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1aebbc6d-0a0a-4f1f-93b6-345b7e1bcec7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76422024-12-02T16:53:14.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1aebbc6d-0a0a-4f1f-93b6-345b7e1bcec7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76432024-12-02T16:53:15.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dfef923a-f364-4825-b43d-82ba7f9fe048 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76442024-12-02T16:53:15.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dfef923a-f364-4825-b43d-82ba7f9fe048 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76452024-12-02T16:53:15.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dfef923a-f364-4825-b43d-82ba7f9fe048 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76462024-12-02T16:53:16.558ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 54f4ec10-ac4d-44d3-8653-11bbd5cac98a response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
76472024-12-02T16:53:16.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c532e42e-288d-4cd5-ab65-13d80cd33ca4 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76482024-12-02T16:53:16.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c532e42e-288d-4cd5-ab65-13d80cd33ca4 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76492024-12-02T16:53:16.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c532e42e-288d-4cd5-ab65-13d80cd33ca4 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76502024-12-02T16:53:17.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ce09cbe0-b499-4620-b73e-3e86e7901a8a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76512024-12-02T16:53:17.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ce09cbe0-b499-4620-b73e-3e86e7901a8a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76522024-12-02T16:53:17.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ce09cbe0-b499-4620-b73e-3e86e7901a8a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76532024-12-02T16:53:18.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8adaf0ba-8529-4bbe-803f-a3fad60b0713 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76542024-12-02T16:53:18.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8adaf0ba-8529-4bbe-803f-a3fad60b0713 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76552024-12-02T16:53:18.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8adaf0ba-8529-4bbe-803f-a3fad60b0713 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
76562024-12-02T16:53:19.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 7c10e634-300c-4bd9-8d4c-a2654119eca8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
76572024-12-02T16:53:19.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 7c10e634-300c-4bd9-8d4c-a2654119eca8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
76582024-12-02T16:53:19.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 7c10e634-300c-4bd9-8d4c-a2654119eca8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
76592024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
76602024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76612024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
76622024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
76632024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
76642024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76652024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
76662024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
76672024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76682024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
76692024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76702024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
76712024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76722024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
76732024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76742024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76752024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
76762024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
76772024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76782024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76792024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
76802024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76812024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76822024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76832024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76842024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76852024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76862024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76872024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76882024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76892024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76902024-12-02T16:53:19.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
76912024-12-02T16:53:19.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
76922024-12-02T16:53:19.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
76932024-12-02T16:53:19.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
76942024-12-02T16:53:19.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76952024-12-02T16:53:19.796ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
76962024-12-02T16:53:19.796ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
76972024-12-02T16:53:19.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76982024-12-02T16:53:19.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
76992024-12-02T16:53:19.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77002024-12-02T16:53:19.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
77012024-12-02T16:53:19.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
77022024-12-02T16:53:19.796ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
77032024-12-02T16:53:19.797ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77042024-12-02T16:53:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
77052024-12-02T16:53:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77062024-12-02T16:53:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77072024-12-02T16:53:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
77082024-12-02T16:53:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77092024-12-02T16:53:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77102024-12-02T16:53:19.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77112024-12-02T16:53:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77122024-12-02T16:53:19.798ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77132024-12-02T16:53:19.798ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.4551ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
77142024-12-02T16:53:19.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77152024-12-02T16:53:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77162024-12-02T16:53:19.800ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77172024-12-02T16:53:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77182024-12-02T16:53:19.802ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25961, tv_nsec: 537321370 } })
77192024-12-02T16:53:19.802ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
77202024-12-02T16:53:19.803ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25961, tv_nsec: 537993935 } })
77212024-12-02T16:53:19.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77222024-12-02T16:53:19.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77232024-12-02T16:53:19.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77242024-12-02T16:53:19.803ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
77252024-12-02T16:53:19.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77262024-12-02T16:53:19.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77272024-12-02T16:53:19.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77282024-12-02T16:53:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77292024-12-02T16:53:19.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77302024-12-02T16:53:19.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77312024-12-02T16:53:19.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77322024-12-02T16:53:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77332024-12-02T16:53:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77342024-12-02T16:53:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
77352024-12-02T16:53:19.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77362024-12-02T16:53:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77372024-12-02T16:53:19.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77382024-12-02T16:53:19.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77392024-12-02T16:53:19.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77402024-12-02T16:53:19.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77412024-12-02T16:53:19.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77422024-12-02T16:53:19.814ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77432024-12-02T16:53:19.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77442024-12-02T16:53:19.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77452024-12-02T16:53:19.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77462024-12-02T16:53:19.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77472024-12-02T16:53:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77482024-12-02T16:53:19.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
77492024-12-02T16:53:19.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77502024-12-02T16:53:19.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77512024-12-02T16:53:19.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2bbfd2d0-1a11-4740-a633-94af327c4487 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
77522024-12-02T16:53:19.833ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
77532024-12-02T16:53:19.834ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 38.601648ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
77542024-12-02T16:53:19.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2bbfd2d0-1a11-4740-a633-94af327c4487 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
77552024-12-02T16:53:19.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2475 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2bbfd2d0-1a11-4740-a633-94af327c4487 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
77562024-12-02T16:53:19.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77572024-12-02T16:53:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
77582024-12-02T16:53:19.840ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77592024-12-02T16:53:19.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77602024-12-02T16:53:19.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.083614ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
77612024-12-02T16:53:19.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77622024-12-02T16:53:19.843ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25961, tv_nsec: 577910004 } })
77632024-12-02T16:53:19.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77642024-12-02T16:53:19.843ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
77652024-12-02T16:53:19.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77662024-12-02T16:53:19.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77672024-12-02T16:53:19.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77682024-12-02T16:53:19.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77692024-12-02T16:53:19.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77702024-12-02T16:53:19.847ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77712024-12-02T16:53:19.848ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.65441ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77722024-12-02T16:53:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77732024-12-02T16:53:19.848ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77742024-12-02T16:53:19.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.194776ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
77752024-12-02T16:53:19.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77762024-12-02T16:53:19.850ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77772024-12-02T16:53:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
77782024-12-02T16:53:19.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77792024-12-02T16:53:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77802024-12-02T16:53:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77812024-12-02T16:53:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77822024-12-02T16:53:19.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77832024-12-02T16:53:19.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77842024-12-02T16:53:19.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77852024-12-02T16:53:19.851ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77862024-12-02T16:53:19.851ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77872024-12-02T16:53:19.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77882024-12-02T16:53:19.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77892024-12-02T16:53:19.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 54.885219ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
77902024-12-02T16:53:19.852ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 55.357324ms iteration = 20 status = 0
77912024-12-02T16:53:19.878ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
77922024-12-02T16:53:19.878ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77932024-12-02T16:53:19.878ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3db9f3ba-7ed9-4217-ad4e-787869435951", "content-length": "26", "date": "Mon, 02 Dec 2024 16:53:19 GMT"} })
77942024-12-02T16:53:19.878ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77952024-12-02T16:53:19.880ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77962024-12-02T16:53:19.885ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 88.846277ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
77972024-12-02T16:53:19.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.596906ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77982024-12-02T16:53:19.891ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77992024-12-02T16:53:19.891ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
78002024-12-02T16:53:19.891ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78012024-12-02T16:53:19.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78022024-12-02T16:53:19.895ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
78032024-12-02T16:53:19.895ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 100.512508ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
78042024-12-02T16:53:19.909ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
78052024-12-02T16:53:19.909ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78062024-12-02T16:53:19.909ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d9aac7e-9e84-43c2-8d63-a00e7d949154", "content-length": "26", "date": "Mon, 02 Dec 2024 16:53:19 GMT"} })
78072024-12-02T16:53:19.909ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78082024-12-02T16:53:19.911ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78092024-12-02T16:53:19.922ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78102024-12-02T16:53:19.922ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
78112024-12-02T16:53:19.922ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 127.165442ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
78122024-12-02T16:53:19.925ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78132024-12-02T16:53:19.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78142024-12-02T16:53:19.934ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
78152024-12-02T16:53:19.934ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78162024-12-02T16:53:19.934ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fdf62e1-fcfe-4c1a-9c2b-7d231f04985f", "content-length": "26", "date": "Mon, 02 Dec 2024 16:53:19 GMT"} })
78172024-12-02T16:53:19.934ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78182024-12-02T16:53:19.934ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 139.458979ms iteration = 23 status = {"physical_disks_added":0}
78192024-12-02T16:53:19.936ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
78202024-12-02T16:53:19.992ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
78212024-12-02T16:53:19.992ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78222024-12-02T16:53:19.992ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bb81579-fc0f-4b01-ace4-f0c611766a92", "content-length": "372", "date": "Mon, 02 Dec 2024 16:53:19 GMT"} })
78232024-12-02T16:53:19.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78242024-12-02T16:53:19.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78252024-12-02T16:53:19.993ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78262024-12-02T16:53:19.993ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "de25e812-43b8-43d3-abc5-41d1247a52bc", "content-length": "1", "date": "Mon, 02 Dec 2024 16:53:19 GMT"} })
78272024-12-02T16:53:19.995ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78282024-12-02T16:53:19.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78292024-12-02T16:53:19.997ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 202.320079ms iteration = 20 status = null
78302024-12-02T16:53:20.006ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 211.299887ms iteration = 20 status = {}
78312024-12-02T16:53:20.034ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
78322024-12-02T16:53:20.034ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
78332024-12-02T16:53:20.034ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7080258e-9267-4acc-8d0e-fb6d07a3a2c8", "date": "Mon, 02 Dec 2024 16:53:19 GMT"} })
78342024-12-02T16:53:20.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78352024-12-02T16:53:20.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78362024-12-02T16:53:20.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78372024-12-02T16:53:20.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78382024-12-02T16:53:20.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78392024-12-02T16:53:20.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78402024-12-02T16:53:20.043ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
78412024-12-02T16:53:20.043ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78422024-12-02T16:53:20.044ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e73744ff-b8b0-411a-93b5-223d504a44d5", "date": "Mon, 02 Dec 2024 16:53:19 GMT"} })
78432024-12-02T16:53:20.046ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 249.740583ms iteration = 21 status = {}
78442024-12-02T16:53:20.074ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78452024-12-02T16:53:20.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78462024-12-02T16:53:20.076ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
78472024-12-02T16:53:20.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78482024-12-02T16:53:20.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78492024-12-02T16:53:20.080ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78502024-12-02T16:53:20.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78512024-12-02T16:53:20.086ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
78522024-12-02T16:53:20.086ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a22e8f6c-2859-4092-8625-3644627c3bfe", "content-length": "134", "date": "Mon, 02 Dec 2024 16:53:19 GMT"} })
78532024-12-02T16:53:20.086ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
78542024-12-02T16:53:20.086ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
78552024-12-02T16:53:20.087ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
78562024-12-02T16:53:20.087ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
78572024-12-02T16:53:20.087ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78582024-12-02T16:53:20.087ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78592024-12-02T16:53:20.087ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78602024-12-02T16:53:20.087ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78612024-12-02T16:53:20.087ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78622024-12-02T16:53:20.087ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78632024-12-02T16:53:20.087ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
78642024-12-02T16:53:20.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78652024-12-02T16:53:20.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78662024-12-02T16:53:20.090ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78672024-12-02T16:53:20.090ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a18fccee-8950-4032-b3c8-fce97c3f9ca8", "content-length": "2", "date": "Mon, 02 Dec 2024 16:53:19 GMT"} })
78682024-12-02T16:53:20.090ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78692024-12-02T16:53:20.090ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1f7f84c-88ac-41bd-8abb-e8c79914977a", "content-length": "52", "date": "Mon, 02 Dec 2024 16:53:19 GMT"} })
78702024-12-02T16:53:20.090ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
78712024-12-02T16:53:20.090ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78722024-12-02T16:53:20.109ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78732024-12-02T16:53:20.111ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78742024-12-02T16:53:20.111ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78752024-12-02T16:53:20.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78762024-12-02T16:53:20.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78772024-12-02T16:53:20.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78782024-12-02T16:53:20.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78792024-12-02T16:53:20.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78802024-12-02T16:53:20.180ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
78812024-12-02T16:53:20.191ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d4b58603-8da8-48b5-ab80-15509c36f8a3", "date": "Mon, 02 Dec 2024 16:53:19 GMT"} })
78822024-12-02T16:53:20.191ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
78832024-12-02T16:53:20.191ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78842024-12-02T16:53:20.191ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c6579e6-7415-4ab5-a03e-1bcdc3f3e02d", "content-length": "691", "date": "Mon, 02 Dec 2024 16:53:19 GMT"} })
78852024-12-02T16:53:20.191ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
78862024-12-02T16:53:20.191ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
78872024-12-02T16:53:20.191ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
78882024-12-02T16:53:20.191ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c859be1-6fd6-4341-a9a6-8ae75d696eff", "content-length": "682", "date": "Mon, 02 Dec 2024 16:53:20 GMT"} })
78892024-12-02T16:53:20.191ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78902024-12-02T16:53:20.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78912024-12-02T16:53:20.194ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 398.630024ms iteration = 20 status = {}
78922024-12-02T16:53:20.195ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78932024-12-02T16:53:20.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78942024-12-02T16:53:20.197ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78952024-12-02T16:53:20.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78962024-12-02T16:53:20.199ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78972024-12-02T16:53:20.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78982024-12-02T16:53:20.207ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 412.295953ms iteration = 20 status = {}
78992024-12-02T16:53:20.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fc1933d0-190a-46a1-8bde-1edbbe141f27 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79002024-12-02T16:53:20.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fc1933d0-190a-46a1-8bde-1edbbe141f27 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79012024-12-02T16:53:20.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fc1933d0-190a-46a1-8bde-1edbbe141f27 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79022024-12-02T16:53:21.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c50f2f5d-193a-4155-b428-43bbed21f98d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79032024-12-02T16:53:21.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c50f2f5d-193a-4155-b428-43bbed21f98d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79042024-12-02T16:53:21.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c50f2f5d-193a-4155-b428-43bbed21f98d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79052024-12-02T16:53:22.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 82307a71-8ba0-46fa-8b6e-781ecd30b700 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79062024-12-02T16:53:22.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 82307a71-8ba0-46fa-8b6e-781ecd30b700 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79072024-12-02T16:53:22.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 82307a71-8ba0-46fa-8b6e-781ecd30b700 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79082024-12-02T16:53:23.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b00e08bf-8888-447e-ba4f-199b1f8e61eb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79092024-12-02T16:53:23.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b00e08bf-8888-447e-ba4f-199b1f8e61eb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79102024-12-02T16:53:23.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b00e08bf-8888-447e-ba4f-199b1f8e61eb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79112024-12-02T16:53:24.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 13121c64-6cb1-4cfc-843c-cddd973a48ba roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79122024-12-02T16:53:24.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 13121c64-6cb1-4cfc-843c-cddd973a48ba resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79132024-12-02T16:53:24.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 13121c64-6cb1-4cfc-843c-cddd973a48ba response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79142024-12-02T16:53:25.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c68eaea7-9798-47d4-9205-39af44b4af85 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79152024-12-02T16:53:25.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c68eaea7-9798-47d4-9205-39af44b4af85 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79162024-12-02T16:53:25.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c68eaea7-9798-47d4-9205-39af44b4af85 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79172024-12-02T16:53:26.558ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1634 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 42c2e492-cd52-4741-b07f-d538e47c98d2 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
79182024-12-02T16:53:26.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1063f33f-1775-4ddd-aa60-75489775d5fe roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79192024-12-02T16:53:26.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1063f33f-1775-4ddd-aa60-75489775d5fe resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79202024-12-02T16:53:26.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1063f33f-1775-4ddd-aa60-75489775d5fe response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79212024-12-02T16:53:28.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 47320cdf-2d0d-4e8c-b536-3cac4c00ebdd roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79222024-12-02T16:53:28.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 47320cdf-2d0d-4e8c-b536-3cac4c00ebdd resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79232024-12-02T16:53:28.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 47320cdf-2d0d-4e8c-b536-3cac4c00ebdd response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79242024-12-02T16:53:29.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 877cb9d7-9070-4aeb-b74a-abf531b14076 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79252024-12-02T16:53:29.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 877cb9d7-9070-4aeb-b74a-abf531b14076 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79262024-12-02T16:53:29.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 877cb9d7-9070-4aeb-b74a-abf531b14076 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79272024-12-02T16:53:29.795ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
79282024-12-02T16:53:29.795ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79292024-12-02T16:53:29.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
79302024-12-02T16:53:29.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79312024-12-02T16:53:29.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79322024-12-02T16:53:29.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79332024-12-02T16:53:29.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79342024-12-02T16:53:29.800ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79352024-12-02T16:53:29.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79362024-12-02T16:53:29.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79372024-12-02T16:53:29.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79382024-12-02T16:53:29.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79392024-12-02T16:53:29.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79402024-12-02T16:53:29.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79412024-12-02T16:53:29.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79422024-12-02T16:53:29.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
79432024-12-02T16:53:29.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79442024-12-02T16:53:29.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79452024-12-02T16:53:29.844ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
79462024-12-02T16:53:29.844ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.260631ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
79472024-12-02T16:53:29.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.620875ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79482024-12-02T16:53:30.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 34f79549-a6b7-4079-872a-9827c8306eee roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79492024-12-02T16:53:30.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 34f79549-a6b7-4079-872a-9827c8306eee resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79502024-12-02T16:53:30.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 34f79549-a6b7-4079-872a-9827c8306eee response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79512024-12-02T16:53:31.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = eab01cda-f1c6-48da-b4e4-85c3558fe46e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79522024-12-02T16:53:31.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = eab01cda-f1c6-48da-b4e4-85c3558fe46e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79532024-12-02T16:53:31.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2626 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = eab01cda-f1c6-48da-b4e4-85c3558fe46e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79542024-12-02T16:53:32.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0861b48e-0be6-4392-8dd2-50d2cd15d35b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79552024-12-02T16:53:32.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0861b48e-0be6-4392-8dd2-50d2cd15d35b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79562024-12-02T16:53:32.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0861b48e-0be6-4392-8dd2-50d2cd15d35b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79572024-12-02T16:53:33.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3c73a537-5a4f-4c6f-bb80-3935a1ff1941 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79582024-12-02T16:53:33.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3c73a537-5a4f-4c6f-bb80-3935a1ff1941 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79592024-12-02T16:53:33.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1812 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3c73a537-5a4f-4c6f-bb80-3935a1ff1941 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79602024-12-02T16:53:34.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f6fb4880-cf1c-4dfc-8b31-7d68899e2ea5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79612024-12-02T16:53:34.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f6fb4880-cf1c-4dfc-8b31-7d68899e2ea5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79622024-12-02T16:53:34.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f6fb4880-cf1c-4dfc-8b31-7d68899e2ea5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79632024-12-02T16:53:35.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3651b8d4-a821-41e6-929d-4bf2b77d9c43 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79642024-12-02T16:53:35.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3651b8d4-a821-41e6-929d-4bf2b77d9c43 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79652024-12-02T16:53:35.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3651b8d4-a821-41e6-929d-4bf2b77d9c43 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79662024-12-02T16:53:36.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e077f712-e0e2-4c00-8267-e220022d3d50 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79672024-12-02T16:53:36.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e077f712-e0e2-4c00-8267-e220022d3d50 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79682024-12-02T16:53:36.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e077f712-e0e2-4c00-8267-e220022d3d50 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79692024-12-02T16:53:36.559ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1761 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 093c4e03-e228-4bd1-8473-3ce0c6842abf response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
79702024-12-02T16:53:37.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 42b7bc9a-cea6-4245-950f-9ba552db78b9 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79712024-12-02T16:53:37.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 42b7bc9a-cea6-4245-950f-9ba552db78b9 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79722024-12-02T16:53:37.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 42b7bc9a-cea6-4245-950f-9ba552db78b9 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79732024-12-02T16:53:38.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 03842f99-5c47-4fca-b935-1def694407f8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79742024-12-02T16:53:38.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 03842f99-5c47-4fca-b935-1def694407f8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79752024-12-02T16:53:38.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 03842f99-5c47-4fca-b935-1def694407f8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79762024-12-02T16:53:39.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d2bf0e5a-da9f-4612-8a2d-09469d1b72c7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79772024-12-02T16:53:39.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d2bf0e5a-da9f-4612-8a2d-09469d1b72c7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79782024-12-02T16:53:39.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d2bf0e5a-da9f-4612-8a2d-09469d1b72c7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
79792024-12-02T16:53:39.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
79802024-12-02T16:53:39.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79812024-12-02T16:53:39.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
79822024-12-02T16:53:39.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79832024-12-02T16:53:39.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79842024-12-02T16:53:39.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79852024-12-02T16:53:39.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79862024-12-02T16:53:39.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79872024-12-02T16:53:39.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79882024-12-02T16:53:39.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79892024-12-02T16:53:39.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79902024-12-02T16:53:39.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79912024-12-02T16:53:39.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79922024-12-02T16:53:39.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
79932024-12-02T16:53:39.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79942024-12-02T16:53:39.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79952024-12-02T16:53:39.815ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
79962024-12-02T16:53:39.815ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.969806ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
79972024-12-02T16:53:39.825ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79982024-12-02T16:53:39.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79992024-12-02T16:53:39.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.763427ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80002024-12-02T16:53:40.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2f340699-4ae6-4697-a22b-f5002db09eda roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80012024-12-02T16:53:40.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2f340699-4ae6-4697-a22b-f5002db09eda resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80022024-12-02T16:53:40.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2f340699-4ae6-4697-a22b-f5002db09eda response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80032024-12-02T16:53:41.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 40208af2-a41d-4593-a8c1-a0f714f40529 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80042024-12-02T16:53:41.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 40208af2-a41d-4593-a8c1-a0f714f40529 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80052024-12-02T16:53:41.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 40208af2-a41d-4593-a8c1-a0f714f40529 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80062024-12-02T16:53:42.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e5f4730e-a7c5-44ef-b4c8-a28612daaf2f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80072024-12-02T16:53:42.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e5f4730e-a7c5-44ef-b4c8-a28612daaf2f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80082024-12-02T16:53:42.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e5f4730e-a7c5-44ef-b4c8-a28612daaf2f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80092024-12-02T16:53:43.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 63ec720f-7311-47da-a487-de34bd80473e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80102024-12-02T16:53:43.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 63ec720f-7311-47da-a487-de34bd80473e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80112024-12-02T16:53:43.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 63ec720f-7311-47da-a487-de34bd80473e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80122024-12-02T16:53:44.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = feb808cd-7f92-4e2e-bca0-9de3e40e41ba roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80132024-12-02T16:53:44.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = feb808cd-7f92-4e2e-bca0-9de3e40e41ba resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80142024-12-02T16:53:44.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = feb808cd-7f92-4e2e-bca0-9de3e40e41ba response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80152024-12-02T16:53:45.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0eab827a-0039-4387-b966-b2399b82166a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80162024-12-02T16:53:45.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0eab827a-0039-4387-b966-b2399b82166a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80172024-12-02T16:53:45.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0eab827a-0039-4387-b966-b2399b82166a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80182024-12-02T16:53:46.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4d9f7870-f5df-4518-ace3-0179f4827905 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80192024-12-02T16:53:46.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4d9f7870-f5df-4518-ace3-0179f4827905 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80202024-12-02T16:53:46.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4d9f7870-f5df-4518-ace3-0179f4827905 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80212024-12-02T16:53:46.558ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1297 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = ea41dcf1-b9ec-46a5-8db6-26695d84dd4f response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
80222024-12-02T16:53:47.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fb074e9c-a44e-4d64-9a2e-89aa24dcf102 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80232024-12-02T16:53:47.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fb074e9c-a44e-4d64-9a2e-89aa24dcf102 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80242024-12-02T16:53:47.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fb074e9c-a44e-4d64-9a2e-89aa24dcf102 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80252024-12-02T16:53:47.698ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:47376
80262024-12-02T16:53:47.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47376 req_id = d55b147a-4bad-4461-85e9-57bdcf444a2c roles = RoleSet { roles: {} } uri = /metrics/producers
80272024-12-02T16:53:47.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47376 req_id = d55b147a-4bad-4461-85e9-57bdcf444a2c resource = Database result = Ok(()) uri = /metrics/producers
80282024-12-02T16:53:47.734ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = d6743efc-3f8c-4f9c-82eb-c8c8561c254a
80292024-12-02T16:53:47.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35939 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:47376 req_id = d55b147a-4bad-4461-85e9-57bdcf444a2c response_code = 201 uri = /metrics/producers
80302024-12-02T16:53:48.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = aa484b43-7b29-403e-8233-30e7d3a2decf roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80312024-12-02T16:53:48.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = aa484b43-7b29-403e-8233-30e7d3a2decf resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80322024-12-02T16:53:48.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = aa484b43-7b29-403e-8233-30e7d3a2decf response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80332024-12-02T16:53:49.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 8539548a-d3b2-4e78-9de4-4f37de34dc1c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
80342024-12-02T16:53:49.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 8539548a-d3b2-4e78-9de4-4f37de34dc1c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
80352024-12-02T16:53:49.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 8539548a-d3b2-4e78-9de4-4f37de34dc1c response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
80362024-12-02T16:53:49.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 332774f2-ce30-4a23-9c4e-a1702e3ee8fe roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80372024-12-02T16:53:49.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 332774f2-ce30-4a23-9c4e-a1702e3ee8fe resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80382024-12-02T16:53:49.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 332774f2-ce30-4a23-9c4e-a1702e3ee8fe response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
80392024-12-02T16:53:49.689ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:55109
80402024-12-02T16:53:49.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55109 req_id = 917145c6-f872-44d8-a6bd-bd92a7ffd7dd roles = RoleSet { roles: {} } uri = /metrics/producers
80412024-12-02T16:53:49.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55109 req_id = 917145c6-f872-44d8-a6bd-bd92a7ffd7dd resource = Database result = Ok(()) uri = /metrics/producers
80422024-12-02T16:53:49.727ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = 999318be-e8de-4392-9ed9-30887ef5bc8f
80432024-12-02T16:53:49.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37970 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55109 req_id = 917145c6-f872-44d8-a6bd-bd92a7ffd7dd response_code = 201 uri = /metrics/producers
80442024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
80452024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
80462024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
80472024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
80482024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80492024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80502024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
80512024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
80522024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80532024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80542024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80552024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
80562024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
80572024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80582024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
80592024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80602024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80612024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
80622024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
80632024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80642024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80652024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
80662024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
80672024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80682024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
80692024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80702024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
80712024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80722024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
80732024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
80742024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
80752024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
80762024-12-02T16:53:49.796ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
80772024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
80782024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
80792024-12-02T16:53:49.796ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c575ce6d-3e43-4b59-886a-60182869b755
80802024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
80812024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
80822024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.76\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"c575ce6d-3e43-4b59-886a-60182869b755"}
80832024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80842024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
80852024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80862024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
80872024-12-02T16:53:49.796ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-02 16:43:49.796623978 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
80882024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
80892024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
80902024-12-02T16:53:49.796ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
80912024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
80922024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
80932024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80942024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
80952024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80962024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
80972024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
80982024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
80992024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81002024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
81012024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
81022024-12-02T16:53:49.796ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
81032024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
81042024-12-02T16:53:49.796ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
81052024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
81062024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81072024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
81082024-12-02T16:53:49.796ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
81092024-12-02T16:53:49.796ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81102024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
81112024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
81122024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
81132024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
81142024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81152024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81162024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81172024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81182024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81192024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
81202024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81212024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
81222024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81232024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81242024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81252024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81262024-12-02T16:53:49.797ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5510b96c-d504-40ca-83bc-e27293be3abe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 25991, tv_nsec: 531461468 } })
81272024-12-02T16:53:49.797ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a1a23f6-3701-4a53-9e08-543f9ba04e60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5030471-1797-42f6-9660-1ead64511c29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 25991, tv_nsec: 531488079 } })
81282024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
81292024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81302024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
81312024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81322024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81332024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
81342024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81352024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
81362024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
81372024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81382024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
81392024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81402024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81412024-12-02T16:53:49.797ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
81422024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
81432024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81442024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
81452024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.397042ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
81462024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
81472024-12-02T16:53:49.797ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.380582ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
81482024-12-02T16:53:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81492024-12-02T16:53:49.799ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.361799ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
81502024-12-02T16:53:49.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81512024-12-02T16:53:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
81522024-12-02T16:53:49.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81532024-12-02T16:53:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81542024-12-02T16:53:49.805ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25991, tv_nsec: 540179315 } })
81552024-12-02T16:53:49.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
81562024-12-02T16:53:49.806ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25991, tv_nsec: 540849220 } })
81572024-12-02T16:53:49.806ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
81582024-12-02T16:53:49.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81592024-12-02T16:53:49.807ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81602024-12-02T16:53:49.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81612024-12-02T16:53:49.808ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-02 16:43:49.796623978 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
81622024-12-02T16:53:49.808ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.190187ms iteration = 11 status = {"expiration":"2024-12-02T16:43:49.796623978Z","pruned":[]}
81632024-12-02T16:53:49.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
81642024-12-02T16:53:49.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81652024-12-02T16:53:49.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81662024-12-02T16:53:49.819ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81672024-12-02T16:53:49.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81682024-12-02T16:53:49.819ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.218963ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
81692024-12-02T16:53:49.848ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81702024-12-02T16:53:49.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81712024-12-02T16:53:49.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81722024-12-02T16:53:49.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
81732024-12-02T16:53:49.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81742024-12-02T16:53:49.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81752024-12-02T16:53:49.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81762024-12-02T16:53:49.855ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81772024-12-02T16:53:49.856ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81782024-12-02T16:53:49.856ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25991, tv_nsec: 590812967 } })
81792024-12-02T16:53:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81802024-12-02T16:53:49.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81812024-12-02T16:53:49.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
81822024-12-02T16:53:49.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81832024-12-02T16:53:49.858ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
81842024-12-02T16:53:49.858ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
81852024-12-02T16:53:49.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
81862024-12-02T16:53:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81872024-12-02T16:53:49.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81882024-12-02T16:53:49.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81892024-12-02T16:53:49.860ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81902024-12-02T16:53:49.860ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
81912024-12-02T16:53:49.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81922024-12-02T16:53:49.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81932024-12-02T16:53:49.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81942024-12-02T16:53:49.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81952024-12-02T16:53:49.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81962024-12-02T16:53:49.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81972024-12-02T16:53:49.862ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81982024-12-02T16:53:49.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81992024-12-02T16:53:49.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82002024-12-02T16:53:49.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82012024-12-02T16:53:49.863ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82022024-12-02T16:53:49.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82032024-12-02T16:53:49.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82042024-12-02T16:53:49.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.619793ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82052024-12-02T16:53:49.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82062024-12-02T16:53:49.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82072024-12-02T16:53:49.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82082024-12-02T16:53:49.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82092024-12-02T16:53:49.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
82102024-12-02T16:53:49.864ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82112024-12-02T16:53:49.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82122024-12-02T16:53:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82132024-12-02T16:53:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82142024-12-02T16:53:49.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.60603ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
82152024-12-02T16:53:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
82162024-12-02T16:53:49.865ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
82172024-12-02T16:53:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
82182024-12-02T16:53:49.866ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82192024-12-02T16:53:49.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82202024-12-02T16:53:49.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82212024-12-02T16:53:49.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82222024-12-02T16:53:49.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82232024-12-02T16:53:49.868ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
82242024-12-02T16:53:49.868ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
82252024-12-02T16:53:49.868ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.810977ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
82262024-12-02T16:53:49.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82272024-12-02T16:53:49.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82282024-12-02T16:53:49.870ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(0492aad9-06a2-4633-8f56-94f1b1542924, 0), (b207e2b9-f0e1-4298-a85b-9b21fa2cee94, 0), (af77466e-f05f-4fb9-8afa-04d781491c67, 0), (cb007587-8ec3-4ab3-923f-ddd7d4b360a1, 0)] collection_id = 0492aad9-06a2-4633-8f56-94f1b1542924
82292024-12-02T16:53:49.870ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
82302024-12-02T16:53:49.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
82312024-12-02T16:53:49.871ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82322024-12-02T16:53:49.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82332024-12-02T16:53:49.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82342024-12-02T16:53:49.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.145728ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
82352024-12-02T16:53:49.872ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
82362024-12-02T16:53:49.872ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 146f6adb-e40b-4b1d-b8b9-8a268cdba75e
82372024-12-02T16:53:49.872ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 81762ca7-68f9-4883-8973-3a7ae005e265
82382024-12-02T16:53:49.872ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 29270c05-956d-4b69-8cea-3a4b54d697e2
82392024-12-02T16:53:49.872ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 146f6adb-e40b-4b1d-b8b9-8a268cdba75e
82402024-12-02T16:53:49.872ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 29270c05-956d-4b69-8cea-3a4b54d697e2
82412024-12-02T16:53:49.873ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82422024-12-02T16:53:49.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82432024-12-02T16:53:49.874ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82442024-12-02T16:53:49.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82452024-12-02T16:53:49.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82462024-12-02T16:53:49.874ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82472024-12-02T16:53:49.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82482024-12-02T16:53:49.875ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82492024-12-02T16:53:49.876ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
82502024-12-02T16:53:49.876ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.495724ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
82512024-12-02T16:53:49.876ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 81762ca7-68f9-4883-8973-3a7ae005e265
82522024-12-02T16:53:49.876ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 79.811677ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
82532024-12-02T16:53:49.876ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82542024-12-02T16:53:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82552024-12-02T16:53:49.878ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82562024-12-02T16:53:49.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82572024-12-02T16:53:49.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
82582024-12-02T16:53:49.881ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82592024-12-02T16:53:49.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82602024-12-02T16:53:49.883ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
82612024-12-02T16:53:49.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
82622024-12-02T16:53:49.900ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
82632024-12-02T16:53:49.900ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
82642024-12-02T16:53:49.900ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
82652024-12-02T16:53:49.900ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82662024-12-02T16:53:49.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82672024-12-02T16:53:49.902ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82682024-12-02T16:53:49.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82692024-12-02T16:53:49.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82702024-12-02T16:53:49.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82712024-12-02T16:53:49.909ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
82722024-12-02T16:53:49.909ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
82732024-12-02T16:53:49.909ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 112.950677ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
82742024-12-02T16:53:49.912ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
82752024-12-02T16:53:49.912ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 116.297247ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
82762024-12-02T16:53:49.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82772024-12-02T16:53:49.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82782024-12-02T16:53:49.913ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82792024-12-02T16:53:49.913ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
82802024-12-02T16:53:49.913ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82812024-12-02T16:53:49.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82822024-12-02T16:53:49.915ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82832024-12-02T16:53:49.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 118.97626ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82842024-12-02T16:53:49.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
82852024-12-02T16:53:49.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82862024-12-02T16:53:49.916ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.0542ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
82872024-12-02T16:53:49.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82882024-12-02T16:53:49.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82892024-12-02T16:53:49.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
82902024-12-02T16:53:49.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82912024-12-02T16:53:49.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82922024-12-02T16:53:49.924ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 127.450494ms iteration = 21 status = 0
82932024-12-02T16:53:49.925ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
82942024-12-02T16:53:49.925ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
82952024-12-02T16:53:49.925ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
82962024-12-02T16:53:49.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82972024-12-02T16:53:49.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82982024-12-02T16:53:49.927ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
82992024-12-02T16:53:49.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83002024-12-02T16:53:49.927ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
83012024-12-02T16:53:49.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
83022024-12-02T16:53:49.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83032024-12-02T16:53:49.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83042024-12-02T16:53:49.932ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
83052024-12-02T16:53:49.932ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
83062024-12-02T16:53:49.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83072024-12-02T16:53:49.932ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83082024-12-02T16:53:49.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83092024-12-02T16:53:49.933ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83102024-12-02T16:53:49.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83112024-12-02T16:53:49.934ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83122024-12-02T16:53:49.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.588731ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
83132024-12-02T16:53:49.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
83142024-12-02T16:53:49.935ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83152024-12-02T16:53:49.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83162024-12-02T16:53:49.937ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
83172024-12-02T16:53:49.937ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83182024-12-02T16:53:49.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83192024-12-02T16:53:49.939ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
83202024-12-02T16:53:49.939ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
83212024-12-02T16:53:49.939ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-02 16:44:11.214841 UTC dns_group = internal generation = 1
83222024-12-02T16:53:49.939ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 143.018651ms iteration = 12 status = {"generation":1}
83232024-12-02T16:53:49.940ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83242024-12-02T16:53:49.940ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83252024-12-02T16:53:49.941ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6f12b06-46ee-4b4a-b513-0574d8119c75", "content-length": "26", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
83262024-12-02T16:53:49.941ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83272024-12-02T16:53:49.941ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83282024-12-02T16:53:49.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83292024-12-02T16:53:49.942ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83302024-12-02T16:53:49.946ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83312024-12-02T16:53:49.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
83322024-12-02T16:53:49.950ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83332024-12-02T16:53:49.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83342024-12-02T16:53:49.951ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
83352024-12-02T16:53:49.951ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 0 version = 2
83362024-12-02T16:53:49.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83372024-12-02T16:53:49.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83382024-12-02T16:53:49.952ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83392024-12-02T16:53:49.952ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83402024-12-02T16:53:49.952ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83412024-12-02T16:53:49.952ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "238bb44a-4275-4207-9078-63f083f57872", "content-length": "26", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
83422024-12-02T16:53:49.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83432024-12-02T16:53:49.952ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83442024-12-02T16:53:49.953ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83452024-12-02T16:53:49.955ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83462024-12-02T16:53:49.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83472024-12-02T16:53:49.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83482024-12-02T16:53:49.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83492024-12-02T16:53:49.958ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 1 version = 2
83502024-12-02T16:53:49.958ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
83512024-12-02T16:53:49.958ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-02 16:44:12.116348 UTC dns_group = external generation = 2
83522024-12-02T16:53:49.958ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 162.174858ms iteration = 12 status = {"generation":2}
83532024-12-02T16:53:49.959ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83542024-12-02T16:53:49.959ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
83552024-12-02T16:53:49.959ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 162.831024ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
83562024-12-02T16:53:49.960ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 0492aad9-06a2-4633-8f56-94f1b1542924 file = nexus/db-queries/src/db/datastore/inventory.rs:1452 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
83572024-12-02T16:53:49.960ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
83582024-12-02T16:53:49.961ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
83592024-12-02T16:53:49.961ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 164.350287ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
83602024-12-02T16:53:49.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
83612024-12-02T16:53:49.967ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(b207e2b9-f0e1-4298-a85b-9b21fa2cee94, 0), (af77466e-f05f-4fb9-8afa-04d781491c67, 0), (cb007587-8ec3-4ab3-923f-ddd7d4b360a1, 0)]
83622024-12-02T16:53:49.967ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 25991, tv_nsec: 701856278 } })
83632024-12-02T16:53:49.977ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83642024-12-02T16:53:49.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83652024-12-02T16:53:49.979ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83662024-12-02T16:53:49.982ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
83672024-12-02T16:53:49.982ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83682024-12-02T16:53:49.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83692024-12-02T16:53:49.983ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83702024-12-02T16:53:49.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83712024-12-02T16:53:49.986ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83722024-12-02T16:53:49.988ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
83732024-12-02T16:53:49.989ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83742024-12-02T16:53:49.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83752024-12-02T16:53:49.991ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83762024-12-02T16:53:49.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83772024-12-02T16:53:49.993ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
83782024-12-02T16:53:49.993ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83792024-12-02T16:53:49.993ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a15883c0-0a55-485f-b300-3cbc04ce5ef7", "content-length": "26", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
83802024-12-02T16:53:49.993ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83812024-12-02T16:53:49.993ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83822024-12-02T16:53:49.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83832024-12-02T16:53:49.995ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
83842024-12-02T16:53:49.995ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83852024-12-02T16:53:49.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83862024-12-02T16:53:49.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83872024-12-02T16:53:49.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83882024-12-02T16:53:49.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83892024-12-02T16:53:49.997ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83902024-12-02T16:53:49.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83912024-12-02T16:53:49.999ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83922024-12-02T16:53:49.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83932024-12-02T16:53:50.000ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83942024-12-02T16:53:50.000ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83952024-12-02T16:53:50.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83962024-12-02T16:53:50.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
83972024-12-02T16:53:50.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
83982024-12-02T16:53:50.002ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83992024-12-02T16:53:50.002ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84002024-12-02T16:53:50.005ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84012024-12-02T16:53:50.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84022024-12-02T16:53:50.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84032024-12-02T16:53:50.006ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
84042024-12-02T16:53:50.006ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84052024-12-02T16:53:50.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84062024-12-02T16:53:50.008ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 212.448817ms iteration = 24 status = {"physical_disks_added":0}
84072024-12-02T16:53:50.030ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-02T16:43:45.642486Z, time_modified: 2024-12-02T16:43:45.642486Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }) }
84082024-12-02T16:53:50.030ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 233.903834ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]}},"default_endpoint":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
84092024-12-02T16:53:50.088ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
84102024-12-02T16:53:50.089ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5fc30103-e8f2-46a4-813a-5c417ce3a9af", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84112024-12-02T16:53:50.089ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84122024-12-02T16:53:50.090ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "31682390-7741-4cbe-8007-558d19871d06", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84132024-12-02T16:53:50.090ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84142024-12-02T16:53:50.092ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84152024-12-02T16:53:50.092ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 295.986657ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
84162024-12-02T16:53:50.125ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
84172024-12-02T16:53:50.148ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
84182024-12-02T16:53:50.148ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84192024-12-02T16:53:50.148ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8195331c-98a7-4c56-8d7b-a307577f340c", "content-length": "372", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} })
84202024-12-02T16:53:50.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84212024-12-02T16:53:50.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84222024-12-02T16:53:50.150ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84232024-12-02T16:53:50.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84242024-12-02T16:53:50.152ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84252024-12-02T16:53:50.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84262024-12-02T16:53:50.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84272024-12-02T16:53:50.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84282024-12-02T16:53:50.161ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 365.339463ms iteration = 21 status = {}
84292024-12-02T16:53:50.191ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
84302024-12-02T16:53:50.191ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
84312024-12-02T16:53:50.191ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "51126ac2-507f-4692-9a60-7a34cc5ea98e", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} })
84322024-12-02T16:53:50.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84332024-12-02T16:53:50.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84342024-12-02T16:53:50.207ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
84352024-12-02T16:53:50.207ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dd61322-6096-4287-9d09-ee536b254fc7", "content-length": "1", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84362024-12-02T16:53:50.209ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84372024-12-02T16:53:50.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84382024-12-02T16:53:50.221ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
84392024-12-02T16:53:50.222ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "33f7b69c-9fa6-47d0-95d2-70d8517ea19f", "content-length": "691", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} })
84402024-12-02T16:53:50.222ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
84412024-12-02T16:53:50.222ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
84422024-12-02T16:53:50.222ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
84432024-12-02T16:53:50.223ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 427.393206ms iteration = 21 status = {}
84442024-12-02T16:53:50.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84452024-12-02T16:53:50.224ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84462024-12-02T16:53:50.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84472024-12-02T16:53:50.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84482024-12-02T16:53:50.225ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 428.567476ms iteration = 21 status = null
84492024-12-02T16:53:50.227ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84502024-12-02T16:53:50.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84512024-12-02T16:53:50.228ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84522024-12-02T16:53:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84532024-12-02T16:53:50.229ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84542024-12-02T16:53:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84552024-12-02T16:53:50.231ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84562024-12-02T16:53:50.232ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
84572024-12-02T16:53:50.232ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84582024-12-02T16:53:50.233ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "69984f3a-7039-4545-8fd6-5224f3012348", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} })
84592024-12-02T16:53:50.233ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
84602024-12-02T16:53:50.233ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
84612024-12-02T16:53:50.233ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
84622024-12-02T16:53:50.234ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fc63add-f5c4-4ee7-9f91-fb5352ae0afc", "content-length": "476", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84632024-12-02T16:53:50.234ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
84642024-12-02T16:53:50.234ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b8c79f1-4d41-4743-bdb0-1aac0bb7ae58", "content-length": "734", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84652024-12-02T16:53:50.234ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
84662024-12-02T16:53:50.235ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e1151cb-f4fd-4e92-9887-1ce54f05e5d4", "content-length": "111", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84672024-12-02T16:53:50.235ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
84682024-12-02T16:53:50.235ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 438.674624ms iteration = 22 status = {}
84692024-12-02T16:53:50.235ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9384004f-8709-4eff-92ce-9ae78dadd5fd", "content-length": "111", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84702024-12-02T16:53:50.235ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
84712024-12-02T16:53:50.236ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d01f03b1-31bf-44d9-8492-24f9b00fd363", "content-length": "167", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84722024-12-02T16:53:50.236ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
84732024-12-02T16:53:50.236ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "97338bce-e766-4641-a9da-a159b3dd10fd", "content-length": "167", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84742024-12-02T16:53:50.236ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
84752024-12-02T16:53:50.236ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bc3187f-7042-4705-9f34-0c7090d06412", "content-length": "175", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84762024-12-02T16:53:50.236ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
84772024-12-02T16:53:50.236ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
84782024-12-02T16:53:50.236ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84792024-12-02T16:53:50.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
84802024-12-02T16:53:50.237ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "437c9505-04d0-469d-8955-3acef2915505", "content-length": "175", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84812024-12-02T16:53:50.237ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
84822024-12-02T16:53:50.237ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "acb63ca3-0376-4571-a387-fd3f94664e96", "content-length": "702", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84832024-12-02T16:53:50.237ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
84842024-12-02T16:53:50.237ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb2225bb-1376-487d-beb8-05c7abb61cab", "content-length": "727", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84852024-12-02T16:53:50.237ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
84862024-12-02T16:53:50.237ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4811490f-1fbc-4933-bd45-313c2a47b477", "content-length": "729", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84872024-12-02T16:53:50.237ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
84882024-12-02T16:53:50.237ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "000533b3-1c65-48f2-abb3-7dd69d51d9ca", "content-length": "728", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84892024-12-02T16:53:50.237ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
84902024-12-02T16:53:50.238ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e21d522a-9f02-414f-9096-d51e3ef14f0e", "content-length": "722", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84912024-12-02T16:53:50.238ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
84922024-12-02T16:53:50.238ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd4dbc9a-4b79-4e22-b52f-f9ef1f0bda76", "content-length": "109", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84932024-12-02T16:53:50.238ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
84942024-12-02T16:53:50.238ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "50695576-66f6-42c9-9fa8-62efe8d35f0a", "content-length": "109", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84952024-12-02T16:53:50.238ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
84962024-12-02T16:53:50.239ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3369910-0acb-4173-97da-f9a178137aee", "content-length": "169", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
84972024-12-02T16:53:50.239ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
84982024-12-02T16:53:50.239ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
84992024-12-02T16:53:50.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85002024-12-02T16:53:50.239ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b7d6f12-1dff-4418-bf22-0c6c4eb15d79", "content-length": "169", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
85012024-12-02T16:53:50.239ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
85022024-12-02T16:53:50.239ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
85032024-12-02T16:53:50.239ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a298c369-d3d5-439d-a053-af9e94921b78", "content-length": "178", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
85042024-12-02T16:53:50.239ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
85052024-12-02T16:53:50.240ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe2abbb1-cf79-4116-916d-4a078f650dd8", "content-length": "178", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
85062024-12-02T16:53:50.240ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
85072024-12-02T16:53:50.240ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f582fe3f-c5aa-40c0-8f35-1ae218a00d92", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
85082024-12-02T16:53:50.240ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
85092024-12-02T16:53:50.240ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85102024-12-02T16:53:50.240ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ed689d4-23e1-41cd-8d36-5206fddd8b05", "content-length": "702", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
85112024-12-02T16:53:50.240ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
85122024-12-02T16:53:50.240ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "af44e190-3b96-47de-a5c8-8d42cdfc6eca", "content-length": "727", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
85132024-12-02T16:53:50.241ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
85142024-12-02T16:53:50.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85152024-12-02T16:53:50.241ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "46ee4f65-58b0-41c5-b7ac-2f5e25d57bde", "content-length": "729", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
85162024-12-02T16:53:50.241ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
85172024-12-02T16:53:50.241ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6641151d-4b62-46dc-99bf-1e45a9bfeb1e", "content-length": "728", "date": "Mon, 02 Dec 2024 16:53:49 GMT"} })
85182024-12-02T16:53:50.241ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
85192024-12-02T16:53:50.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
85202024-12-02T16:53:50.242ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8f0f7333-dda0-4c11-a48d-123be935e4ad", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
85212024-12-02T16:53:50.242ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
85222024-12-02T16:53:50.242ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85232024-12-02T16:53:50.243ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85242024-12-02T16:53:50.245ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "071334ae-42cd-4248-a0ff-297814db3d36", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
85252024-12-02T16:53:50.245ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
85262024-12-02T16:53:50.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
85272024-12-02T16:53:50.246ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
85282024-12-02T16:53:50.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
85292024-12-02T16:53:50.247ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
85302024-12-02T16:53:50.247ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 451.295774ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
85312024-12-02T16:53:50.247ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
85322024-12-02T16:53:50.247ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85332024-12-02T16:53:50.248ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85342024-12-02T16:53:50.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85352024-12-02T16:53:50.250ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
85362024-12-02T16:53:50.250ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
85372024-12-02T16:53:50.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
85382024-12-02T16:53:50.254ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85392024-12-02T16:53:50.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85402024-12-02T16:53:50.256ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85412024-12-02T16:53:50.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85422024-12-02T16:53:50.259ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85432024-12-02T16:53:50.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85442024-12-02T16:53:50.262ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85452024-12-02T16:53:50.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85462024-12-02T16:53:50.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85472024-12-02T16:53:50.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85482024-12-02T16:53:50.326ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
85492024-12-02T16:53:50.326ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
85502024-12-02T16:53:50.328ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85512024-12-02T16:53:50.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85522024-12-02T16:53:50.330ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85532024-12-02T16:53:50.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85542024-12-02T16:53:50.332ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85552024-12-02T16:53:50.337ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85562024-12-02T16:53:50.337ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
85572024-12-02T16:53:50.337ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85582024-12-02T16:53:50.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85592024-12-02T16:53:50.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85602024-12-02T16:53:50.338ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85612024-12-02T16:53:50.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85622024-12-02T16:53:50.339ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
85632024-12-02T16:53:50.339ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85642024-12-02T16:53:50.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85652024-12-02T16:53:50.340ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85662024-12-02T16:53:50.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85672024-12-02T16:53:50.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85682024-12-02T16:53:50.345ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
85692024-12-02T16:53:50.345ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85702024-12-02T16:53:50.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85712024-12-02T16:53:50.349ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85722024-12-02T16:53:50.350ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "546b0f88-9338-4e4e-a75c-2daba7aec1e5", "content-length": "134", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} })
85732024-12-02T16:53:50.350ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85742024-12-02T16:53:50.350ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
85752024-12-02T16:53:50.350ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85762024-12-02T16:53:50.350ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85772024-12-02T16:53:50.350ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85782024-12-02T16:53:50.350ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85792024-12-02T16:53:50.350ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85802024-12-02T16:53:50.350ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85812024-12-02T16:53:50.350ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85822024-12-02T16:53:50.350ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85832024-12-02T16:53:50.350ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
85842024-12-02T16:53:50.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85852024-12-02T16:53:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85862024-12-02T16:53:50.352ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85872024-12-02T16:53:50.352ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7dcbb6bf-21c6-4e3a-9ca7-1b75b3606f50", "content-length": "2", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} })
85882024-12-02T16:53:50.352ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85892024-12-02T16:53:50.352ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e65e6abe-9943-40ab-9fd9-de5a274d0ffa", "content-length": "52", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} })
85902024-12-02T16:53:50.352ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
85912024-12-02T16:53:50.352ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85922024-12-02T16:53:50.361ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 936229ab-d10a-4f8c-8bea-15ce4db2d97f, kind: Service { id: aecb31a5-75ac-4a9f-bc12-71eca3dc990f }, name: Name("nexus-aecb31a5-75ac-4a9f-bc12-71eca3dc990f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 195])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3b2c589-11d0-4eac-9249-aaa6e4692507, kind: Service { id: e3a2206d-5fc8-4c68-ac44-4ca4fdf3d85b }, name: Name("nexus-e3a2206d-5fc8-4c68-ac44-4ca4fdf3d85b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc168541-f9e5-40eb-82bf-71648886c506, kind: Service { id: 09079b37-9a62-4b04-a7f7-99297d26aab2 }, name: Name("nexus-09079b37-9a62-4b04-a7f7-99297d26aab2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0c599830-7ce4-4624-ac95-0291168a133e, kind: Service { id: efa28bff-324d-4515-8bf9-4ea313797b64 }, name: Name("external-dns-efa28bff-324d-4515-8bf9-4ea313797b64"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 74523f0d-3c18-436d-892f-81007dc1ad64, kind: Service { id: 5510b96c-d504-40ca-83bc-e27293be3abe }, name: Name("external-dns-5510b96c-d504-40ca-83bc-e27293be3abe"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 108])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
85932024-12-02T16:53:50.361ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85942024-12-02T16:53:50.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85952024-12-02T16:53:50.363ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85962024-12-02T16:53:50.365ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
85972024-12-02T16:53:50.365ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85982024-12-02T16:53:50.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85992024-12-02T16:53:50.367ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
86002024-12-02T16:53:50.367ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0c599830-7ce4-4624-ac95-0291168a133e, kind: Service { id: efa28bff-324d-4515-8bf9-4ea313797b64 }, name: Name("external-dns-efa28bff-324d-4515-8bf9-4ea313797b64"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 141, 60])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 74523f0d-3c18-436d-892f-81007dc1ad64, kind: Service { id: 5510b96c-d504-40ca-83bc-e27293be3abe }, name: Name("external-dns-5510b96c-d504-40ca-83bc-e27293be3abe"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 108])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 936229ab-d10a-4f8c-8bea-15ce4db2d97f, kind: Service { id: aecb31a5-75ac-4a9f-bc12-71eca3dc990f }, name: Name("nexus-aecb31a5-75ac-4a9f-bc12-71eca3dc990f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 195])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3b2c589-11d0-4eac-9249-aaa6e4692507, kind: Service { id: e3a2206d-5fc8-4c68-ac44-4ca4fdf3d85b }, name: Name("nexus-e3a2206d-5fc8-4c68-ac44-4ca4fdf3d85b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 171])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cc168541-f9e5-40eb-82bf-71648886c506, kind: Service { id: 09079b37-9a62-4b04-a7f7-99297d26aab2 }, name: Name("nexus-09079b37-9a62-4b04-a7f7-99297d26aab2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
86012024-12-02T16:53:50.367ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
86022024-12-02T16:53:50.450ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2492dc66-082f-4a32-bbcd-406ffad8973c", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} })
86032024-12-02T16:53:50.450ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
86042024-12-02T16:53:50.450ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
86052024-12-02T16:53:50.451ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "906befd4-05b8-44f2-b10c-9b41bb160adf", "content-length": "682", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} })
86062024-12-02T16:53:50.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86072024-12-02T16:53:50.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86082024-12-02T16:53:50.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86092024-12-02T16:53:50.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86102024-12-02T16:53:50.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86112024-12-02T16:53:50.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86122024-12-02T16:53:50.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86132024-12-02T16:53:50.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86142024-12-02T16:53:50.467ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 671.402389ms iteration = 21 status = {}
86152024-12-02T16:53:50.480ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, time_created: 2024-12-02T16:44:07.899032Z, time_modified: 2024-12-02T16:44:07.899032Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
86162024-12-02T16:53:50.480ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
86172024-12-02T16:53:50.480ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86182024-12-02T16:53:50.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86192024-12-02T16:53:50.482ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86202024-12-02T16:53:50.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86212024-12-02T16:53:50.484ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86222024-12-02T16:53:50.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
86232024-12-02T16:53:50.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = af4b78cb-1eb5-4fac-a14c-fb5821554505 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86242024-12-02T16:53:50.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = af4b78cb-1eb5-4fac-a14c-fb5821554505 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86252024-12-02T16:53:50.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = af4b78cb-1eb5-4fac-a14c-fb5821554505 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86262024-12-02T16:53:50.520ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
86272024-12-02T16:53:50.520ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "3af552a6-0b69-4aa2-8118-146af05cd24e", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} })
86282024-12-02T16:53:50.522ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
86292024-12-02T16:53:50.522ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 725.568192ms
86302024-12-02T16:53:50.522ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 725.579962ms iteration = 3 status = {}
86312024-12-02T16:53:50.543ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "e858462f-5293-4d9a-8a04-cc22a7c714fc", "content-length": "30800", "date": "Mon, 02 Dec 2024 16:53:50 GMT"} })
86322024-12-02T16:53:50.545ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
86332024-12-02T16:53:50.545ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
86342024-12-02T16:53:50.545ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
86352024-12-02T16:53:50.546ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
86362024-12-02T16:53:50.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
86372024-12-02T16:53:50.548ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86382024-12-02T16:53:50.550ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
86392024-12-02T16:53:50.550ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
86402024-12-02T16:53:50.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
86412024-12-02T16:53:50.704ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 75867222-254d-4d93-8421-b22ad4637eec file = nexus/db-queries/src/db/datastore/inventory.rs:1006
86422024-12-02T16:53:50.704ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 75867222-254d-4d93-8421-b22ad4637eec time_started = 2024-12-02 16:53:50.233909 UTC
86432024-12-02T16:53:50.704ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 908.522351ms iteration = 4 status = {"collection_id":"75867222-254d-4d93-8421-b22ad4637eec","time_done":"2024-12-02 16:53:50.545080 UTC","time_started":"2024-12-02 16:53:50.233909 UTC"}
86442024-12-02T16:53:50.704ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
86452024-12-02T16:53:50.704ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86462024-12-02T16:53:50.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86472024-12-02T16:53:50.707ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86482024-12-02T16:53:50.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86492024-12-02T16:53:50.708ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86502024-12-02T16:53:50.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86512024-12-02T16:53:50.711ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86522024-12-02T16:53:50.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86532024-12-02T16:53:50.713ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86542024-12-02T16:53:50.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86552024-12-02T16:53:50.715ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86562024-12-02T16:53:50.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86572024-12-02T16:53:50.749ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 44.470348ms iteration = 25 status = {"physical_disks_added":0}
86582024-12-02T16:53:51.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0d7ce402-5d26-45f7-9d08-1b9577af7225 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86592024-12-02T16:53:51.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0d7ce402-5d26-45f7-9d08-1b9577af7225 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86602024-12-02T16:53:51.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0d7ce402-5d26-45f7-9d08-1b9577af7225 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86612024-12-02T16:53:52.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b04d3923-8296-41d8-a3ba-888f43121234 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86622024-12-02T16:53:52.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b04d3923-8296-41d8-a3ba-888f43121234 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86632024-12-02T16:53:52.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b04d3923-8296-41d8-a3ba-888f43121234 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86642024-12-02T16:53:53.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 86040d6a-760f-4317-bf57-2b625492413a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86652024-12-02T16:53:53.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 86040d6a-760f-4317-bf57-2b625492413a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86662024-12-02T16:53:53.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 86040d6a-760f-4317-bf57-2b625492413a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86672024-12-02T16:53:54.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 30f33153-05cd-40b5-8e86-f990e1225149 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86682024-12-02T16:53:54.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 30f33153-05cd-40b5-8e86-f990e1225149 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86692024-12-02T16:53:54.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 30f33153-05cd-40b5-8e86-f990e1225149 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86702024-12-02T16:53:55.443ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:58981
86712024-12-02T16:53:55.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58981 req_id = 7c3dbf06-560f-4893-8df3-ca757e94831d roles = RoleSet { roles: {} } uri = /metrics/producers
86722024-12-02T16:53:55.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58981 req_id = 7c3dbf06-560f-4893-8df3-ca757e94831d resource = Database result = Ok(()) uri = /metrics/producers
86732024-12-02T16:53:55.454ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = c94a6654-1297-4865-84af-bb83693635c3
86742024-12-02T16:53:55.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10735 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58981 req_id = 7c3dbf06-560f-4893-8df3-ca757e94831d response_code = 201 uri = /metrics/producers
86752024-12-02T16:53:55.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 57eb302c-93ac-43fa-be21-332cc8299ef7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86762024-12-02T16:53:55.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 57eb302c-93ac-43fa-be21-332cc8299ef7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86772024-12-02T16:53:55.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 57eb302c-93ac-43fa-be21-332cc8299ef7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86782024-12-02T16:53:56.559ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1290 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 83b7cc5f-45c7-4d8e-9b93-1398ba10a69a response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
86792024-12-02T16:53:56.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 375f580c-42bf-484e-8b01-07e3efb7416d roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86802024-12-02T16:53:56.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 375f580c-42bf-484e-8b01-07e3efb7416d resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86812024-12-02T16:53:56.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 375f580c-42bf-484e-8b01-07e3efb7416d response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86822024-12-02T16:53:57.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4f03b7ba-b739-4f86-811f-4baf4d944922 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86832024-12-02T16:53:57.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4f03b7ba-b739-4f86-811f-4baf4d944922 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86842024-12-02T16:53:57.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4f03b7ba-b739-4f86-811f-4baf4d944922 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86852024-12-02T16:53:58.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a02c16f2-65a5-47a9-807f-04005d2ff593 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86862024-12-02T16:53:58.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a02c16f2-65a5-47a9-807f-04005d2ff593 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86872024-12-02T16:53:58.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a02c16f2-65a5-47a9-807f-04005d2ff593 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86882024-12-02T16:53:59.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 480c4459-320a-44a4-8b28-e340abf7ee41 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86892024-12-02T16:53:59.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 480c4459-320a-44a4-8b28-e340abf7ee41 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86902024-12-02T16:53:59.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 480c4459-320a-44a4-8b28-e340abf7ee41 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
86912024-12-02T16:53:59.795ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
86922024-12-02T16:53:59.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86932024-12-02T16:53:59.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
86942024-12-02T16:53:59.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86952024-12-02T16:53:59.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86962024-12-02T16:53:59.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86972024-12-02T16:53:59.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86982024-12-02T16:53:59.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86992024-12-02T16:53:59.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87002024-12-02T16:53:59.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87012024-12-02T16:53:59.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87022024-12-02T16:53:59.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.225884ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87032024-12-02T16:53:59.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87042024-12-02T16:53:59.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87052024-12-02T16:53:59.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87062024-12-02T16:53:59.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87072024-12-02T16:53:59.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
87082024-12-02T16:53:59.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87092024-12-02T16:53:59.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87102024-12-02T16:53:59.827ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
87112024-12-02T16:53:59.827ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.116672ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
87122024-12-02T16:54:00.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bcd37dd1-d7e2-4764-86a0-0e575a41dec8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87132024-12-02T16:54:00.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bcd37dd1-d7e2-4764-86a0-0e575a41dec8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87142024-12-02T16:54:00.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bcd37dd1-d7e2-4764-86a0-0e575a41dec8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87152024-12-02T16:54:01.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d1840b06-f75c-426f-914b-95fd7ca2981c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87162024-12-02T16:54:01.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d1840b06-f75c-426f-914b-95fd7ca2981c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87172024-12-02T16:54:01.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d1840b06-f75c-426f-914b-95fd7ca2981c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87182024-12-02T16:54:02.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a86cdfc5-9bbd-4014-b50d-fad58eb9b632 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87192024-12-02T16:54:02.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a86cdfc5-9bbd-4014-b50d-fad58eb9b632 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87202024-12-02T16:54:02.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1951 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a86cdfc5-9bbd-4014-b50d-fad58eb9b632 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87212024-12-02T16:54:02.922ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:38591
87222024-12-02T16:54:02.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38591 req_id = 94769dca-b7a4-4606-97a9-4016977ec038 roles = RoleSet { roles: {} } uri = /metrics/producers
87232024-12-02T16:54:02.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38591 req_id = 94769dca-b7a4-4606-97a9-4016977ec038 resource = Database result = Ok(()) uri = /metrics/producers
87242024-12-02T16:54:02.935ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87252024-12-02T16:54:02.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13020 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38591 req_id = 94769dca-b7a4-4606-97a9-4016977ec038 response_code = 201 uri = /metrics/producers
87262024-12-02T16:54:03.079ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:41989
87272024-12-02T16:54:03.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41989 req_id = b2b9de22-d4d2-47a1-9b0e-06d63fff839a roles = RoleSet { roles: {} } uri = /metrics/producers
87282024-12-02T16:54:03.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41989 req_id = b2b9de22-d4d2-47a1-9b0e-06d63fff839a resource = Database result = Ok(()) uri = /metrics/producers
87292024-12-02T16:54:03.116ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = f1994180-91a5-4667-ac8f-de00c9b09458
87302024-12-02T16:54:03.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36983 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41989 req_id = b2b9de22-d4d2-47a1-9b0e-06d63fff839a response_code = 201 uri = /metrics/producers
87312024-12-02T16:54:03.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8cc694a4-e7a0-4b00-9560-d70556c87ac0 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87322024-12-02T16:54:03.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8cc694a4-e7a0-4b00-9560-d70556c87ac0 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87332024-12-02T16:54:03.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8cc694a4-e7a0-4b00-9560-d70556c87ac0 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87342024-12-02T16:54:04.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d85c3a25-9a88-4727-9b3a-cf1d45b37424 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87352024-12-02T16:54:04.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d85c3a25-9a88-4727-9b3a-cf1d45b37424 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87362024-12-02T16:54:04.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d85c3a25-9a88-4727-9b3a-cf1d45b37424 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87372024-12-02T16:54:05.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d70b4660-fc01-4161-9425-cac753e18054 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87382024-12-02T16:54:05.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d70b4660-fc01-4161-9425-cac753e18054 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87392024-12-02T16:54:05.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1875 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d70b4660-fc01-4161-9425-cac753e18054 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87402024-12-02T16:54:06.512ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:64785
87412024-12-02T16:54:06.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64785 req_id = c410257a-3bcf-4f24-aef1-8ff2ea07029b roles = RoleSet { roles: {} } uri = /metrics/producers
87422024-12-02T16:54:06.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64785 req_id = c410257a-3bcf-4f24-aef1-8ff2ea07029b resource = Database result = Ok(()) uri = /metrics/producers
87432024-12-02T16:54:06.522ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = bcacf9eb-c8be-49ce-bc71-4d5ced99f0ed
87442024-12-02T16:54:06.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9389 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64785 req_id = c410257a-3bcf-4f24-aef1-8ff2ea07029b response_code = 201 uri = /metrics/producers
87452024-12-02T16:54:06.559ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1453 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 232e2b8d-e73f-4222-af6c-57711002e04a response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
87462024-12-02T16:54:06.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0e23169d-629a-40ca-9abb-a6d1ee7a07d7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87472024-12-02T16:54:06.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0e23169d-629a-40ca-9abb-a6d1ee7a07d7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87482024-12-02T16:54:06.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0e23169d-629a-40ca-9abb-a6d1ee7a07d7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87492024-12-02T16:54:07.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7a4819ca-90eb-4dd3-b29f-cdb02acd640b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87502024-12-02T16:54:07.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7a4819ca-90eb-4dd3-b29f-cdb02acd640b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87512024-12-02T16:54:07.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7a4819ca-90eb-4dd3-b29f-cdb02acd640b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87522024-12-02T16:54:08.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 527f6ce2-868c-4982-85f0-f2a861fe811c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87532024-12-02T16:54:08.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 527f6ce2-868c-4982-85f0-f2a861fe811c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87542024-12-02T16:54:08.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 527f6ce2-868c-4982-85f0-f2a861fe811c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87552024-12-02T16:54:09.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
87562024-12-02T16:54:09.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
87572024-12-02T16:54:09.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87582024-12-02T16:54:09.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87592024-12-02T16:54:09.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87602024-12-02T16:54:09.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87612024-12-02T16:54:09.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87622024-12-02T16:54:09.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87632024-12-02T16:54:09.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87642024-12-02T16:54:09.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87652024-12-02T16:54:09.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87662024-12-02T16:54:09.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87672024-12-02T16:54:09.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87682024-12-02T16:54:09.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87692024-12-02T16:54:09.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87702024-12-02T16:54:09.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
87712024-12-02T16:54:09.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87722024-12-02T16:54:09.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87732024-12-02T16:54:09.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
87742024-12-02T16:54:09.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.895832ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
87752024-12-02T16:54:09.828ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.191932ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87762024-12-02T16:54:09.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e27c5fd5-b8c3-4b5b-abc8-e217f0e7ec8b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87772024-12-02T16:54:09.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e27c5fd5-b8c3-4b5b-abc8-e217f0e7ec8b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87782024-12-02T16:54:09.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e27c5fd5-b8c3-4b5b-abc8-e217f0e7ec8b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87792024-12-02T16:54:10.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8105420b-5049-4855-b242-c7d530ff9f6c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87802024-12-02T16:54:10.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8105420b-5049-4855-b242-c7d530ff9f6c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87812024-12-02T16:54:10.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8105420b-5049-4855-b242-c7d530ff9f6c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87822024-12-02T16:54:11.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 09a024c6-c39e-4c88-b0b3-1aded767ec8e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87832024-12-02T16:54:11.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 09a024c6-c39e-4c88-b0b3-1aded767ec8e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87842024-12-02T16:54:11.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 09a024c6-c39e-4c88-b0b3-1aded767ec8e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87852024-12-02T16:54:12.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3687b02e-9391-4f9b-8332-06f71b2e8d45 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87862024-12-02T16:54:12.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3687b02e-9391-4f9b-8332-06f71b2e8d45 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87872024-12-02T16:54:12.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3687b02e-9391-4f9b-8332-06f71b2e8d45 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
87882024-12-02T16:54:13.161ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
87892024-12-02T16:54:13.161ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
87902024-12-02T16:54:13.192ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
87912024-12-02T16:54:13.192ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:33230
87922024-12-02T16:54:13.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33230 req_id = ea92aab8-b151-416b-9cd1-0c6e11d7cd2b roles = RoleSet { roles: {} } uri = /metrics/producers
87932024-12-02T16:54:13.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33230 req_id = ea92aab8-b151-416b-9cd1-0c6e11d7cd2b resource = Database result = Ok(()) uri = /metrics/producers
87942024-12-02T16:54:13.204ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
87952024-12-02T16:54:13.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11315 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:33230 req_id = ea92aab8-b151-416b-9cd1-0c6e11d7cd2b response_code = 201 uri = /metrics/producers
87962024-12-02T16:54:13.204ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "ea92aab8-b151-416b-9cd1-0c6e11d7cd2b", "content-length": "41", "date": "Mon, 02 Dec 2024 16:54:13 GMT"} })
87972024-12-02T16:54:13.206ZDEBGnexus (producer-registration-task): registered with nexus successfully
87982024-12-02T16:54:13.206ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
87992024-12-02T16:54:13.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b66fd2d5-17cf-4b0c-9253-6a3455e9369e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88002024-12-02T16:54:13.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b66fd2d5-17cf-4b0c-9253-6a3455e9369e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88012024-12-02T16:54:14.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b66fd2d5-17cf-4b0c-9253-6a3455e9369e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88022024-12-02T16:54:15.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7542092-5933-4ccc-b854-f78ffd09a643 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88032024-12-02T16:54:15.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7542092-5933-4ccc-b854-f78ffd09a643 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88042024-12-02T16:54:15.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7542092-5933-4ccc-b854-f78ffd09a643 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88052024-12-02T16:54:16.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2536d2d5-327e-4c8d-a114-617073abc7c3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88062024-12-02T16:54:16.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2536d2d5-327e-4c8d-a114-617073abc7c3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88072024-12-02T16:54:16.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2536d2d5-327e-4c8d-a114-617073abc7c3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88082024-12-02T16:54:16.559ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1298 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 4af807fb-6557-4d03-a188-ca68425884c1 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
88092024-12-02T16:54:17.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4a54755f-4d15-4eaf-8a9b-e49d6a1037ca roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88102024-12-02T16:54:17.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4a54755f-4d15-4eaf-8a9b-e49d6a1037ca resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88112024-12-02T16:54:17.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4a54755f-4d15-4eaf-8a9b-e49d6a1037ca response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88122024-12-02T16:54:18.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e0f6a831-ee22-46cc-9678-1355c95dc343 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88132024-12-02T16:54:18.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e0f6a831-ee22-46cc-9678-1355c95dc343 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88142024-12-02T16:54:18.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e0f6a831-ee22-46cc-9678-1355c95dc343 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88152024-12-02T16:54:19.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e5432bd4-47eb-4fa6-ac7b-00e445cdcd0b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88162024-12-02T16:54:19.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e5432bd4-47eb-4fa6-ac7b-00e445cdcd0b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88172024-12-02T16:54:19.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e5432bd4-47eb-4fa6-ac7b-00e445cdcd0b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
88182024-12-02T16:54:19.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = d06ea11c-a400-45c2-b44f-195c166d291b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
88192024-12-02T16:54:19.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = d06ea11c-a400-45c2-b44f-195c166d291b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
88202024-12-02T16:54:19.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = d06ea11c-a400-45c2-b44f-195c166d291b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
88212024-12-02T16:54:19.796ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
88222024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88232024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
88242024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
88252024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
88262024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88272024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
88282024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88292024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88302024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
88312024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88322024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
88332024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
88342024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88352024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
88362024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
88372024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
88382024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88392024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88402024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88412024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
88422024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88432024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88442024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88452024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88462024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88472024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88482024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88492024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88502024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88512024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88522024-12-02T16:54:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88532024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
88542024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
88552024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88562024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
88572024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
88582024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
88592024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
88602024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88612024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
88622024-12-02T16:54:19.798ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
88632024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88642024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
88652024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88662024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88672024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88682024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88692024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88702024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88712024-12-02T16:54:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
88722024-12-02T16:54:19.800ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26021, tv_nsec: 534548496 } })
88732024-12-02T16:54:19.801ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26021, tv_nsec: 534760147 } })
88742024-12-02T16:54:19.801ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
88752024-12-02T16:54:19.801ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.202157ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88762024-12-02T16:54:19.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88772024-12-02T16:54:19.801ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
88782024-12-02T16:54:19.802ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88792024-12-02T16:54:19.802ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88802024-12-02T16:54:19.802ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88812024-12-02T16:54:19.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88822024-12-02T16:54:19.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88832024-12-02T16:54:19.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88842024-12-02T16:54:19.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88852024-12-02T16:54:19.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88862024-12-02T16:54:19.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88872024-12-02T16:54:19.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88882024-12-02T16:54:19.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88892024-12-02T16:54:19.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88902024-12-02T16:54:19.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88912024-12-02T16:54:19.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88922024-12-02T16:54:19.807ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88932024-12-02T16:54:19.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88942024-12-02T16:54:19.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88952024-12-02T16:54:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88962024-12-02T16:54:19.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.011964ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88972024-12-02T16:54:19.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88982024-12-02T16:54:19.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88992024-12-02T16:54:19.811ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89002024-12-02T16:54:19.811ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89012024-12-02T16:54:19.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89022024-12-02T16:54:19.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89032024-12-02T16:54:19.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89042024-12-02T16:54:19.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89052024-12-02T16:54:19.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89062024-12-02T16:54:19.812ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26021, tv_nsec: 546448620 } })
89072024-12-02T16:54:19.813ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
89082024-12-02T16:54:19.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89092024-12-02T16:54:19.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89102024-12-02T16:54:19.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89112024-12-02T16:54:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
89122024-12-02T16:54:19.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89132024-12-02T16:54:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89142024-12-02T16:54:19.819ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89152024-12-02T16:54:19.819ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
89162024-12-02T16:54:19.819ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 22.319364ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
89172024-12-02T16:54:19.839ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
89182024-12-02T16:54:19.839ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.507281ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
89192024-12-02T16:54:19.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89202024-12-02T16:54:19.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89212024-12-02T16:54:19.841ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89222024-12-02T16:54:19.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89232024-12-02T16:54:19.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.220844ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
89242024-12-02T16:54:19.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89252024-12-02T16:54:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89262024-12-02T16:54:19.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89272024-12-02T16:54:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89282024-12-02T16:54:19.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 51.802013ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
89292024-12-02T16:54:19.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89302024-12-02T16:54:19.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89312024-12-02T16:54:19.851ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89322024-12-02T16:54:19.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89332024-12-02T16:54:19.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89342024-12-02T16:54:19.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89352024-12-02T16:54:19.852ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89362024-12-02T16:54:19.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89372024-12-02T16:54:19.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89382024-12-02T16:54:19.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89392024-12-02T16:54:19.854ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89402024-12-02T16:54:19.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89412024-12-02T16:54:19.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89422024-12-02T16:54:19.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89432024-12-02T16:54:19.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89442024-12-02T16:54:19.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89452024-12-02T16:54:19.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89462024-12-02T16:54:19.857ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89472024-12-02T16:54:19.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
89482024-12-02T16:54:19.857ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89492024-12-02T16:54:19.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89502024-12-02T16:54:19.858ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89512024-12-02T16:54:19.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89522024-12-02T16:54:19.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89532024-12-02T16:54:19.860ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 62.306475ms iteration = 22 status = 0
89542024-12-02T16:54:19.876ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
89552024-12-02T16:54:19.876ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.534726ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
89562024-12-02T16:54:19.885ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
89572024-12-02T16:54:19.885ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89582024-12-02T16:54:19.885ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d041e2a2-ce4a-417d-83d1-0cfe9ad7dd6e", "content-length": "26", "date": "Mon, 02 Dec 2024 16:54:19 GMT"} })
89592024-12-02T16:54:19.885ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89602024-12-02T16:54:19.887ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89612024-12-02T16:54:19.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 90.752663ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
89622024-12-02T16:54:19.892ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89632024-12-02T16:54:19.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89642024-12-02T16:54:19.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 96.611244ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89652024-12-02T16:54:19.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89662024-12-02T16:54:19.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89672024-12-02T16:54:19.921ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 123.031806ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
89682024-12-02T16:54:19.948ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 151.297832ms iteration = 26 status = {"physical_disks_added":0}
89692024-12-02T16:54:19.973ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
89702024-12-02T16:54:19.973ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89712024-12-02T16:54:19.974ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf2e3a64-4481-4eb8-bb9c-39dcfa9b1bc2", "content-length": "26", "date": "Mon, 02 Dec 2024 16:54:19 GMT"} })
89722024-12-02T16:54:19.974ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89732024-12-02T16:54:19.976ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89742024-12-02T16:54:19.983ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 186.673102ms iteration = 22 status = {}
89752024-12-02T16:54:19.985ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
89762024-12-02T16:54:19.985ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89772024-12-02T16:54:19.985ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e39803f-7530-4cd4-8f0a-05e96218fc9d", "content-length": "26", "date": "Mon, 02 Dec 2024 16:54:19 GMT"} })
89782024-12-02T16:54:19.985ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89792024-12-02T16:54:19.986ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
89802024-12-02T16:54:20.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89812024-12-02T16:54:20.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89822024-12-02T16:54:20.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89832024-12-02T16:54:20.012ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89842024-12-02T16:54:20.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89852024-12-02T16:54:20.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89862024-12-02T16:54:20.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89872024-12-02T16:54:20.015ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89882024-12-02T16:54:20.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89892024-12-02T16:54:20.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89902024-12-02T16:54:20.015ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89912024-12-02T16:54:20.015ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89922024-12-02T16:54:20.016ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "30f08e83-9083-4c41-8c9e-d180b0ddaa9f", "content-length": "372", "date": "Mon, 02 Dec 2024 16:54:19 GMT"} })
89932024-12-02T16:54:20.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89942024-12-02T16:54:20.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89952024-12-02T16:54:20.029ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
89962024-12-02T16:54:20.029ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
89972024-12-02T16:54:20.030ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "865e9830-7531-4fc2-9758-e7e87cd9a505", "date": "Mon, 02 Dec 2024 16:54:19 GMT"} })
89982024-12-02T16:54:20.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89992024-12-02T16:54:20.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90002024-12-02T16:54:20.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90012024-12-02T16:54:20.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90022024-12-02T16:54:20.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90032024-12-02T16:54:20.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90042024-12-02T16:54:20.036ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90052024-12-02T16:54:20.036ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee4d8e96-5fe4-44af-baf3-9c910208f44c", "content-length": "1", "date": "Mon, 02 Dec 2024 16:54:19 GMT"} })
90062024-12-02T16:54:20.038ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90072024-12-02T16:54:20.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90082024-12-02T16:54:20.058ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90092024-12-02T16:54:20.058ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "33644738-d510-4e3b-8566-0c89ec348148", "content-length": "691", "date": "Mon, 02 Dec 2024 16:54:19 GMT"} })
90102024-12-02T16:54:20.058ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
90112024-12-02T16:54:20.058ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
90122024-12-02T16:54:20.058ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
90132024-12-02T16:54:20.059ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 262.457474ms iteration = 22 status = {}
90142024-12-02T16:54:20.061ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 264.260899ms iteration = 22 status = null
90152024-12-02T16:54:20.061ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
90162024-12-02T16:54:20.061ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90172024-12-02T16:54:20.062ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6d335cfe-b877-42da-b5bf-f955ccae3fb5", "date": "Mon, 02 Dec 2024 16:54:19 GMT"} })
90182024-12-02T16:54:20.064ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 266.093186ms iteration = 23 status = {}
90192024-12-02T16:54:20.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90202024-12-02T16:54:20.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90212024-12-02T16:54:20.109ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
90222024-12-02T16:54:20.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90232024-12-02T16:54:20.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90242024-12-02T16:54:20.119ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90252024-12-02T16:54:20.120ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec016f80-97ef-4e02-be05-9fb23162d1fb", "content-length": "134", "date": "Mon, 02 Dec 2024 16:54:19 GMT"} })
90262024-12-02T16:54:20.120ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90272024-12-02T16:54:20.120ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
90282024-12-02T16:54:20.120ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90292024-12-02T16:54:20.120ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90302024-12-02T16:54:20.120ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90312024-12-02T16:54:20.120ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90322024-12-02T16:54:20.120ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90332024-12-02T16:54:20.120ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90342024-12-02T16:54:20.120ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90352024-12-02T16:54:20.120ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90362024-12-02T16:54:20.120ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
90372024-12-02T16:54:20.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90382024-12-02T16:54:20.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90392024-12-02T16:54:20.122ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90402024-12-02T16:54:20.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "cac4cc8f-f27b-43f7-a192-513e1ccf7577", "content-length": "2", "date": "Mon, 02 Dec 2024 16:54:20 GMT"} })
90412024-12-02T16:54:20.123ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90422024-12-02T16:54:20.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e78c1d68-8eec-4865-bf3a-7e03a596b27c", "content-length": "52", "date": "Mon, 02 Dec 2024 16:54:20 GMT"} })
90432024-12-02T16:54:20.123ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
90442024-12-02T16:54:20.123ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
90452024-12-02T16:54:20.215ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "aa3c4146-2b63-499f-9a86-f09d24f43b8b", "date": "Mon, 02 Dec 2024 16:54:19 GMT"} })
90462024-12-02T16:54:20.215ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
90472024-12-02T16:54:20.215ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
90482024-12-02T16:54:20.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a74b6723-dc1b-4771-a9ee-4311320a6f28 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90492024-12-02T16:54:20.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a74b6723-dc1b-4771-a9ee-4311320a6f28 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90502024-12-02T16:54:20.216ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "10169fe7-dbca-40b8-8e11-b0a538f4b04d", "content-length": "682", "date": "Mon, 02 Dec 2024 16:54:19 GMT"} })
90512024-12-02T16:54:20.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90522024-12-02T16:54:20.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90532024-12-02T16:54:20.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1871 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a74b6723-dc1b-4771-a9ee-4311320a6f28 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90542024-12-02T16:54:20.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90552024-12-02T16:54:20.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90562024-12-02T16:54:20.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90572024-12-02T16:54:20.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90582024-12-02T16:54:20.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90592024-12-02T16:54:20.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90602024-12-02T16:54:20.233ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 435.94166ms iteration = 22 status = {}
90612024-12-02T16:54:21.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bbf77150-4d9f-4f9a-8946-efc66a72033a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90622024-12-02T16:54:21.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bbf77150-4d9f-4f9a-8946-efc66a72033a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90632024-12-02T16:54:21.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = bbf77150-4d9f-4f9a-8946-efc66a72033a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90642024-12-02T16:54:22.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7e328193-1375-4b57-b87f-b802b8dd0f98 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90652024-12-02T16:54:22.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7e328193-1375-4b57-b87f-b802b8dd0f98 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90662024-12-02T16:54:22.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7e328193-1375-4b57-b87f-b802b8dd0f98 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90672024-12-02T16:54:23.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4be42e23-71fd-4005-95d6-5c46fc87aab2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90682024-12-02T16:54:23.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4be42e23-71fd-4005-95d6-5c46fc87aab2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90692024-12-02T16:54:23.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4be42e23-71fd-4005-95d6-5c46fc87aab2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90702024-12-02T16:54:24.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5e43004b-c7bf-428e-8132-92cdbbdf610b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90712024-12-02T16:54:24.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5e43004b-c7bf-428e-8132-92cdbbdf610b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90722024-12-02T16:54:24.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5e43004b-c7bf-428e-8132-92cdbbdf610b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90732024-12-02T16:54:25.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 52a22f5d-a9af-4669-b19b-0e68dec0d1b9 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90742024-12-02T16:54:25.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 52a22f5d-a9af-4669-b19b-0e68dec0d1b9 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90752024-12-02T16:54:25.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 52a22f5d-a9af-4669-b19b-0e68dec0d1b9 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90762024-12-02T16:54:26.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 19062e7c-d22a-4783-80a1-ec5ab0563408 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90772024-12-02T16:54:26.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 19062e7c-d22a-4783-80a1-ec5ab0563408 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90782024-12-02T16:54:26.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 19062e7c-d22a-4783-80a1-ec5ab0563408 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90792024-12-02T16:54:26.559ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1337 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = e6860917-6447-4e65-9c9e-5fb421177811 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
90802024-12-02T16:54:27.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dc5dfae9-f85b-4087-ab2c-e51062093b66 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90812024-12-02T16:54:27.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dc5dfae9-f85b-4087-ab2c-e51062093b66 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90822024-12-02T16:54:27.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dc5dfae9-f85b-4087-ab2c-e51062093b66 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90832024-12-02T16:54:28.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d58163b6-3d29-454c-8ab8-383a607584e1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90842024-12-02T16:54:28.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d58163b6-3d29-454c-8ab8-383a607584e1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90852024-12-02T16:54:28.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d58163b6-3d29-454c-8ab8-383a607584e1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90862024-12-02T16:54:29.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b54ee259-1dba-47e8-9f3f-564ef4934e29 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90872024-12-02T16:54:29.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b54ee259-1dba-47e8-9f3f-564ef4934e29 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90882024-12-02T16:54:29.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1651 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b54ee259-1dba-47e8-9f3f-564ef4934e29 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
90892024-12-02T16:54:29.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
90902024-12-02T16:54:29.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
90912024-12-02T16:54:29.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90922024-12-02T16:54:29.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90932024-12-02T16:54:29.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90942024-12-02T16:54:29.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90952024-12-02T16:54:29.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90962024-12-02T16:54:29.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90972024-12-02T16:54:29.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90982024-12-02T16:54:29.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90992024-12-02T16:54:29.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91002024-12-02T16:54:29.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91012024-12-02T16:54:29.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91022024-12-02T16:54:29.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91032024-12-02T16:54:29.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91042024-12-02T16:54:29.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
91052024-12-02T16:54:29.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91062024-12-02T16:54:29.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91072024-12-02T16:54:29.816ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
91082024-12-02T16:54:29.816ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.612851ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
91092024-12-02T16:54:29.828ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.627516ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91102024-12-02T16:54:30.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5d057a68-1baf-46ce-8421-1620b0c29762 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91112024-12-02T16:54:30.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5d057a68-1baf-46ce-8421-1620b0c29762 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91122024-12-02T16:54:30.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5d057a68-1baf-46ce-8421-1620b0c29762 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91132024-12-02T16:54:31.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ec571fa1-df92-476c-b399-c325ec748eca roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91142024-12-02T16:54:31.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ec571fa1-df92-476c-b399-c325ec748eca resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91152024-12-02T16:54:31.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ec571fa1-df92-476c-b399-c325ec748eca response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91162024-12-02T16:54:31.546ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:55476
91172024-12-02T16:54:31.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = 96e0d21c-8eb4-4a8e-ae91-ec12e68fc5ae roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
91182024-12-02T16:54:31.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = 96e0d21c-8eb4-4a8e-ae91-ec12e68fc5ae resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
91192024-12-02T16:54:31.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = 96e0d21c-8eb4-4a8e-ae91-ec12e68fc5ae response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
91202024-12-02T16:54:31.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = a0cc3b98-2419-4e6f-9a4d-e7fdb5107c60 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
91212024-12-02T16:54:31.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = a0cc3b98-2419-4e6f-9a4d-e7fdb5107c60 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
91222024-12-02T16:54:31.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = a0cc3b98-2419-4e6f-9a4d-e7fdb5107c60 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
91232024-12-02T16:54:32.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e4545ee0-dcc7-4916-8fc8-7039e20c4c8e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91242024-12-02T16:54:32.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e4545ee0-dcc7-4916-8fc8-7039e20c4c8e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91252024-12-02T16:54:32.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e4545ee0-dcc7-4916-8fc8-7039e20c4c8e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91262024-12-02T16:54:33.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 944b3661-8aab-4425-a8c2-6a4a810edb31 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91272024-12-02T16:54:33.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 944b3661-8aab-4425-a8c2-6a4a810edb31 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91282024-12-02T16:54:33.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 944b3661-8aab-4425-a8c2-6a4a810edb31 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91292024-12-02T16:54:34.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72da5a5c-26df-46db-bbce-ef1e3ec2922b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91302024-12-02T16:54:34.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72da5a5c-26df-46db-bbce-ef1e3ec2922b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91312024-12-02T16:54:34.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 72da5a5c-26df-46db-bbce-ef1e3ec2922b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91322024-12-02T16:54:35.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5cfe9c32-a963-49d4-a35b-e7f7267ba9c0 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91332024-12-02T16:54:35.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5cfe9c32-a963-49d4-a35b-e7f7267ba9c0 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91342024-12-02T16:54:35.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5cfe9c32-a963-49d4-a35b-e7f7267ba9c0 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91352024-12-02T16:54:36.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 23099c2c-8499-41a7-a064-3bbfe57d8f1c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91362024-12-02T16:54:36.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 23099c2c-8499-41a7-a064-3bbfe57d8f1c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91372024-12-02T16:54:36.560ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1242 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 7f4020f8-5983-4f00-b8f7-0d84fbf1ed20 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
91382024-12-02T16:54:36.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 23099c2c-8499-41a7-a064-3bbfe57d8f1c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91392024-12-02T16:54:37.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b53ffa48-6828-4df8-b000-0d799638c1b5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91402024-12-02T16:54:37.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b53ffa48-6828-4df8-b000-0d799638c1b5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91412024-12-02T16:54:37.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b53ffa48-6828-4df8-b000-0d799638c1b5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91422024-12-02T16:54:38.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 087138c9-6441-4f73-9b78-13bea8ffed23 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91432024-12-02T16:54:38.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 087138c9-6441-4f73-9b78-13bea8ffed23 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91442024-12-02T16:54:38.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 087138c9-6441-4f73-9b78-13bea8ffed23 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91452024-12-02T16:54:39.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9302e6ab-8de7-42ba-aacf-d0915d5f940b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91462024-12-02T16:54:39.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9302e6ab-8de7-42ba-aacf-d0915d5f940b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91472024-12-02T16:54:39.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9302e6ab-8de7-42ba-aacf-d0915d5f940b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91482024-12-02T16:54:39.796ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
91492024-12-02T16:54:39.796ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
91502024-12-02T16:54:39.796ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91512024-12-02T16:54:39.796ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91522024-12-02T16:54:39.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91532024-12-02T16:54:39.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91542024-12-02T16:54:39.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91552024-12-02T16:54:39.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91562024-12-02T16:54:39.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91572024-12-02T16:54:39.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.49417ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91582024-12-02T16:54:39.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91592024-12-02T16:54:39.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91602024-12-02T16:54:39.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91612024-12-02T16:54:39.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91622024-12-02T16:54:39.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91632024-12-02T16:54:39.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91642024-12-02T16:54:39.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
91652024-12-02T16:54:39.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91662024-12-02T16:54:39.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91672024-12-02T16:54:39.816ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
91682024-12-02T16:54:39.816ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.324338ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
91692024-12-02T16:54:40.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = be08175b-03d3-46b2-afd9-82da67900d01 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91702024-12-02T16:54:40.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = be08175b-03d3-46b2-afd9-82da67900d01 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91712024-12-02T16:54:40.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = be08175b-03d3-46b2-afd9-82da67900d01 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91722024-12-02T16:54:41.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d73cdc5e-7421-4f8d-a5fb-1cc6dcdf3acb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91732024-12-02T16:54:41.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d73cdc5e-7421-4f8d-a5fb-1cc6dcdf3acb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91742024-12-02T16:54:41.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d73cdc5e-7421-4f8d-a5fb-1cc6dcdf3acb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91752024-12-02T16:54:42.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c6bc15ee-5f35-4f3b-9ab1-655989df7360 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91762024-12-02T16:54:42.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c6bc15ee-5f35-4f3b-9ab1-655989df7360 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91772024-12-02T16:54:42.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1681 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c6bc15ee-5f35-4f3b-9ab1-655989df7360 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91782024-12-02T16:54:43.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9c16071f-5bcf-498a-bdda-f8fa3860d9b8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91792024-12-02T16:54:43.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9c16071f-5bcf-498a-bdda-f8fa3860d9b8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91802024-12-02T16:54:43.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9c16071f-5bcf-498a-bdda-f8fa3860d9b8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91812024-12-02T16:54:44.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 46150500-b0c1-478d-872e-bdf5764f3513 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91822024-12-02T16:54:44.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 46150500-b0c1-478d-872e-bdf5764f3513 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91832024-12-02T16:54:44.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3738 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 46150500-b0c1-478d-872e-bdf5764f3513 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91842024-12-02T16:54:45.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 809b292c-80f4-435a-8713-ca7084c2908f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91852024-12-02T16:54:45.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 809b292c-80f4-435a-8713-ca7084c2908f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91862024-12-02T16:54:45.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 809b292c-80f4-435a-8713-ca7084c2908f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91872024-12-02T16:54:46.560ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1259 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = ef8ad80a-0ebd-4c0f-a6c0-43a63e634e3f response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
91882024-12-02T16:54:46.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f38e70c6-a713-4782-a2a0-85e43a2862fc roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91892024-12-02T16:54:46.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f38e70c6-a713-4782-a2a0-85e43a2862fc resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91902024-12-02T16:54:46.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f38e70c6-a713-4782-a2a0-85e43a2862fc response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91912024-12-02T16:54:47.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9e39b2f6-f47b-4248-a311-857267db092c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91922024-12-02T16:54:47.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9e39b2f6-f47b-4248-a311-857267db092c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91932024-12-02T16:54:47.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9e39b2f6-f47b-4248-a311-857267db092c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91942024-12-02T16:54:48.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 222fee26-aa6d-485c-a2b0-085d9e6e34aa roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91952024-12-02T16:54:48.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 222fee26-aa6d-485c-a2b0-085d9e6e34aa resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91962024-12-02T16:54:48.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 222fee26-aa6d-485c-a2b0-085d9e6e34aa response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
91972024-12-02T16:54:49.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 186be944-4f22-4a44-a046-ba8b7dd86e0f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
91982024-12-02T16:54:49.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 186be944-4f22-4a44-a046-ba8b7dd86e0f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
91992024-12-02T16:54:49.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 186be944-4f22-4a44-a046-ba8b7dd86e0f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
92002024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
92012024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
92022024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92032024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92042024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
92052024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
92062024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
92072024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92082024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92092024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
92102024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92112024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
92122024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
92132024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
92142024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92152024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92162024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92172024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
92182024-12-02T16:54:49.797ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-02 16:44:49.797605866 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
92192024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
92202024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
92212024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
92222024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92232024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
92242024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
92252024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92262024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
92272024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92282024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
92292024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
92302024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
92312024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92322024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
92332024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
92342024-12-02T16:54:49.797ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
92352024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
92362024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
92372024-12-02T16:54:49.797ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c575ce6d-3e43-4b59-886a-60182869b755
92382024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
92392024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.45\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"c575ce6d-3e43-4b59-886a-60182869b755"}
92402024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
92412024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92422024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92432024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
92442024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
92452024-12-02T16:54:49.797ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92462024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
92472024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
92482024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92492024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92502024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
92512024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
92522024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
92532024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92542024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
92552024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92562024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
92572024-12-02T16:54:49.797ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
92582024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
92592024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92602024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92612024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
92622024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92632024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92642024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92652024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92662024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92672024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92682024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92692024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
92702024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92712024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92722024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92732024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92742024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92752024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
92762024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92772024-12-02T16:54:49.798ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5510b96c-d504-40ca-83bc-e27293be3abe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 26051, tv_nsec: 531471399 } })
92782024-12-02T16:54:49.798ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a1a23f6-3701-4a53-9e08-543f9ba04e60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5030471-1797-42f6-9660-1ead64511c29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 26051, tv_nsec: 531492049 } })
92792024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92802024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92812024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
92822024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92832024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
92842024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92852024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
92862024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92872024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92882024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
92892024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.228041ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
92902024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
92912024-12-02T16:54:49.798ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.443153ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
92922024-12-02T16:54:49.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92932024-12-02T16:54:49.801ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.536181ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92942024-12-02T16:54:49.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92952024-12-02T16:54:49.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92962024-12-02T16:54:49.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92972024-12-02T16:54:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92982024-12-02T16:54:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
92992024-12-02T16:54:49.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93002024-12-02T16:54:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93012024-12-02T16:54:49.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93022024-12-02T16:54:49.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93032024-12-02T16:54:49.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93042024-12-02T16:54:49.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93052024-12-02T16:54:49.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93062024-12-02T16:54:49.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93072024-12-02T16:54:49.805ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93082024-12-02T16:54:49.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93092024-12-02T16:54:49.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93102024-12-02T16:54:49.806ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-02 16:44:49.797605866 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
93112024-12-02T16:54:49.806ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.671266ms iteration = 12 status = {"expiration":"2024-12-02T16:44:49.797605866Z","pruned":[]}
93122024-12-02T16:54:49.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93132024-12-02T16:54:49.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93142024-12-02T16:54:49.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93152024-12-02T16:54:49.814ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26051, tv_nsec: 547264617 } })
93162024-12-02T16:54:49.814ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
93172024-12-02T16:54:49.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93182024-12-02T16:54:49.816ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.639594ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
93192024-12-02T16:54:49.816ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26051, tv_nsec: 549727228 } })
93202024-12-02T16:54:49.816ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
93212024-12-02T16:54:49.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93222024-12-02T16:54:49.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93232024-12-02T16:54:49.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93242024-12-02T16:54:49.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93252024-12-02T16:54:49.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93262024-12-02T16:54:49.823ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26051, tv_nsec: 556806270 } })
93272024-12-02T16:54:49.824ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
93282024-12-02T16:54:49.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93292024-12-02T16:54:49.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93302024-12-02T16:54:49.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93312024-12-02T16:54:49.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93322024-12-02T16:54:49.838ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93332024-12-02T16:54:49.838ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93342024-12-02T16:54:49.838ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93352024-12-02T16:54:49.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93362024-12-02T16:54:49.839ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93372024-12-02T16:54:49.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93382024-12-02T16:54:49.841ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
93392024-12-02T16:54:49.841ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93402024-12-02T16:54:49.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93412024-12-02T16:54:49.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93422024-12-02T16:54:49.842ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93432024-12-02T16:54:49.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93442024-12-02T16:54:49.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93452024-12-02T16:54:49.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93462024-12-02T16:54:49.851ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93472024-12-02T16:54:49.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93482024-12-02T16:54:49.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93492024-12-02T16:54:49.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
93502024-12-02T16:54:49.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93512024-12-02T16:54:49.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93522024-12-02T16:54:49.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93532024-12-02T16:54:49.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93542024-12-02T16:54:49.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.313178ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93552024-12-02T16:54:49.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93562024-12-02T16:54:49.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93572024-12-02T16:54:49.859ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93582024-12-02T16:54:49.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.771609ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93592024-12-02T16:54:49.861ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93602024-12-02T16:54:49.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93612024-12-02T16:54:49.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93622024-12-02T16:54:49.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93632024-12-02T16:54:49.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93642024-12-02T16:54:49.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
93652024-12-02T16:54:49.863ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
93662024-12-02T16:54:49.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
93672024-12-02T16:54:49.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.295018ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
93682024-12-02T16:54:49.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93692024-12-02T16:54:49.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
93702024-12-02T16:54:49.865ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93712024-12-02T16:54:49.866ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.839492ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
93722024-12-02T16:54:49.867ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93732024-12-02T16:54:49.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93742024-12-02T16:54:49.868ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93752024-12-02T16:54:49.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93762024-12-02T16:54:49.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93772024-12-02T16:54:49.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 71.008991ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93782024-12-02T16:54:49.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
93792024-12-02T16:54:49.869ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93802024-12-02T16:54:49.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93812024-12-02T16:54:49.874ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
93822024-12-02T16:54:49.874ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
93832024-12-02T16:54:49.874ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 76.555239ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
93842024-12-02T16:54:49.877ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93852024-12-02T16:54:49.877ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93862024-12-02T16:54:49.877ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.557155ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93872024-12-02T16:54:49.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93882024-12-02T16:54:49.877ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93892024-12-02T16:54:49.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93902024-12-02T16:54:49.879ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93912024-12-02T16:54:49.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93922024-12-02T16:54:49.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93932024-12-02T16:54:49.886ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
93942024-12-02T16:54:49.886ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.889167ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
93952024-12-02T16:54:49.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93962024-12-02T16:54:49.889ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93972024-12-02T16:54:49.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93982024-12-02T16:54:49.890ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93992024-12-02T16:54:49.892ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94002024-12-02T16:54:49.892ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
94012024-12-02T16:54:49.892ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94022024-12-02T16:54:49.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94032024-12-02T16:54:49.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
94042024-12-02T16:54:49.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94052024-12-02T16:54:49.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94062024-12-02T16:54:49.898ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 100.047625ms iteration = 23 status = 0
94072024-12-02T16:54:49.908ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
94082024-12-02T16:54:49.913ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
94092024-12-02T16:54:49.913ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
94102024-12-02T16:54:49.913ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
94112024-12-02T16:54:49.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94122024-12-02T16:54:49.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94132024-12-02T16:54:49.915ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
94142024-12-02T16:54:49.915ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
94152024-12-02T16:54:49.915ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
94162024-12-02T16:54:49.915ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94172024-12-02T16:54:49.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94182024-12-02T16:54:49.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94192024-12-02T16:54:49.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94202024-12-02T16:54:49.920ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94212024-12-02T16:54:49.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94222024-12-02T16:54:49.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94232024-12-02T16:54:49.920ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
94242024-12-02T16:54:49.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
94252024-12-02T16:54:49.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94262024-12-02T16:54:49.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94272024-12-02T16:54:49.922ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
94282024-12-02T16:54:49.922ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
94292024-12-02T16:54:49.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94302024-12-02T16:54:49.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94312024-12-02T16:54:49.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94322024-12-02T16:54:49.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94332024-12-02T16:54:49.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94342024-12-02T16:54:49.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94352024-12-02T16:54:49.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94362024-12-02T16:54:49.929ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 131.241728ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
94372024-12-02T16:54:49.930ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
94382024-12-02T16:54:49.930ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94392024-12-02T16:54:49.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94402024-12-02T16:54:49.931ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
94412024-12-02T16:54:49.931ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
94422024-12-02T16:54:49.931ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-02 16:44:11.214841 UTC dns_group = internal generation = 1
94432024-12-02T16:54:49.931ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 133.649228ms iteration = 13 status = {"generation":1}
94442024-12-02T16:54:49.931ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
94452024-12-02T16:54:49.931ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
94462024-12-02T16:54:49.931ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 133.731689ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
94472024-12-02T16:54:49.931ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94482024-12-02T16:54:49.933ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
94492024-12-02T16:54:49.933ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94502024-12-02T16:54:49.933ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2886a63b-96fc-4776-a500-0169d6450ab3", "content-length": "26", "date": "Mon, 02 Dec 2024 16:54:49 GMT"} })
94512024-12-02T16:54:49.933ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94522024-12-02T16:54:49.933ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
94532024-12-02T16:54:49.933ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94542024-12-02T16:54:49.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94552024-12-02T16:54:49.935ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94562024-12-02T16:54:49.940ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94572024-12-02T16:54:49.940ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94582024-12-02T16:54:49.940ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.615027ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
94592024-12-02T16:54:49.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a47d431f-0fca-461d-98df-af7f9f094b08 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
94602024-12-02T16:54:49.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a47d431f-0fca-461d-98df-af7f9f094b08 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
94612024-12-02T16:54:49.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a47d431f-0fca-461d-98df-af7f9f094b08 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
94622024-12-02T16:54:49.956ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
94632024-12-02T16:54:49.956ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 0 version = 2
94642024-12-02T16:54:49.956ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94652024-12-02T16:54:49.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94662024-12-02T16:54:49.967ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
94672024-12-02T16:54:49.967ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94682024-12-02T16:54:49.967ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "27f1cffa-2242-46e7-aa2f-1c33e5dca618", "content-length": "26", "date": "Mon, 02 Dec 2024 16:54:49 GMT"} })
94692024-12-02T16:54:49.967ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94702024-12-02T16:54:49.970ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94712024-12-02T16:54:49.975ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
94722024-12-02T16:54:49.975ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94732024-12-02T16:54:49.975ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "af708348-3e3a-4d85-8ea4-51bd3e98ca3b", "content-length": "26", "date": "Mon, 02 Dec 2024 16:54:49 GMT"} })
94742024-12-02T16:54:49.976ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94752024-12-02T16:54:49.976ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 179.043545ms iteration = 27 status = {"physical_disks_added":0}
94762024-12-02T16:54:49.977ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
94772024-12-02T16:54:49.982ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-02T16:43:45.642486Z, time_modified: 2024-12-02T16:43:45.642486Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }) }
94782024-12-02T16:54:49.982ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 185.045357ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]}},"default_endpoint":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
94792024-12-02T16:54:49.985ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94802024-12-02T16:54:49.989ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94812024-12-02T16:54:49.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94822024-12-02T16:54:49.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94832024-12-02T16:54:49.991ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 1 version = 2
94842024-12-02T16:54:49.991ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
94852024-12-02T16:54:49.991ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-02 16:44:12.116348 UTC dns_group = external generation = 2
94862024-12-02T16:54:49.991ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 193.730673ms iteration = 13 status = {"generation":2}
94872024-12-02T16:54:49.992ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
94882024-12-02T16:54:49.992ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 194.44122ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
94892024-12-02T16:54:50.003ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94902024-12-02T16:54:50.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94912024-12-02T16:54:50.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94922024-12-02T16:54:50.006ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94932024-12-02T16:54:50.006ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94942024-12-02T16:54:50.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94952024-12-02T16:54:50.050ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
94962024-12-02T16:54:50.050ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3694cf3b-8ef2-440a-84e8-3f442c353781", "date": "Mon, 02 Dec 2024 16:54:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
94972024-12-02T16:54:50.050ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
94982024-12-02T16:54:50.051ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d7f5795c-92c8-4552-99d3-fe739783dc70", "date": "Mon, 02 Dec 2024 16:54:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
94992024-12-02T16:54:50.051ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
95002024-12-02T16:54:50.053ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
95012024-12-02T16:54:50.053ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 255.896136ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
95022024-12-02T16:54:50.113ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
95032024-12-02T16:54:50.113ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae0faf40-3893-4fc9-9436-90e6c6e4052c", "content-length": "1", "date": "Mon, 02 Dec 2024 16:54:50 GMT"} })
95042024-12-02T16:54:50.115ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95052024-12-02T16:54:50.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
95062024-12-02T16:54:50.121ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
95072024-12-02T16:54:50.121ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95082024-12-02T16:54:50.121ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bc621c9-fea5-4638-8fa9-5fc1e07102e0", "content-length": "372", "date": "Mon, 02 Dec 2024 16:54:50 GMT"} })
95092024-12-02T16:54:50.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95102024-12-02T16:54:50.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95112024-12-02T16:54:50.123ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95122024-12-02T16:54:50.124ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 326.314732ms iteration = 23 status = null
95132024-12-02T16:54:50.124ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95142024-12-02T16:54:50.124ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95152024-12-02T16:54:50.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95162024-12-02T16:54:50.138ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
95172024-12-02T16:54:50.138ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
95182024-12-02T16:54:50.138ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9076623a-4674-465b-97c8-be6f3ca8347d", "date": "Mon, 02 Dec 2024 16:54:50 GMT"} })
95192024-12-02T16:54:50.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95202024-12-02T16:54:50.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95212024-12-02T16:54:50.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95222024-12-02T16:54:50.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95232024-12-02T16:54:50.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95242024-12-02T16:54:50.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95252024-12-02T16:54:50.148ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95262024-12-02T16:54:50.148ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95272024-12-02T16:54:50.149ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5e7c96b6-11cb-4221-b807-eecf50f697ff", "date": "Mon, 02 Dec 2024 16:54:50 GMT"} })
95282024-12-02T16:54:50.151ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 353.55785ms iteration = 24 status = {}
95292024-12-02T16:54:50.191ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
95302024-12-02T16:54:50.194ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 396.272503ms iteration = 23 status = {}
95312024-12-02T16:54:50.220ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
95322024-12-02T16:54:50.220ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2d85903-52b8-4ff9-a745-6ceeb7a1110f", "content-length": "691", "date": "Mon, 02 Dec 2024 16:54:50 GMT"} })
95332024-12-02T16:54:50.220ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
95342024-12-02T16:54:50.220ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
95352024-12-02T16:54:50.220ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
95362024-12-02T16:54:50.222ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 424.57098ms iteration = 23 status = {}
95372024-12-02T16:54:50.242ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
95382024-12-02T16:54:50.243ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "473e0ac7-da50-4201-9978-15911702b47c", "date": "Mon, 02 Dec 2024 16:54:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
95392024-12-02T16:54:50.243ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
95402024-12-02T16:54:50.245ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c899898b-f99b-4533-8ea0-a723d464222d", "date": "Mon, 02 Dec 2024 16:54:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
95412024-12-02T16:54:50.245ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
95422024-12-02T16:54:50.246ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "986cb274-ada4-42db-91b9-452c7c41cac4", "date": "Mon, 02 Dec 2024 16:54:49 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
95432024-12-02T16:54:50.246ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
95442024-12-02T16:54:50.248ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
95452024-12-02T16:54:50.248ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 450.600748ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
95462024-12-02T16:54:50.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95472024-12-02T16:54:50.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95482024-12-02T16:54:50.254ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
95492024-12-02T16:54:50.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95502024-12-02T16:54:50.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95512024-12-02T16:54:50.263ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
95522024-12-02T16:54:50.264ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "791c3db2-acfe-4245-80ff-eb3685dcaea4", "content-length": "134", "date": "Mon, 02 Dec 2024 16:54:50 GMT"} })
95532024-12-02T16:54:50.264ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
95542024-12-02T16:54:50.264ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
95552024-12-02T16:54:50.264ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
95562024-12-02T16:54:50.264ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
95572024-12-02T16:54:50.264ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95582024-12-02T16:54:50.264ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95592024-12-02T16:54:50.264ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95602024-12-02T16:54:50.264ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95612024-12-02T16:54:50.264ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95622024-12-02T16:54:50.264ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95632024-12-02T16:54:50.264ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
95642024-12-02T16:54:50.264ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95652024-12-02T16:54:50.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95662024-12-02T16:54:50.267ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
95672024-12-02T16:54:50.267ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "759a2ecb-dd8d-4a90-8cba-1a24fc7063dd", "content-length": "2", "date": "Mon, 02 Dec 2024 16:54:50 GMT"} })
95682024-12-02T16:54:50.267ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
95692024-12-02T16:54:50.267ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e9cc074-29f1-4dca-aaca-22a61f7a8a64", "content-length": "52", "date": "Mon, 02 Dec 2024 16:54:50 GMT"} })
95702024-12-02T16:54:50.267ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
95712024-12-02T16:54:50.267ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
95722024-12-02T16:54:50.357ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b0972cdb-f110-43f5-aefe-1bbad3ad7226", "date": "Mon, 02 Dec 2024 16:54:50 GMT"} })
95732024-12-02T16:54:50.357ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
95742024-12-02T16:54:50.357ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
95752024-12-02T16:54:50.357ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dddd2a13-61b7-404d-b71b-7e7d7eeabfd6", "content-length": "682", "date": "Mon, 02 Dec 2024 16:54:50 GMT"} })
95762024-12-02T16:54:50.357ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95772024-12-02T16:54:50.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95782024-12-02T16:54:50.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95792024-12-02T16:54:50.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95802024-12-02T16:54:50.365ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95812024-12-02T16:54:50.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95822024-12-02T16:54:50.367ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95832024-12-02T16:54:50.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95842024-12-02T16:54:50.375ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 577.634439ms iteration = 23 status = {}
95852024-12-02T16:54:50.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1a196682-d7ad-4e65-99d6-4beb553a892c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
95862024-12-02T16:54:50.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1a196682-d7ad-4e65-99d6-4beb553a892c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
95872024-12-02T16:54:50.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1a196682-d7ad-4e65-99d6-4beb553a892c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
95882024-12-02T16:54:51.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9a4e8e96-fb6d-4951-b6de-1db98147c64e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
95892024-12-02T16:54:51.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9a4e8e96-fb6d-4951-b6de-1db98147c64e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
95902024-12-02T16:54:51.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2833 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9a4e8e96-fb6d-4951-b6de-1db98147c64e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
95912024-12-02T16:54:53.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5fa7490e-ec1c-46dd-9c71-e5c14d609e78 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
95922024-12-02T16:54:53.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5fa7490e-ec1c-46dd-9c71-e5c14d609e78 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
95932024-12-02T16:54:53.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5fa7490e-ec1c-46dd-9c71-e5c14d609e78 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
95942024-12-02T16:54:54.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8d43ee80-332c-40e0-9ae6-6512e2214a3b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
95952024-12-02T16:54:54.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8d43ee80-332c-40e0-9ae6-6512e2214a3b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
95962024-12-02T16:54:54.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8d43ee80-332c-40e0-9ae6-6512e2214a3b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
95972024-12-02T16:54:55.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9f2c307d-8515-4909-84db-3e5530b66ff3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
95982024-12-02T16:54:55.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9f2c307d-8515-4909-84db-3e5530b66ff3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
95992024-12-02T16:54:55.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9f2c307d-8515-4909-84db-3e5530b66ff3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96002024-12-02T16:54:56.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fa0a5a23-ee96-445b-ab14-429c752623fb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96012024-12-02T16:54:56.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fa0a5a23-ee96-445b-ab14-429c752623fb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96022024-12-02T16:54:56.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fa0a5a23-ee96-445b-ab14-429c752623fb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96032024-12-02T16:54:56.559ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1270 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = c53db092-16ed-47b9-b91f-6aa52621b489 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
96042024-12-02T16:54:57.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 671c35af-c51d-434d-b3c3-3356e1d3cb60 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96052024-12-02T16:54:57.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 671c35af-c51d-434d-b3c3-3356e1d3cb60 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96062024-12-02T16:54:57.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 671c35af-c51d-434d-b3c3-3356e1d3cb60 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96072024-12-02T16:54:58.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 48fe9127-cd90-45ca-9fda-4cea0e6a4ca8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96082024-12-02T16:54:58.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 48fe9127-cd90-45ca-9fda-4cea0e6a4ca8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96092024-12-02T16:54:58.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 48fe9127-cd90-45ca-9fda-4cea0e6a4ca8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96102024-12-02T16:54:59.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd2c8541-5928-4dcc-ac74-7bb8bb96fcd7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96112024-12-02T16:54:59.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd2c8541-5928-4dcc-ac74-7bb8bb96fcd7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96122024-12-02T16:54:59.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd2c8541-5928-4dcc-ac74-7bb8bb96fcd7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96132024-12-02T16:54:59.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
96142024-12-02T16:54:59.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96152024-12-02T16:54:59.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
96162024-12-02T16:54:59.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96172024-12-02T16:54:59.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96182024-12-02T16:54:59.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96192024-12-02T16:54:59.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96202024-12-02T16:54:59.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96212024-12-02T16:54:59.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96222024-12-02T16:54:59.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96232024-12-02T16:54:59.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96242024-12-02T16:54:59.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96252024-12-02T16:54:59.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96262024-12-02T16:54:59.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
96272024-12-02T16:54:59.809ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96282024-12-02T16:54:59.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96292024-12-02T16:54:59.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
96302024-12-02T16:54:59.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.199741ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
96312024-12-02T16:54:59.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96322024-12-02T16:54:59.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96332024-12-02T16:54:59.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.557854ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96342024-12-02T16:55:00.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = eedf68b3-3df7-440f-9369-c1ec28efe153 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96352024-12-02T16:55:00.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = eedf68b3-3df7-440f-9369-c1ec28efe153 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96362024-12-02T16:55:00.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = eedf68b3-3df7-440f-9369-c1ec28efe153 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96372024-12-02T16:55:01.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cb2e9a7c-0a4e-4226-beab-3e54ea5a343f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96382024-12-02T16:55:01.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cb2e9a7c-0a4e-4226-beab-3e54ea5a343f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96392024-12-02T16:55:01.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2692 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cb2e9a7c-0a4e-4226-beab-3e54ea5a343f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96402024-12-02T16:55:02.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dcac1ebe-b847-4e49-b8ad-65df4ca2010c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96412024-12-02T16:55:02.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dcac1ebe-b847-4e49-b8ad-65df4ca2010c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96422024-12-02T16:55:02.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dcac1ebe-b847-4e49-b8ad-65df4ca2010c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96432024-12-02T16:55:03.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8b8c7880-bd07-42b4-9ac7-182687a150b1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96442024-12-02T16:55:03.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8b8c7880-bd07-42b4-9ac7-182687a150b1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96452024-12-02T16:55:03.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8b8c7880-bd07-42b4-9ac7-182687a150b1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96462024-12-02T16:55:04.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 24d3751a-2262-4bb1-a261-effecba1e4d2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96472024-12-02T16:55:04.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 24d3751a-2262-4bb1-a261-effecba1e4d2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96482024-12-02T16:55:04.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 24d3751a-2262-4bb1-a261-effecba1e4d2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96492024-12-02T16:55:05.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fd47e509-a08a-478c-a19f-e0aaf1a3804a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96502024-12-02T16:55:05.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fd47e509-a08a-478c-a19f-e0aaf1a3804a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96512024-12-02T16:55:05.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fd47e509-a08a-478c-a19f-e0aaf1a3804a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96522024-12-02T16:55:06.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 15329a76-bf14-47f2-8ce4-c494f85e4064 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96532024-12-02T16:55:06.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 15329a76-bf14-47f2-8ce4-c494f85e4064 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96542024-12-02T16:55:06.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 15329a76-bf14-47f2-8ce4-c494f85e4064 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96552024-12-02T16:55:06.560ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1827 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 35e3e808-e178-4562-ad55-5ddaf6562c73 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
96562024-12-02T16:55:07.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dfa6e46a-6cd8-44b8-be2b-749584edd18f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96572024-12-02T16:55:07.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dfa6e46a-6cd8-44b8-be2b-749584edd18f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96582024-12-02T16:55:07.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dfa6e46a-6cd8-44b8-be2b-749584edd18f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96592024-12-02T16:55:08.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 672f9c30-2376-4306-9dd4-0705c0943305 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96602024-12-02T16:55:08.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 672f9c30-2376-4306-9dd4-0705c0943305 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96612024-12-02T16:55:08.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 672f9c30-2376-4306-9dd4-0705c0943305 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96622024-12-02T16:55:09.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 97bb0b3a-1fe6-41ed-9753-a6ccf74c6787 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96632024-12-02T16:55:09.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 97bb0b3a-1fe6-41ed-9753-a6ccf74c6787 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96642024-12-02T16:55:09.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1567 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 97bb0b3a-1fe6-41ed-9753-a6ccf74c6787 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96652024-12-02T16:55:09.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
96662024-12-02T16:55:09.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96672024-12-02T16:55:09.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
96682024-12-02T16:55:09.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96692024-12-02T16:55:09.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96702024-12-02T16:55:09.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96712024-12-02T16:55:09.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96722024-12-02T16:55:09.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96732024-12-02T16:55:09.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96742024-12-02T16:55:09.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.324089ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96752024-12-02T16:55:09.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96762024-12-02T16:55:09.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96772024-12-02T16:55:09.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96782024-12-02T16:55:09.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96792024-12-02T16:55:09.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96802024-12-02T16:55:09.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96812024-12-02T16:55:09.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
96822024-12-02T16:55:09.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96832024-12-02T16:55:09.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96842024-12-02T16:55:09.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
96852024-12-02T16:55:09.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.566578ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
96862024-12-02T16:55:10.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 80545943-620d-499e-9e7d-a6cd8d7afec6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96872024-12-02T16:55:10.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 80545943-620d-499e-9e7d-a6cd8d7afec6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96882024-12-02T16:55:10.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 80545943-620d-499e-9e7d-a6cd8d7afec6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96892024-12-02T16:55:11.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1f8cb97e-7a6e-407c-bf5a-c8017e9c85f2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96902024-12-02T16:55:11.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1f8cb97e-7a6e-407c-bf5a-c8017e9c85f2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96912024-12-02T16:55:11.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1f8cb97e-7a6e-407c-bf5a-c8017e9c85f2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96922024-12-02T16:55:12.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 17679def-5525-4c19-9704-5a98a88a5d25 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96932024-12-02T16:55:12.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 17679def-5525-4c19-9704-5a98a88a5d25 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96942024-12-02T16:55:12.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 17679def-5525-4c19-9704-5a98a88a5d25 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96952024-12-02T16:55:13.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2310be77-896a-4783-8c86-bb13d302eaa3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96962024-12-02T16:55:13.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2310be77-896a-4783-8c86-bb13d302eaa3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96972024-12-02T16:55:13.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1665 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2310be77-896a-4783-8c86-bb13d302eaa3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96982024-12-02T16:55:14.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 73391e47-307f-44ae-886f-a08305c75f48 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
96992024-12-02T16:55:14.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 73391e47-307f-44ae-886f-a08305c75f48 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97002024-12-02T16:55:14.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 73391e47-307f-44ae-886f-a08305c75f48 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97012024-12-02T16:55:15.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cbe4c39f-fc59-4c08-970e-5cdda1ada1c5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97022024-12-02T16:55:15.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cbe4c39f-fc59-4c08-970e-5cdda1ada1c5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97032024-12-02T16:55:15.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cbe4c39f-fc59-4c08-970e-5cdda1ada1c5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97042024-12-02T16:55:16.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 207b56aa-91f4-4062-9772-2f9a921e37af roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97052024-12-02T16:55:16.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 207b56aa-91f4-4062-9772-2f9a921e37af resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97062024-12-02T16:55:16.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 207b56aa-91f4-4062-9772-2f9a921e37af response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97072024-12-02T16:55:16.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = e0bed3c3-1bbd-4614-acb2-4f73885e2f5f roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
97082024-12-02T16:55:16.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = e0bed3c3-1bbd-4614-acb2-4f73885e2f5f resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
97092024-12-02T16:55:16.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = e0bed3c3-1bbd-4614-acb2-4f73885e2f5f response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
97102024-12-02T16:55:16.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = 974586ad-b593-439d-8f93-cb922bba8ead roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
97112024-12-02T16:55:16.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = 974586ad-b593-439d-8f93-cb922bba8ead resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
97122024-12-02T16:55:16.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = 974586ad-b593-439d-8f93-cb922bba8ead response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
97132024-12-02T16:55:16.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1849 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 191c8f30-4a9c-4838-8c75-493c059a928c response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
97142024-12-02T16:55:17.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4b2dd9e4-09e4-491b-b22a-63c34dd21e1e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97152024-12-02T16:55:17.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4b2dd9e4-09e4-491b-b22a-63c34dd21e1e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97162024-12-02T16:55:17.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4b2dd9e4-09e4-491b-b22a-63c34dd21e1e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97172024-12-02T16:55:18.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cae2a3f6-5928-4a7b-98d0-0cc8b1a13ef0 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97182024-12-02T16:55:18.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cae2a3f6-5928-4a7b-98d0-0cc8b1a13ef0 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97192024-12-02T16:55:18.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cae2a3f6-5928-4a7b-98d0-0cc8b1a13ef0 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97202024-12-02T16:55:19.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = b901186f-1ea4-4102-ba56-3c92b8bda38f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
97212024-12-02T16:55:19.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = b901186f-1ea4-4102-ba56-3c92b8bda38f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
97222024-12-02T16:55:19.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = b901186f-1ea4-4102-ba56-3c92b8bda38f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
97232024-12-02T16:55:19.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 77d55930-41d7-4260-8568-a60b064e1a63 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97242024-12-02T16:55:19.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 77d55930-41d7-4260-8568-a60b064e1a63 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97252024-12-02T16:55:19.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 77d55930-41d7-4260-8568-a60b064e1a63 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
97262024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
97272024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
97282024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
97292024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97302024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97312024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
97322024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
97332024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97342024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
97352024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97362024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
97372024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
97382024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97392024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
97402024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
97412024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97422024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
97432024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97442024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
97452024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97462024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
97472024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97482024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97492024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97502024-12-02T16:55:19.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97512024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97522024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
97532024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97542024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97552024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97562024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97572024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97582024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
97592024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
97602024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
97612024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97622024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
97632024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
97642024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
97652024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97662024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
97672024-12-02T16:55:19.798ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97682024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97692024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
97702024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97712024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97722024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97732024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97742024-12-02T16:55:19.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97752024-12-02T16:55:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97762024-12-02T16:55:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
97772024-12-02T16:55:19.801ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26081, tv_nsec: 533641948 } })
97782024-12-02T16:55:19.801ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
97792024-12-02T16:55:19.801ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97802024-12-02T16:55:19.801ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97812024-12-02T16:55:19.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97822024-12-02T16:55:19.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97832024-12-02T16:55:19.801ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.261727ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97842024-12-02T16:55:19.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97852024-12-02T16:55:19.802ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26081, tv_nsec: 535479813 } })
97862024-12-02T16:55:19.803ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
97872024-12-02T16:55:19.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97882024-12-02T16:55:19.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97892024-12-02T16:55:19.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97902024-12-02T16:55:19.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97912024-12-02T16:55:19.805ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97922024-12-02T16:55:19.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97932024-12-02T16:55:19.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97942024-12-02T16:55:19.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97952024-12-02T16:55:19.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97962024-12-02T16:55:19.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97972024-12-02T16:55:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97982024-12-02T16:55:19.808ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97992024-12-02T16:55:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98002024-12-02T16:55:19.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98012024-12-02T16:55:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
98022024-12-02T16:55:19.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98032024-12-02T16:55:19.808ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98042024-12-02T16:55:19.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98052024-12-02T16:55:19.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98062024-12-02T16:55:19.809ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.267239ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
98072024-12-02T16:55:19.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98082024-12-02T16:55:19.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98092024-12-02T16:55:19.811ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26081, tv_nsec: 544355661 } })
98102024-12-02T16:55:19.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98112024-12-02T16:55:19.812ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
98122024-12-02T16:55:19.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98132024-12-02T16:55:19.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98142024-12-02T16:55:19.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98152024-12-02T16:55:19.813ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98162024-12-02T16:55:19.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98172024-12-02T16:55:19.814ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98182024-12-02T16:55:19.814ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98192024-12-02T16:55:19.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98202024-12-02T16:55:19.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98212024-12-02T16:55:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
98222024-12-02T16:55:19.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98232024-12-02T16:55:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98242024-12-02T16:55:19.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98252024-12-02T16:55:19.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98262024-12-02T16:55:19.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98272024-12-02T16:55:19.826ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 29.095825ms iteration = 28 status = {"physical_disks_added":0}
98282024-12-02T16:55:19.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98292024-12-02T16:55:19.833ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98302024-12-02T16:55:19.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98312024-12-02T16:55:19.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98322024-12-02T16:55:19.834ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98332024-12-02T16:55:19.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98342024-12-02T16:55:19.836ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98352024-12-02T16:55:19.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98362024-12-02T16:55:19.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 39.497886ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
98372024-12-02T16:55:19.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98382024-12-02T16:55:19.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98392024-12-02T16:55:19.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
98402024-12-02T16:55:19.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98412024-12-02T16:55:19.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98422024-12-02T16:55:19.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98432024-12-02T16:55:19.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
98442024-12-02T16:55:19.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.58636ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
98452024-12-02T16:55:19.842ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 44.136965ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
98462024-12-02T16:55:19.843ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.377978ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
98472024-12-02T16:55:19.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98482024-12-02T16:55:19.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98492024-12-02T16:55:19.844ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98502024-12-02T16:55:19.844ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98512024-12-02T16:55:19.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98522024-12-02T16:55:19.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98532024-12-02T16:55:19.849ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98542024-12-02T16:55:19.849ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.965054ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98552024-12-02T16:55:19.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98562024-12-02T16:55:19.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98572024-12-02T16:55:19.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98582024-12-02T16:55:19.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98592024-12-02T16:55:19.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98602024-12-02T16:55:19.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98612024-12-02T16:55:19.857ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98622024-12-02T16:55:19.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98632024-12-02T16:55:19.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98642024-12-02T16:55:19.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98652024-12-02T16:55:19.873ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98662024-12-02T16:55:19.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98672024-12-02T16:55:19.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.716811ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98682024-12-02T16:55:19.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98692024-12-02T16:55:19.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98702024-12-02T16:55:19.876ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98712024-12-02T16:55:19.876ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98722024-12-02T16:55:19.876ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a97af1e-8a56-4f46-a342-c874e8d1aacd", "content-length": "26", "date": "Mon, 02 Dec 2024 16:55:19 GMT"} })
98732024-12-02T16:55:19.876ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98742024-12-02T16:55:19.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 79.195332ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98752024-12-02T16:55:19.877ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98762024-12-02T16:55:19.878ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98772024-12-02T16:55:19.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
98782024-12-02T16:55:19.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98792024-12-02T16:55:19.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98802024-12-02T16:55:19.881ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.196408ms iteration = 24 status = 0
98812024-12-02T16:55:19.888ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98822024-12-02T16:55:19.888ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98832024-12-02T16:55:19.888ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "91e983e2-e9d2-4bbf-aecb-3cd4c2a5ba8f", "content-length": "26", "date": "Mon, 02 Dec 2024 16:55:19 GMT"} })
98842024-12-02T16:55:19.888ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98852024-12-02T16:55:19.889ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98862024-12-02T16:55:19.890ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98872024-12-02T16:55:19.890ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98882024-12-02T16:55:19.890ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.964453ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98892024-12-02T16:55:19.914ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
98902024-12-02T16:55:19.914ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98912024-12-02T16:55:19.914ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "02c1e641-1baf-486a-9979-2870e540ab93", "content-length": "26", "date": "Mon, 02 Dec 2024 16:55:19 GMT"} })
98922024-12-02T16:55:19.914ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98932024-12-02T16:55:19.916ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
98942024-12-02T16:55:20.008ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 210.48774ms iteration = 24 status = {}
98952024-12-02T16:55:20.020ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98962024-12-02T16:55:20.020ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98972024-12-02T16:55:20.021ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "77402650-e860-499d-8de5-ae6b286ef980", "content-length": "372", "date": "Mon, 02 Dec 2024 16:55:19 GMT"} })
98982024-12-02T16:55:20.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98992024-12-02T16:55:20.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99002024-12-02T16:55:20.038ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
99012024-12-02T16:55:20.038ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99022024-12-02T16:55:20.038ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5cfe1e3b-5836-469b-b408-fc609c52e00b", "date": "Mon, 02 Dec 2024 16:55:19 GMT"} })
99032024-12-02T16:55:20.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99042024-12-02T16:55:20.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99052024-12-02T16:55:20.072ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99062024-12-02T16:55:20.072ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4583d2d2-594c-4e32-853e-4788d8da51b6", "content-length": "691", "date": "Mon, 02 Dec 2024 16:55:19 GMT"} })
99072024-12-02T16:55:20.072ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
99082024-12-02T16:55:20.072ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
99092024-12-02T16:55:20.072ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
99102024-12-02T16:55:20.074ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 277.036811ms iteration = 24 status = {}
99112024-12-02T16:55:20.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99122024-12-02T16:55:20.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99132024-12-02T16:55:20.077ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99142024-12-02T16:55:20.077ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "304479a8-51f4-4ea5-a45a-074ad30ded5e", "content-length": "1", "date": "Mon, 02 Dec 2024 16:55:19 GMT"} })
99152024-12-02T16:55:20.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99162024-12-02T16:55:20.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99172024-12-02T16:55:20.078ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99182024-12-02T16:55:20.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99192024-12-02T16:55:20.081ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99202024-12-02T16:55:20.081ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 283.634148ms iteration = 24 status = null
99212024-12-02T16:55:20.081ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99222024-12-02T16:55:20.081ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3023dc30-a0c8-49cf-9583-134b865157dd", "date": "Mon, 02 Dec 2024 16:55:19 GMT"} })
99232024-12-02T16:55:20.083ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 285.114242ms iteration = 25 status = {}
99242024-12-02T16:55:20.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99252024-12-02T16:55:20.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99262024-12-02T16:55:20.123ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
99272024-12-02T16:55:20.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99282024-12-02T16:55:20.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99292024-12-02T16:55:20.131ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99302024-12-02T16:55:20.131ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "81b6498c-5e39-4844-b4a6-4cc4533dcde3", "content-length": "134", "date": "Mon, 02 Dec 2024 16:55:19 GMT"} })
99312024-12-02T16:55:20.131ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99322024-12-02T16:55:20.131ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
99332024-12-02T16:55:20.131ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99342024-12-02T16:55:20.131ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99352024-12-02T16:55:20.131ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99362024-12-02T16:55:20.131ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99372024-12-02T16:55:20.131ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99382024-12-02T16:55:20.131ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99392024-12-02T16:55:20.131ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99402024-12-02T16:55:20.131ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99412024-12-02T16:55:20.132ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
99422024-12-02T16:55:20.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99432024-12-02T16:55:20.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99442024-12-02T16:55:20.133ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99452024-12-02T16:55:20.134ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c08511c0-2bbd-4737-891e-2ee2c821f88f", "content-length": "2", "date": "Mon, 02 Dec 2024 16:55:19 GMT"} })
99462024-12-02T16:55:20.134ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99472024-12-02T16:55:20.134ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cda4ff2-dc3a-49eb-86b4-777e61534b90", "content-length": "52", "date": "Mon, 02 Dec 2024 16:55:19 GMT"} })
99482024-12-02T16:55:20.134ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
99492024-12-02T16:55:20.134ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99502024-12-02T16:55:20.223ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c3fe98eb-8118-439f-a7ce-eedb47ddb6cb", "date": "Mon, 02 Dec 2024 16:55:19 GMT"} })
99512024-12-02T16:55:20.223ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
99522024-12-02T16:55:20.223ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99532024-12-02T16:55:20.223ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a88ffcc5-e669-4ce5-8a99-8ffd179aedfe", "content-length": "682", "date": "Mon, 02 Dec 2024 16:55:19 GMT"} })
99542024-12-02T16:55:20.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99552024-12-02T16:55:20.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99562024-12-02T16:55:20.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99572024-12-02T16:55:20.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99582024-12-02T16:55:20.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99592024-12-02T16:55:20.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99602024-12-02T16:55:20.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99612024-12-02T16:55:20.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99622024-12-02T16:55:20.238ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 441.163095ms iteration = 24 status = {}
99632024-12-02T16:55:20.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c023d6c3-0fc3-4468-8f96-78828531e918 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99642024-12-02T16:55:20.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c023d6c3-0fc3-4468-8f96-78828531e918 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99652024-12-02T16:55:20.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c023d6c3-0fc3-4468-8f96-78828531e918 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99662024-12-02T16:55:21.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 59074791-e5ad-4b05-a1c3-bbeffeab36c2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99672024-12-02T16:55:21.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 59074791-e5ad-4b05-a1c3-bbeffeab36c2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99682024-12-02T16:55:21.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 59074791-e5ad-4b05-a1c3-bbeffeab36c2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99692024-12-02T16:55:22.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0576d92b-90ce-480c-84b3-b5ccfdc39272 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99702024-12-02T16:55:22.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0576d92b-90ce-480c-84b3-b5ccfdc39272 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99712024-12-02T16:55:22.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0576d92b-90ce-480c-84b3-b5ccfdc39272 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99722024-12-02T16:55:23.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 494c2182-cfd1-4f3a-aa01-b9a03c030b59 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99732024-12-02T16:55:23.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 494c2182-cfd1-4f3a-aa01-b9a03c030b59 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99742024-12-02T16:55:23.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 494c2182-cfd1-4f3a-aa01-b9a03c030b59 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99752024-12-02T16:55:24.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5c7f89d6-9387-4eba-90eb-b1a4ef40d18e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99762024-12-02T16:55:24.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5c7f89d6-9387-4eba-90eb-b1a4ef40d18e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99772024-12-02T16:55:24.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 5c7f89d6-9387-4eba-90eb-b1a4ef40d18e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99782024-12-02T16:55:25.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 91c509b3-08bc-428c-8698-9a0185e968bc roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99792024-12-02T16:55:25.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 91c509b3-08bc-428c-8698-9a0185e968bc resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99802024-12-02T16:55:25.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 91c509b3-08bc-428c-8698-9a0185e968bc response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99812024-12-02T16:55:26.560ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1305 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 53979017-9741-41c8-9376-a7aeef9fe48f response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
99822024-12-02T16:55:26.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f9fbae85-3e60-40df-875c-27f0db4d3c50 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99832024-12-02T16:55:26.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f9fbae85-3e60-40df-875c-27f0db4d3c50 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99842024-12-02T16:55:26.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f9fbae85-3e60-40df-875c-27f0db4d3c50 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99852024-12-02T16:55:27.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9d645461-9087-4590-9c2d-1421072b8cab roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99862024-12-02T16:55:27.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9d645461-9087-4590-9c2d-1421072b8cab resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99872024-12-02T16:55:27.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9d645461-9087-4590-9c2d-1421072b8cab response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99882024-12-02T16:55:28.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b3ae442a-518c-4fae-9974-28eed53ee9c7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99892024-12-02T16:55:28.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b3ae442a-518c-4fae-9974-28eed53ee9c7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99902024-12-02T16:55:28.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b3ae442a-518c-4fae-9974-28eed53ee9c7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99912024-12-02T16:55:29.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c323356d-7a28-49e4-a11b-12f8eb36355c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99922024-12-02T16:55:29.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c323356d-7a28-49e4-a11b-12f8eb36355c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99932024-12-02T16:55:29.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c323356d-7a28-49e4-a11b-12f8eb36355c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
99942024-12-02T16:55:29.798ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
99952024-12-02T16:55:29.798ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
99962024-12-02T16:55:29.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99972024-12-02T16:55:29.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99982024-12-02T16:55:29.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99992024-12-02T16:55:29.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100002024-12-02T16:55:29.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100012024-12-02T16:55:29.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100022024-12-02T16:55:29.800ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100032024-12-02T16:55:29.801ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.128487ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100042024-12-02T16:55:29.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100052024-12-02T16:55:29.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100062024-12-02T16:55:29.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100072024-12-02T16:55:29.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100082024-12-02T16:55:29.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100092024-12-02T16:55:29.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100102024-12-02T16:55:29.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
100112024-12-02T16:55:29.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100122024-12-02T16:55:29.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100132024-12-02T16:55:29.817ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
100142024-12-02T16:55:29.817ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.047146ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
100152024-12-02T16:55:30.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 10554278-c7ea-456d-8b7b-9a638fb13a5e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
100162024-12-02T16:55:30.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 10554278-c7ea-456d-8b7b-9a638fb13a5e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
100172024-12-02T16:55:30.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 10554278-c7ea-456d-8b7b-9a638fb13a5e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
100182024-12-02T16:55:30.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = a08d18e0-4283-4c64-b0d0-9aa05fdd764e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
100192024-12-02T16:55:30.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = a08d18e0-4283-4c64-b0d0-9aa05fdd764e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
100202024-12-02T16:55:30.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = a08d18e0-4283-4c64-b0d0-9aa05fdd764e response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
100212024-12-02T16:55:30.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fbfda4dc-9033-49c3-8214-d5a0b25a8962 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100222024-12-02T16:55:30.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fbfda4dc-9033-49c3-8214-d5a0b25a8962 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100232024-12-02T16:55:30.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fbfda4dc-9033-49c3-8214-d5a0b25a8962 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100242024-12-02T16:55:31.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9335fc6b-8a06-4daa-998e-cfafc68579ee roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100252024-12-02T16:55:31.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9335fc6b-8a06-4daa-998e-cfafc68579ee resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100262024-12-02T16:55:31.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 9335fc6b-8a06-4daa-998e-cfafc68579ee response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100272024-12-02T16:55:32.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c5264131-adb9-4e2e-b023-ac3afec947fe roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100282024-12-02T16:55:32.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c5264131-adb9-4e2e-b023-ac3afec947fe resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100292024-12-02T16:55:32.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c5264131-adb9-4e2e-b023-ac3afec947fe response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100302024-12-02T16:55:33.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dfd9254b-c9b7-4eab-b5de-0a6080b5fb76 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100312024-12-02T16:55:33.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dfd9254b-c9b7-4eab-b5de-0a6080b5fb76 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100322024-12-02T16:55:33.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2915 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dfd9254b-c9b7-4eab-b5de-0a6080b5fb76 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100332024-12-02T16:55:34.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 28d968d1-da77-4c90-8f75-0d08a0b628be roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100342024-12-02T16:55:34.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 28d968d1-da77-4c90-8f75-0d08a0b628be resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100352024-12-02T16:55:34.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 28d968d1-da77-4c90-8f75-0d08a0b628be response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100362024-12-02T16:55:35.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f6bb670a-8692-42d6-ab85-ac552f4dd1f5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100372024-12-02T16:55:35.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f6bb670a-8692-42d6-ab85-ac552f4dd1f5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100382024-12-02T16:55:35.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f6bb670a-8692-42d6-ab85-ac552f4dd1f5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100392024-12-02T16:55:36.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1477 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 2b88002b-4565-4ca6-ba28-3757378990d7 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
100402024-12-02T16:55:36.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b2f27b9c-6723-4676-ac13-ec83594eded1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100412024-12-02T16:55:36.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b2f27b9c-6723-4676-ac13-ec83594eded1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100422024-12-02T16:55:36.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = b2f27b9c-6723-4676-ac13-ec83594eded1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100432024-12-02T16:55:38.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 443359e7-de6f-4c88-9579-f8eafc38cb49 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100442024-12-02T16:55:38.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 443359e7-de6f-4c88-9579-f8eafc38cb49 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100452024-12-02T16:55:38.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 443359e7-de6f-4c88-9579-f8eafc38cb49 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100462024-12-02T16:55:38.165ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cfdc984d-5be7-40f3-a5b7-86254d0b610c uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-02T16:55:38.159442008Z }
100472024-12-02T16:55:38.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cfdc984d-5be7-40f3-a5b7-86254d0b610c roles = RoleSet { roles: {} } uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
100482024-12-02T16:55:38.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cfdc984d-5be7-40f3-a5b7-86254d0b610c resource = Database result = Ok(()) uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
100492024-12-02T16:55:38.192ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:55439
100502024-12-02T16:55:38.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:55439 req_id = e48caf1b-a898-4b63-a627-3d72a2b2c3ab roles = RoleSet { roles: {} } uri = /metrics/producers
100512024-12-02T16:55:38.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:55439 req_id = e48caf1b-a898-4b63-a627-3d72a2b2c3ab resource = Database result = Ok(()) uri = /metrics/producers
100522024-12-02T16:55:38.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46471 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = cfdc984d-5be7-40f3-a5b7-86254d0b610c response_code = 204 uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
100532024-12-02T16:55:38.207ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2586d614-0e15-4a6a-adef-d7e926786961 uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-02T16:55:38.207631079Z }
100542024-12-02T16:55:38.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2586d614-0e15-4a6a-adef-d7e926786961 roles = RoleSet { roles: {} } uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
100552024-12-02T16:55:38.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2586d614-0e15-4a6a-adef-d7e926786961 resource = Database result = Ok(()) uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
100562024-12-02T16:55:38.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9726 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2586d614-0e15-4a6a-adef-d7e926786961 response_code = 204 uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
100572024-12-02T16:55:38.228ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72
100582024-12-02T16:55:38.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35295 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:55439 req_id = e48caf1b-a898-4b63-a627-3d72a2b2c3ab response_code = 201 uri = /metrics/producers
100592024-12-02T16:55:39.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f710301b-9e4c-41c7-869c-305c0a041b5f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100602024-12-02T16:55:39.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f710301b-9e4c-41c7-869c-305c0a041b5f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100612024-12-02T16:55:39.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = f710301b-9e4c-41c7-869c-305c0a041b5f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100622024-12-02T16:55:39.798ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
100632024-12-02T16:55:39.798ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
100642024-12-02T16:55:39.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100652024-12-02T16:55:39.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100662024-12-02T16:55:39.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100672024-12-02T16:55:39.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100682024-12-02T16:55:39.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100692024-12-02T16:55:39.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100702024-12-02T16:55:39.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100712024-12-02T16:55:39.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.898704ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100722024-12-02T16:55:39.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100732024-12-02T16:55:39.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100742024-12-02T16:55:39.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100752024-12-02T16:55:39.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100762024-12-02T16:55:39.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100772024-12-02T16:55:39.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100782024-12-02T16:55:39.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
100792024-12-02T16:55:39.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100802024-12-02T16:55:39.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100812024-12-02T16:55:39.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
100822024-12-02T16:55:39.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.064024ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
100832024-12-02T16:55:40.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ae2e06a1-64ad-41af-8947-e6c167cc3449 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100842024-12-02T16:55:40.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ae2e06a1-64ad-41af-8947-e6c167cc3449 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100852024-12-02T16:55:40.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ae2e06a1-64ad-41af-8947-e6c167cc3449 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100862024-12-02T16:55:41.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6e868aab-f15e-44ea-8d68-d05c58ba2479 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100872024-12-02T16:55:41.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6e868aab-f15e-44ea-8d68-d05c58ba2479 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100882024-12-02T16:55:41.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6e868aab-f15e-44ea-8d68-d05c58ba2479 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100892024-12-02T16:55:42.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 997f4a38-7d25-4fa0-9e53-09188e21555a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100902024-12-02T16:55:42.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 997f4a38-7d25-4fa0-9e53-09188e21555a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100912024-12-02T16:55:42.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 997f4a38-7d25-4fa0-9e53-09188e21555a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100922024-12-02T16:55:43.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7f3b6e3-5626-45e1-b2c2-40294182ead3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100932024-12-02T16:55:43.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7f3b6e3-5626-45e1-b2c2-40294182ead3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100942024-12-02T16:55:43.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1760 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = e7f3b6e3-5626-45e1-b2c2-40294182ead3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100952024-12-02T16:55:44.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 52d1d657-0131-4b71-b59e-bc8ac1f77952 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100962024-12-02T16:55:44.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 52d1d657-0131-4b71-b59e-bc8ac1f77952 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100972024-12-02T16:55:44.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 52d1d657-0131-4b71-b59e-bc8ac1f77952 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100982024-12-02T16:55:45.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 34a83ff0-e6a9-4f6e-a596-877218dc4cd5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
100992024-12-02T16:55:45.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 34a83ff0-e6a9-4f6e-a596-877218dc4cd5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
101002024-12-02T16:55:45.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 34a83ff0-e6a9-4f6e-a596-877218dc4cd5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
101012024-12-02T16:55:46.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd74cd46-cb10-4d4e-8152-404a6a75ca3c roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
101022024-12-02T16:55:46.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd74cd46-cb10-4d4e-8152-404a6a75ca3c resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
101032024-12-02T16:55:46.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = dd74cd46-cb10-4d4e-8152-404a6a75ca3c response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
101042024-12-02T16:55:46.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = b0ad66b0-412a-48c8-91dc-d8e544f751c8 roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
101052024-12-02T16:55:46.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = b0ad66b0-412a-48c8-91dc-d8e544f751c8 resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
101062024-12-02T16:55:46.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3109 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = b0ad66b0-412a-48c8-91dc-d8e544f751c8 response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
101072024-12-02T16:55:46.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = a8f0ac11-ba0c-4fd8-975a-aad188d7e40c roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
101082024-12-02T16:55:46.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = a8f0ac11-ba0c-4fd8-975a-aad188d7e40c resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
101092024-12-02T16:55:46.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = a8f0ac11-ba0c-4fd8-975a-aad188d7e40c response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
101102024-12-02T16:55:46.593ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = cf334472-c657-4451-91ec-0292b3ed1b91 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
101112024-12-02T16:55:47.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2b4c2629-fe8a-4ec0-8430-46000beb74a2 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
101122024-12-02T16:55:47.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2b4c2629-fe8a-4ec0-8430-46000beb74a2 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
101132024-12-02T16:55:47.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 2b4c2629-fe8a-4ec0-8430-46000beb74a2 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
101142024-12-02T16:55:48.160ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a9285f44-7b50-47fc-8d96-23a965a6a995 uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-02T16:55:48.159715319Z }
101152024-12-02T16:55:48.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a9285f44-7b50-47fc-8d96-23a965a6a995 roles = RoleSet { roles: {} } uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
101162024-12-02T16:55:48.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a9285f44-7b50-47fc-8d96-23a965a6a995 resource = Database result = Ok(()) uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
101172024-12-02T16:55:48.214ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:159 retry_after (ms) = 42 transaction = vmm_and_migration_update_runtime
101182024-12-02T16:55:48.241ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:41847
101192024-12-02T16:55:48.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41847 req_id = ca155876-25f5-4be4-a107-edcac9ca79d8 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
101202024-12-02T16:55:48.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41847 req_id = ca155876-25f5-4be4-a107-edcac9ca79d8 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
101212024-12-02T16:55:48.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1817 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41847 req_id = ca155876-25f5-4be4-a107-edcac9ca79d8 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
101222024-12-02T16:55:48.266ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:115 transaction = vmm_and_migration_update_runtime
101232024-12-02T16:55:48.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106529 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a9285f44-7b50-47fc-8d96-23a965a6a995 response_code = 204 uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
101242024-12-02T16:55:49.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6af0955f-c986-4aab-8f59-7bd3f353f373 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
101252024-12-02T16:55:49.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6af0955f-c986-4aab-8f59-7bd3f353f373 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
101262024-12-02T16:55:49.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6af0955f-c986-4aab-8f59-7bd3f353f373 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
101272024-12-02T16:55:49.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = fcb7ca84-248d-4ce5-b5fb-b886beb5a40c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
101282024-12-02T16:55:49.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = fcb7ca84-248d-4ce5-b5fb-b886beb5a40c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
101292024-12-02T16:55:49.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = fcb7ca84-248d-4ce5-b5fb-b886beb5a40c response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
101302024-12-02T16:55:49.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 7c292464-28d0-41bc-9787-72c0be5e738a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
101312024-12-02T16:55:49.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 7c292464-28d0-41bc-9787-72c0be5e738a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
101322024-12-02T16:55:49.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3621 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 7c292464-28d0-41bc-9787-72c0be5e738a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
101332024-12-02T16:55:49.798ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
101342024-12-02T16:55:49.798ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
101352024-12-02T16:55:49.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101362024-12-02T16:55:49.798ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
101372024-12-02T16:55:49.798ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
101382024-12-02T16:55:49.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101392024-12-02T16:55:49.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101402024-12-02T16:55:49.798ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
101412024-12-02T16:55:49.798ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = c575ce6d-3e43-4b59-886a-60182869b755
101422024-12-02T16:55:49.798ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
101432024-12-02T16:55:49.798ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.21\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"c575ce6d-3e43-4b59-886a-60182869b755"}
101442024-12-02T16:55:49.798ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
101452024-12-02T16:55:49.798ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
101462024-12-02T16:55:49.798ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
101472024-12-02T16:55:49.798ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
101482024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101492024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
101502024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
101512024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101522024-12-02T16:55:49.799ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
101532024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
101542024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101552024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
101562024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
101572024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
101582024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101592024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
101602024-12-02T16:55:49.799ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-02 16:45:49.798896087 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
101612024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
101622024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
101632024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101642024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
101652024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
101662024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
101672024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101682024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101692024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
101702024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
101712024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
101722024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101732024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
101742024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101752024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
101762024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101772024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
101782024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
101792024-12-02T16:55:49.799ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
101802024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101812024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
101822024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
101832024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
101842024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
101852024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
101862024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101872024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
101882024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
101892024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
101902024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
101912024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
101922024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
101932024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
101942024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101952024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
101962024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101972024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
101982024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101992024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102002024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102012024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102022024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102032024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
102042024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102052024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102062024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102072024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102082024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102092024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102102024-12-02T16:55:49.799ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3a1a23f6-3701-4a53-9e08-543f9ba04e60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b5030471-1797-42f6-9660-1ead64511c29.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2a91405-2b77-4d99-86ea-67c3ba8afc98.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 26111, tv_nsec: 531512389 } })
102112024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102122024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102132024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
102142024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102152024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
102162024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102172024-12-02T16:55:49.799ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5510b96c-d504-40ca-83bc-e27293be3abe.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efa28bff-324d-4515-8bf9-4ea313797b64.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 26111, tv_nsec: 531614320 } })
102182024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
102192024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102202024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102212024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
102222024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102232024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
102242024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102252024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102262024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
102272024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102282024-12-02T16:55:49.799ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102292024-12-02T16:55:49.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102302024-12-02T16:55:49.800ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102312024-12-02T16:55:49.800ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
102322024-12-02T16:55:49.800ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.392342ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
102332024-12-02T16:55:49.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102342024-12-02T16:55:49.800ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
102352024-12-02T16:55:49.800ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.332922ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
102362024-12-02T16:55:49.801ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26111, tv_nsec: 533525617 } })
102372024-12-02T16:55:49.801ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
102382024-12-02T16:55:49.802ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.186417ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
102392024-12-02T16:55:49.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102402024-12-02T16:55:49.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102412024-12-02T16:55:49.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102422024-12-02T16:55:49.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102432024-12-02T16:55:49.804ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26111, tv_nsec: 536331841 } })
102442024-12-02T16:55:49.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
102452024-12-02T16:55:49.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102462024-12-02T16:55:49.804ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
102472024-12-02T16:55:49.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102482024-12-02T16:55:49.805ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102492024-12-02T16:55:49.805ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102502024-12-02T16:55:49.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102512024-12-02T16:55:49.806ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102522024-12-02T16:55:49.807ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102532024-12-02T16:55:49.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
102542024-12-02T16:55:49.808ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
102552024-12-02T16:55:49.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
102562024-12-02T16:55:49.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102572024-12-02T16:55:49.808ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102582024-12-02T16:55:49.808ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102592024-12-02T16:55:49.808ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102602024-12-02T16:55:49.808ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102612024-12-02T16:55:49.808ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102622024-12-02T16:55:49.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102632024-12-02T16:55:49.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102642024-12-02T16:55:49.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102652024-12-02T16:55:49.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102662024-12-02T16:55:49.810ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102672024-12-02T16:55:49.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102682024-12-02T16:55:49.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
102692024-12-02T16:55:49.811ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102702024-12-02T16:55:49.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102712024-12-02T16:55:49.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102722024-12-02T16:55:49.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102732024-12-02T16:55:49.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102742024-12-02T16:55:49.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
102752024-12-02T16:55:49.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102762024-12-02T16:55:49.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102772024-12-02T16:55:49.813ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-02 16:45:49.798896087 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
102782024-12-02T16:55:49.813ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.268885ms iteration = 13 status = {"expiration":"2024-12-02T16:45:49.798896087Z","pruned":[]}
102792024-12-02T16:55:49.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102802024-12-02T16:55:49.814ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.824588ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
102812024-12-02T16:55:49.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102822024-12-02T16:55:49.815ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102832024-12-02T16:55:49.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102842024-12-02T16:55:49.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102852024-12-02T16:55:49.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102862024-12-02T16:55:49.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102872024-12-02T16:55:49.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102882024-12-02T16:55:49.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102892024-12-02T16:55:49.818ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102902024-12-02T16:55:49.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102912024-12-02T16:55:49.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102922024-12-02T16:55:49.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102932024-12-02T16:55:49.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102942024-12-02T16:55:49.820ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102952024-12-02T16:55:49.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102962024-12-02T16:55:49.821ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102972024-12-02T16:55:49.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102982024-12-02T16:55:49.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102992024-12-02T16:55:49.823ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103002024-12-02T16:55:49.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103012024-12-02T16:55:49.823ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103022024-12-02T16:55:49.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103032024-12-02T16:55:49.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103042024-12-02T16:55:49.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
103052024-12-02T16:55:49.828ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103062024-12-02T16:55:49.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103072024-12-02T16:55:49.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
103082024-12-02T16:55:49.831ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103092024-12-02T16:55:49.831ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
103102024-12-02T16:55:49.831ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103112024-12-02T16:55:49.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103122024-12-02T16:55:49.831ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
103132024-12-02T16:55:49.831ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
103142024-12-02T16:55:49.831ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 32.913087ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
103152024-12-02T16:55:49.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103162024-12-02T16:55:49.834ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103172024-12-02T16:55:49.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103182024-12-02T16:55:49.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103192024-12-02T16:55:49.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103202024-12-02T16:55:49.835ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26111, tv_nsec: 567275921 } })
103212024-12-02T16:55:49.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
103222024-12-02T16:55:49.835ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
103232024-12-02T16:55:49.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103242024-12-02T16:55:49.838ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103252024-12-02T16:55:49.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103262024-12-02T16:55:49.838ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 39.709767ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
103272024-12-02T16:55:49.839ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
103282024-12-02T16:55:49.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103292024-12-02T16:55:49.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103302024-12-02T16:55:49.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103312024-12-02T16:55:49.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
103322024-12-02T16:55:49.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103332024-12-02T16:55:49.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103342024-12-02T16:55:49.852ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103352024-12-02T16:55:49.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103362024-12-02T16:55:49.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103372024-12-02T16:55:49.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103382024-12-02T16:55:49.860ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
103392024-12-02T16:55:49.860ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
103402024-12-02T16:55:49.860ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 61.78651ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
103412024-12-02T16:55:49.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
103422024-12-02T16:55:49.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.636936ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
103432024-12-02T16:55:49.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.05049ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
103442024-12-02T16:55:49.864ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
103452024-12-02T16:55:49.864ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
103462024-12-02T16:55:49.864ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
103472024-12-02T16:55:49.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103482024-12-02T16:55:49.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103492024-12-02T16:55:49.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.777075ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
103502024-12-02T16:55:49.870ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103512024-12-02T16:55:49.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
103522024-12-02T16:55:49.872ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103532024-12-02T16:55:49.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103542024-12-02T16:55:49.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 75.218717ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103552024-12-02T16:55:49.876ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103562024-12-02T16:55:49.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103572024-12-02T16:55:49.878ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
103582024-12-02T16:55:49.878ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
103592024-12-02T16:55:49.878ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
103602024-12-02T16:55:49.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103612024-12-02T16:55:49.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103622024-12-02T16:55:49.883ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103632024-12-02T16:55:49.884ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103642024-12-02T16:55:49.884ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
103652024-12-02T16:55:49.884ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 85.194575ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
103662024-12-02T16:55:49.884ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103672024-12-02T16:55:49.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
103682024-12-02T16:55:49.885ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103692024-12-02T16:55:49.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103702024-12-02T16:55:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
103712024-12-02T16:55:49.887ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103722024-12-02T16:55:49.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103732024-12-02T16:55:49.888ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
103742024-12-02T16:55:49.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
103752024-12-02T16:55:49.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103762024-12-02T16:55:49.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103772024-12-02T16:55:50.015ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
103782024-12-02T16:55:50.015ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103792024-12-02T16:55:50.015ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e85a0a2-2ab5-4bef-bd57-b58fc95d8c52", "content-length": "26", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
103802024-12-02T16:55:50.015ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103812024-12-02T16:55:50.016ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103822024-12-02T16:55:50.067ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
103832024-12-02T16:55:50.067ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103842024-12-02T16:55:50.068ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "660cc7b8-3df3-4a21-8750-317bb67494c6", "content-length": "26", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
103852024-12-02T16:55:50.068ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103862024-12-02T16:55:50.070ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
103872024-12-02T16:55:50.085ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a/state
103882024-12-02T16:55:50.112ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
103892024-12-02T16:55:50.132ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
103902024-12-02T16:55:50.171ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103912024-12-02T16:55:50.171ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103922024-12-02T16:55:50.172ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c93ac80f-787a-447d-ac34-c50e9bf4526a", "content-length": "585", "date": "Mon, 02 Dec 2024 16:55:49 GMT"} })
103932024-12-02T16:55:50.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103942024-12-02T16:55:50.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103952024-12-02T16:55:50.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 374.597294ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103962024-12-02T16:55:50.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103972024-12-02T16:55:50.174ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
103982024-12-02T16:55:50.174ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103992024-12-02T16:55:50.175ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 376.163327ms iteration = 6 status = {"nsuccess":5}
104002024-12-02T16:55:50.175ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0582f34-75dc-4cae-9a58-5c6149875431", "content-length": "26", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
104012024-12-02T16:55:50.175ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
104022024-12-02T16:55:50.175ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104032024-12-02T16:55:50.176ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104042024-12-02T16:55:50.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104052024-12-02T16:55:50.176ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
104062024-12-02T16:55:50.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
104072024-12-02T16:55:50.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104082024-12-02T16:55:50.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104092024-12-02T16:55:50.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
104102024-12-02T16:55:50.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104112024-12-02T16:55:50.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104122024-12-02T16:55:50.190ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104132024-12-02T16:55:50.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104142024-12-02T16:55:50.220ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
104152024-12-02T16:55:50.220ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 0 version = 2
104162024-12-02T16:55:50.220ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104172024-12-02T16:55:50.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104182024-12-02T16:55:50.222ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
104192024-12-02T16:55:50.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104202024-12-02T16:55:50.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104212024-12-02T16:55:50.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104222024-12-02T16:55:50.226ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
104232024-12-02T16:55:50.226ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104242024-12-02T16:55:50.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104252024-12-02T16:55:50.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
104262024-12-02T16:55:50.227ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104272024-12-02T16:55:50.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104282024-12-02T16:55:50.229ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104292024-12-02T16:55:50.229ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2fdf7baf-a6a2-4fa5-8118-ad7bc74f3bc8 dns_zone_name = oxide.test found_so_far = 1 version = 2
104302024-12-02T16:55:50.229ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
104312024-12-02T16:55:50.229ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-02 16:44:12.116348 UTC dns_group = external generation = 2
104322024-12-02T16:55:50.229ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 430.832555ms iteration = 14 status = {"generation":2}
104332024-12-02T16:55:50.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104342024-12-02T16:55:50.230ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
104352024-12-02T16:55:50.230ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
104362024-12-02T16:55:50.230ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104372024-12-02T16:55:50.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104382024-12-02T16:55:50.230ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 431.41954ms iteration = 25 status = 0
104392024-12-02T16:55:50.231ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104402024-12-02T16:55:50.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
104412024-12-02T16:55:50.234ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104422024-12-02T16:55:50.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104432024-12-02T16:55:50.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104442024-12-02T16:55:50.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104452024-12-02T16:55:50.244ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104462024-12-02T16:55:50.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104472024-12-02T16:55:50.245ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {d02e1000-d87d-4401-83cf-1a0f154fbdf5: {10.151.1.176: {5734c14d-016a-4685-9589-f0039fbbe1e8}, 10.151.1.175: {5734c14d-016a-4685-9589-f0039fbbe1e8}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
104482024-12-02T16:55:50.245ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
104492024-12-02T16:55:50.245ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "538dd5b1-36ca-4392-a480-fcbc694315ff", "date": "Mon, 02 Dec 2024 16:55:49 GMT"} })
104502024-12-02T16:55:50.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104512024-12-02T16:55:50.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104522024-12-02T16:55:50.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104532024-12-02T16:55:50.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104542024-12-02T16:55:50.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104552024-12-02T16:55:50.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104562024-12-02T16:55:50.257ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
104572024-12-02T16:55:50.257ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 458.044093ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
104582024-12-02T16:55:50.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104592024-12-02T16:55:50.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104602024-12-02T16:55:50.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104612024-12-02T16:55:50.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104622024-12-02T16:55:50.264ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 465.715141ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
104632024-12-02T16:55:50.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104642024-12-02T16:55:50.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104652024-12-02T16:55:50.268ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
104662024-12-02T16:55:50.268ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
104672024-12-02T16:55:50.268ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
104682024-12-02T16:55:50.269ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "321be8d1-3222-43dc-9765-0ac374c94f37", "date": "Mon, 02 Dec 2024 16:55:49 GMT"} })
104692024-12-02T16:55:50.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104702024-12-02T16:55:50.271ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 472.034235ms iteration = 26 status = {}
104712024-12-02T16:55:50.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
104722024-12-02T16:55:50.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104732024-12-02T16:55:50.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104742024-12-02T16:55:50.275ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 3054f566-865e-472c-9bef-578084568488 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
104752024-12-02T16:55:50.275ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
104762024-12-02T16:55:50.275ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-02 16:44:11.214841 UTC dns_group = internal generation = 1
104772024-12-02T16:55:50.275ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 476.680526ms iteration = 14 status = {"generation":1}
104782024-12-02T16:55:50.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104792024-12-02T16:55:50.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104802024-12-02T16:55:50.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104812024-12-02T16:55:50.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104822024-12-02T16:55:50.283ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-02T16:43:45.642486Z, time_modified: 2024-12-02T16:43:45.642486Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, db_silo: Silo { identity: SiloIdentity { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-02T16:44:12.071211Z, time_modified: 2024-12-02T16:44:12.071211Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
104832024-12-02T16:55:50.283ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 484.595195ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]}},"default_endpoint":{"silo_id":"07ef2657-6a0a-432e-8c0e-93397c08ce01","tls_certs":["abf77318b0864497768c1f08713cde535ae2838b09abb826cb859997e387ec38"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
104842024-12-02T16:55:50.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d7096bce-9050-429f-8425-b519dd451159 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
104852024-12-02T16:55:50.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d7096bce-9050-429f-8425-b519dd451159 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
104862024-12-02T16:55:50.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d7096bce-9050-429f-8425-b519dd451159 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
104872024-12-02T16:55:50.300ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 501.486063ms iteration = 29 status = {"physical_disks_added":0}
104882024-12-02T16:55:50.303ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
104892024-12-02T16:55:50.303ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "28d769bc-e7dd-4628-8509-9710d59f2fef", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
104902024-12-02T16:55:50.303ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
104912024-12-02T16:55:50.306ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "47724837-7a25-4fb9-bc81-a76c36ec118e", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
104922024-12-02T16:55:50.306ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
104932024-12-02T16:55:50.307ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
104942024-12-02T16:55:50.307ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 508.434204ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
104952024-12-02T16:55:50.356ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
104962024-12-02T16:55:50.356ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3574ca9-cc90-4c41-a913-a987a69c0338", "content-length": "2", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
104972024-12-02T16:55:50.358ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104982024-12-02T16:55:50.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
104992024-12-02T16:55:50.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = fb2202f3-3aa7-4bde-baf5-27b684b4dec5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
105002024-12-02T16:55:50.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = fb2202f3-3aa7-4bde-baf5-27b684b4dec5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
105012024-12-02T16:55:50.364ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 565.214011ms iteration = 25 status = {}
105022024-12-02T16:55:50.378ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
105032024-12-02T16:55:50.417ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
105042024-12-02T16:55:50.418ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9826dc3-ec32-4060-8c35-ce532cd551f4", "content-length": "811", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
105052024-12-02T16:55:50.418ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(14273799) }} sled = buskin
105062024-12-02T16:55:50.418ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
105072024-12-02T16:55:50.418ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
105082024-12-02T16:55:50.420ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 621.521352ms iteration = 25 status = null
105092024-12-02T16:55:50.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = fb2202f3-3aa7-4bde-baf5-27b684b4dec5 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
105102024-12-02T16:55:50.421ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 622.668002ms iteration = 25 status = {}
105112024-12-02T16:55:50.436ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
105122024-12-02T16:55:50.437ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "62d5e2d6-3f5d-4b75-a84f-4dcf733406a2", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
105132024-12-02T16:55:50.437ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
105142024-12-02T16:55:50.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105152024-12-02T16:55:50.438ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0f6cfa85-b97c-4350-8b0f-afa0a8577aa2", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
105162024-12-02T16:55:50.438ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
105172024-12-02T16:55:50.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105182024-12-02T16:55:50.440ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c98089c9-3e5e-436b-87e3-2293acd86fb9", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
105192024-12-02T16:55:50.440ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
105202024-12-02T16:55:50.441ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
105212024-12-02T16:55:50.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105222024-12-02T16:55:50.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105232024-12-02T16:55:50.442ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
105242024-12-02T16:55:50.443ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 644.021369ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
105252024-12-02T16:55:50.452ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
105262024-12-02T16:55:50.452ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "33780840-d6ee-4943-99ca-535307147f5f", "content-length": "134", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
105272024-12-02T16:55:50.452ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
105282024-12-02T16:55:50.452ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
105292024-12-02T16:55:50.452ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
105302024-12-02T16:55:50.452ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
105312024-12-02T16:55:50.452ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105322024-12-02T16:55:50.452ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105332024-12-02T16:55:50.452ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105342024-12-02T16:55:50.452ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
105352024-12-02T16:55:50.452ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105362024-12-02T16:55:50.452ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
105372024-12-02T16:55:50.452ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
105382024-12-02T16:55:50.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105392024-12-02T16:55:50.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105402024-12-02T16:55:50.455ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
105412024-12-02T16:55:50.455ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "56b0f2ba-a0cb-4c77-8470-35586a7ea4a8", "content-length": "2", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
105422024-12-02T16:55:50.455ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
105432024-12-02T16:55:50.455ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a8fbbb8-245a-4fb5-9427-24c60ec90de5", "content-length": "52", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
105442024-12-02T16:55:50.455ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
105452024-12-02T16:55:50.455ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
105462024-12-02T16:55:50.559ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fa04a0c1-6cbd-4fb2-96c1-b5a6688bf84c", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
105472024-12-02T16:55:50.559ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
105482024-12-02T16:55:50.559ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
105492024-12-02T16:55:50.560ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a48e3f40-a86a-4656-8ad8-69657e2bf512", "content-length": "682", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
105502024-12-02T16:55:50.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105512024-12-02T16:55:50.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105522024-12-02T16:55:50.564ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105532024-12-02T16:55:50.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105542024-12-02T16:55:50.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105552024-12-02T16:55:50.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105562024-12-02T16:55:50.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105572024-12-02T16:55:50.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105582024-12-02T16:55:50.576ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 778.00677ms iteration = 25 status = {}
105592024-12-02T16:55:50.828ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-02T16:55:50.828635228Z }
105602024-12-02T16:55:50.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea roles = RoleSet { roles: {} } uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105612024-12-02T16:55:50.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea resource = Database result = Ok(()) uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105622024-12-02T16:55:50.866ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a vmm_needs_update = true
105632024-12-02T16:55:50.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea roles = RoleSet { roles: {} } uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105642024-12-02T16:55:50.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea resource = Database result = Ok(()) uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105652024-12-02T16:55:50.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea roles = RoleSet { roles: {} } uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105662024-12-02T16:55:50.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea resource = Database result = Ok(()) uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105672024-12-02T16:55:50.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea roles = RoleSet { roles: {} } uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105682024-12-02T16:55:50.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea resource = Database result = Ok(()) uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105692024-12-02T16:55:50.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea roles = RoleSet { roles: {} } uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105702024-12-02T16:55:50.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea resource = Database result = Ok(()) uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105712024-12-02T16:55:50.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea roles = RoleSet { roles: {} } uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105722024-12-02T16:55:50.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea resource = Database result = Ok(()) uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105732024-12-02T16:55:50.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea roles = RoleSet { roles: {} } uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105742024-12-02T16:55:50.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea resource = Database result = Ok(()) uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105752024-12-02T16:55:50.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105762024-12-02T16:55:50.880ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 07ef2657-6a0a-432e-8c0e-93397c08ce01, lookup_type: ById(07ef2657-6a0a-432e-8c0e-93397c08ce01) }, key: b97157f3-6480-4706-a569-3a2476a14295, lookup_type: ById(b97157f3-6480-4706-a569-3a2476a14295) }, key: 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72, lookup_type: ById(6b1b4926-d47f-4b9a-acaf-8d896e9e8d72) } result = Ok(()) uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105772024-12-02T16:55:50.880ZINFOnexus (dropshot_internal): starting update saga for 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-02T16:55:50.828635228Z }
105782024-12-02T16:55:50.880ZDEBGnexus (dropshot_internal): preparing instance-update saga for 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105792024-12-02T16:55:50.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51667 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a5f3d7ff-b06a-4efd-916a-9229462189ea response_code = 204 uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105802024-12-02T16:55:50.880ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update
105812024-12-02T16:55:50.880ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"6b1b4926-d47f-4b9a-acaf-8d896e9e8d72","lookup_type":{"ById":"6b1b4926-d47f-4b9a-acaf-8d896e9e8d72"},"parent":{"key":"b97157f3-6480-4706-a569-3a2476a14295","lookup_type":{"ById":"b97157f3-6480-4706-a569-3a2476a14295"},"parent":{"key":"07ef2657-6a0a-432e-8c0e-93397c08ce01","lookup_type":{"ById":"07ef2657-6a0a-432e-8c0e-93397c08ce01"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
105822024-12-02T16:55:50.880ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update
105832024-12-02T16:55:50.880ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a remote_addr = [fd00:1122:3344:101::1]:56748 req_id = da65d487-ea66-4318-995e-b18532868748 uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-02T16:55:50.828635228Z }
105842024-12-02T16:55:50.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = da65d487-ea66-4318-995e-b18532868748 roles = RoleSet { roles: {} } uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105852024-12-02T16:55:50.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = da65d487-ea66-4318-995e-b18532868748 resource = Database result = Ok(()) uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105862024-12-02T16:55:50.917ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update
105872024-12-02T16:55:50.917ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
105882024-12-02T16:55:50.917ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
105892024-12-02T16:55:50.917ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e
105902024-12-02T16:55:50.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37994 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:56748 req_id = da65d487-ea66-4318-995e-b18532868748 response_code = 204 uri = /vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105912024-12-02T16:55:50.919ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "340b2283-2e05-4ba3-8d3e-131aefe1d9f4", "content-length": "132", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
105922024-12-02T16:55:50.921ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
105932024-12-02T16:55:50.921ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e
105942024-12-02T16:55:50.921ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 sled_id = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-02T16:55:50.828635228Z }, migration_in: None, migration_out: None } vmm_id = 3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105952024-12-02T16:55:50.921ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a sled_id = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf vmm_id = 3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-02T16:55:50.828635228Z }
105962024-12-02T16:55:50.921ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 roles = RoleSet { roles: {} } sled_id = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf vmm_id = 3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105972024-12-02T16:55:50.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 resource = Database result = Ok(()) sled_id = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf vmm_id = 3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a
105982024-12-02T16:55:50.926ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
105992024-12-02T16:55:50.926ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e
106002024-12-02T16:55:50.930ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106012024-12-02T16:55:50.930ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("3eca1923-5cdc-462d-9e06-a4cbab925f3d")) node_id = 0 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e
106022024-12-02T16:55:50.934ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106032024-12-02T16:55:50.934ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e
106042024-12-02T16:55:50.939ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update
106052024-12-02T16:55:50.939ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106062024-12-02T16:55:50.940ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106072024-12-02T16:55:50.946ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106082024-12-02T16:55:50.946ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106092024-12-02T16:55:50.948ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106102024-12-02T16:55:50.948ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106112024-12-02T16:55:50.950ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106122024-12-02T16:55:50.950ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106132024-12-02T16:55:50.952ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106142024-12-02T16:55:50.952ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106152024-12-02T16:55:50.954ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106162024-12-02T16:55:50.954ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106172024-12-02T16:55:50.956ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106182024-12-02T16:55:50.959ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 07ef2657-6a0a-432e-8c0e-93397c08ce01, lookup_type: ById(07ef2657-6a0a-432e-8c0e-93397c08ce01) }, key: b97157f3-6480-4706-a569-3a2476a14295, lookup_type: ById(b97157f3-6480-4706-a569-3a2476a14295) }, key: 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72, lookup_type: ById(6b1b4926-d47f-4b9a-acaf-8d896e9e8d72) } result = Ok(()) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106192024-12-02T16:55:50.959ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance updater_id = 3eca1923-5cdc-462d-9e06-a4cbab925f3d
106202024-12-02T16:55:50.959ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106212024-12-02T16:55:50.959ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106222024-12-02T16:55:50.963ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
106232024-12-02T16:55:50.965ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 1.166524767s iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"destroyed":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
106242024-12-02T16:55:50.968ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance updater_id = 3eca1923-5cdc-462d-9e06-a4cbab925f3d
106252024-12-02T16:55:50.968ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106262024-12-02T16:55:50.969ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance
106272024-12-02T16:55:50.973ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 locked_gen = Generation(Generation(2)) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = LockInstance updater_id = 3eca1923-5cdc-462d-9e06-a4cbab925f3d
106282024-12-02T16:55:50.973ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106292024-12-02T16:55:50.973ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("3eca1923-5cdc-462d-9e06-a4cbab925f3d")}) node_id = 1 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e
106302024-12-02T16:55:50.977ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106312024-12-02T16:55:50.977ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e
106322024-12-02T16:55:50.980ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
106332024-12-02T16:55:50.980ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
106342024-12-02T16:55:50.982ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
106352024-12-02T16:55:50.982ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
106362024-12-02T16:55:50.983ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
106372024-12-02T16:55:50.984ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
106382024-12-02T16:55:50.985ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
106392024-12-02T16:55:50.988ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 07ef2657-6a0a-432e-8c0e-93397c08ce01, lookup_type: ById(07ef2657-6a0a-432e-8c0e-93397c08ce01) }, key: b97157f3-6480-4706-a569-3a2476a14295, lookup_type: ById(b97157f3-6480-4706-a569-3a2476a14295) }, key: 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72, lookup_type: ById(6b1b4926-d47f-4b9a-acaf-8d896e9e8d72) } result = Ok(()) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
106402024-12-02T16:55:50.988ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
106412024-12-02T16:55:50.988ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
106422024-12-02T16:55:50.996ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a, time_created: 2024-12-02T16:55:29.842557Z, time_deleted: None, instance_id: 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72, sled_id: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-02T16:55:50.828635Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-02T16:55:27.625292Z, gen: Generation(Generation(3)), propolis_id: Some(3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-02T16:55:50.996665177Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
106432024-12-02T16:55:50.996ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
106442024-12-02T16:55:50.999ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"6b1b4926-d47f-4b9a-acaf-8d896e9e8d72","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"6b1b4926-d47f-4b9a-acaf-8d896e9e8d72","lookup_type":{"ById":"6b1b4926-d47f-4b9a-acaf-8d896e9e8d72"},"parent":{"key":"b97157f3-6480-4706-a569-3a2476a14295","lookup_type":{"ById":"b97157f3-6480-4706-a569-3a2476a14295"},"parent":{"key":"07ef2657-6a0a-432e-8c0e-93397c08ce01","lookup_type":{"ById":"07ef2657-6a0a-432e-8c0e-93397c08ce01"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"3eca1923-5cdc-462d-9e06-a4cbab925f3d"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"b97157f3-6480-4706-a569-3a2476a14295","ram_diff":1073741824},"destroy_active_vmm":"3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-02T16:55:50.996665177Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106452024-12-02T16:55:50.999ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
106462024-12-02T16:55:51.030ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
106472024-12-02T16:55:51.030ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106482024-12-02T16:55:51.030ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106492024-12-02T16:55:51.030ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
106502024-12-02T16:55:51.036ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106512024-12-02T16:55:51.036ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
106522024-12-02T16:55:51.040ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106532024-12-02T16:55:51.040ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
106542024-12-02T16:55:51.044ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106552024-12-02T16:55:51.044ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("c727952c-f361-4182-b5ba-48701bb202e5")) node_id = 0 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
106562024-12-02T16:55:51.048ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106572024-12-02T16:55:51.048ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
106582024-12-02T16:55:51.051ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 parent_lock = UpdaterLock { updater_id: 3eca1923-5cdc-462d-9e06-a4cbab925f3d, locked_gen: Generation(Generation(2)) } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
106592024-12-02T16:55:51.051ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = BecomeUpdater
106602024-12-02T16:55:51.052ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = BecomeUpdater
106612024-12-02T16:55:51.061ZDEBGnexus (SagaExecutor): inherited lock from 3eca1923-5cdc-462d-9e06-a4cbab925f3d to c727952c-f361-4182-b5ba-48701bb202e5 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 3eca1923-5cdc-462d-9e06-a4cbab925f3d saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = BecomeUpdater updater_id = c727952c-f361-4182-b5ba-48701bb202e5
106622024-12-02T16:55:51.061ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
106632024-12-02T16:55:51.062ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106642024-12-02T16:55:51.062ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("c727952c-f361-4182-b5ba-48701bb202e5")}) node_id = 1 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
106652024-12-02T16:55:51.065ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106662024-12-02T16:55:51.065ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
106672024-12-02T16:55:51.068ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106682024-12-02T16:55:51.068ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
106692024-12-02T16:55:51.072ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106702024-12-02T16:55:51.072ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
106712024-12-02T16:55:51.078ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
106722024-12-02T16:55:51.080ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72
106732024-12-02T16:55:51.082ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = UpdateNetworkConfig
106742024-12-02T16:55:51.083ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = UpdateNetworkConfig
106752024-12-02T16:55:51.085ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = UpdateNetworkConfig
106762024-12-02T16:55:51.085ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = UpdateNetworkConfig
106772024-12-02T16:55:51.089ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
106782024-12-02T16:55:51.089ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = UpdateNetworkConfig
106792024-12-02T16:55:51.090ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = UpdateNetworkConfig
106802024-12-02T16:55:51.092ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
106812024-12-02T16:55:51.092ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
106822024-12-02T16:55:51.092ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
106832024-12-02T16:55:51.093ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
106842024-12-02T16:55:51.095ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
106852024-12-02T16:55:51.095ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
106862024-12-02T16:55:51.095ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
106872024-12-02T16:55:51.099ZDEBGnexus: notifying dendrite of updates instance_id = Some(6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 (instance)) switch = switch0
106882024-12-02T16:55:51.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26112, tv_nsec: 832141637 } })
106892024-12-02T16:55:51.100ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
106902024-12-02T16:55:51.131ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
106912024-12-02T16:55:51.131ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106922024-12-02T16:55:51.131ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f6f4f7e-e8af-46ea-8dc3-66022e5f0633", "content-length": "26", "date": "Mon, 02 Dec 2024 16:55:51 GMT"} })
106932024-12-02T16:55:51.131ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106942024-12-02T16:55:51.132ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106952024-12-02T16:55:51.161ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
106962024-12-02T16:55:51.161ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "a14df7c9-ba73-47c9-9d88-59124048b4d6", "content-length": "4", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
106972024-12-02T16:55:51.162ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
106982024-12-02T16:55:51.162ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
106992024-12-02T16:55:51.166ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107002024-12-02T16:55:51.166ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107012024-12-02T16:55:51.170ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = ReleaseVirtualProvisioning
107022024-12-02T16:55:51.170ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = ReleaseVirtualProvisioning
107032024-12-02T16:55:51.184ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-02T16:55:51.172974Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 07ef2657-6a0a-432e-8c0e-93397c08ce01, time_modified: Some(2024-12-02T16:55:51.172974Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: b97157f3-6480-4706-a569-3a2476a14295, time_modified: Some(2024-12-02T16:55:51.172974Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
107042024-12-02T16:55:51.184ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107052024-12-02T16:55:51.184ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107062024-12-02T16:55:51.188ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107072024-12-02T16:55:51.188ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107082024-12-02T16:55:51.191ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
107092024-12-02T16:55:51.194ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = UnassignOximeterProducer
107102024-12-02T16:55:51.194ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = UnassignOximeterProducer
107112024-12-02T16:55:51.199ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 8df106e3-854c-42b1-b488-0558252fd241 producer_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
107122024-12-02T16:55:51.199ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = UnassignOximeterProducer
107132024-12-02T16:55:51.199ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = UnassignOximeterProducer
107142024-12-02T16:55:51.235ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
107152024-12-02T16:55:51.238ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/6b1b4926-d47f-4b9a-acaf-8d896e9e8d72
107162024-12-02T16:55:51.261ZDEBGnexus (SagaExecutor): client response oximeter-collector = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/6b1b4926-d47f-4b9a-acaf-8d896e9e8d72", status: 204, headers: {"x-request-id": "dea37ae9-597a-4728-8869-b9a2bdfeb2bd", "date": "Mon, 02 Dec 2024 16:55:51 GMT"} }) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
107172024-12-02T16:55:51.261ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 8df106e3-854c-42b1-b488-0558252fd241 producer_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
107182024-12-02T16:55:51.262ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107192024-12-02T16:55:51.262ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107202024-12-02T16:55:51.266ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107212024-12-02T16:55:51.266ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107222024-12-02T16:55:51.272ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 lock = UpdaterLock { updater_id: c727952c-f361-4182-b5ba-48701bb202e5, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-02T16:55:50.996665177Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
107232024-12-02T16:55:51.272ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = CommitInstanceUpdates
107242024-12-02T16:55:51.272ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = CommitInstanceUpdates
107252024-12-02T16:55:51.281ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 new_runtime = InstanceRuntimeState { time_updated: 2024-12-02T16:55:50.996665177Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
107262024-12-02T16:55:51.281ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107272024-12-02T16:55:51.281ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107282024-12-02T16:55:51.281ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
107292024-12-02T16:55:51.281ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
107302024-12-02T16:55:51.281ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
107312024-12-02T16:55:51.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107322024-12-02T16:55:51.281ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107332024-12-02T16:55:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107342024-12-02T16:55:51.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107352024-12-02T16:55:51.283ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107362024-12-02T16:55:51.285ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107372024-12-02T16:55:51.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107382024-12-02T16:55:51.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107392024-12-02T16:55:51.285ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107402024-12-02T16:55:51.285ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107412024-12-02T16:55:51.286ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107422024-12-02T16:55:51.288ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107432024-12-02T16:55:51.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107442024-12-02T16:55:51.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107452024-12-02T16:55:51.289ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107462024-12-02T16:55:51.289ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("6b1b4926-d47f-4b9a-acaf-8d896e9e8d72"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a")}) node_id = 7 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107472024-12-02T16:55:51.293ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107482024-12-02T16:55:51.293ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107492024-12-02T16:55:51.296ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107502024-12-02T16:55:51.296ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107512024-12-02T16:55:51.300ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107522024-12-02T16:55:51.300ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107532024-12-02T16:55:51.303ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 propolis_id = 3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
107542024-12-02T16:55:51.303ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = ReleaseSledResources
107552024-12-02T16:55:51.303ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = ReleaseSledResources
107562024-12-02T16:55:51.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4f2f19eb-ff8e-49bf-88c0-b4680a45cad6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
107572024-12-02T16:55:51.307ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107582024-12-02T16:55:51.307ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107592024-12-02T16:55:51.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4f2f19eb-ff8e-49bf-88c0-b4680a45cad6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
107602024-12-02T16:55:51.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2067 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4f2f19eb-ff8e-49bf-88c0-b4680a45cad6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
107612024-12-02T16:55:51.311ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107622024-12-02T16:55:51.311ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107632024-12-02T16:55:51.317ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 propolis_id = 3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
107642024-12-02T16:55:51.317ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = MarkVmmDeleted
107652024-12-02T16:55:51.317ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = MarkVmmDeleted
107662024-12-02T16:55:51.326ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107672024-12-02T16:55:51.326ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107682024-12-02T16:55:51.330ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107692024-12-02T16:55:51.330ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107702024-12-02T16:55:51.333ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107712024-12-02T16:55:51.333ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107722024-12-02T16:55:51.337ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107732024-12-02T16:55:51.337ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107742024-12-02T16:55:51.340ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = ChainSuccessorSaga
107752024-12-02T16:55:51.341ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = ChainSuccessorSaga
107762024-12-02T16:55:51.342ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = ChainSuccessorSaga
107772024-12-02T16:55:51.342ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = ChainSuccessorSaga
107782024-12-02T16:55:51.343ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = ChainSuccessorSaga
107792024-12-02T16:55:51.344ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = ChainSuccessorSaga
107802024-12-02T16:55:51.345ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = ChainSuccessorSaga
107812024-12-02T16:55:51.345ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107822024-12-02T16:55:51.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107832024-12-02T16:55:51.348ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 07ef2657-6a0a-432e-8c0e-93397c08ce01, lookup_type: ById(07ef2657-6a0a-432e-8c0e-93397c08ce01) }, key: b97157f3-6480-4706-a569-3a2476a14295, lookup_type: ById(b97157f3-6480-4706-a569-3a2476a14295) }, key: 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72, lookup_type: ById(6b1b4926-d47f-4b9a-acaf-8d896e9e8d72) } result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = ChainSuccessorSaga
107842024-12-02T16:55:51.348ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = ChainSuccessorSaga
107852024-12-02T16:55:51.348ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_node = ChainSuccessorSaga
107862024-12-02T16:55:51.351ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 karmic_state = WillReincarnate needs_reincarnation = false saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update
107872024-12-02T16:55:51.351ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107882024-12-02T16:55:51.351ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107892024-12-02T16:55:51.354ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107902024-12-02T16:55:51.354ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107912024-12-02T16:55:51.374ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
107922024-12-02T16:55:51.374ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107932024-12-02T16:55:51.375ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d383db4-2cea-49c7-a7c2-5e8d5a84cc63", "content-length": "372", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
107942024-12-02T16:55:51.375ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107952024-12-02T16:55:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107962024-12-02T16:55:51.378ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
107972024-12-02T16:55:51.378ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
107982024-12-02T16:55:51.380ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107992024-12-02T16:55:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108002024-12-02T16:55:51.382ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
108012024-12-02T16:55:51.382ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f
108022024-12-02T16:55:51.382ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108032024-12-02T16:55:51.384ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108042024-12-02T16:55:51.384ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108052024-12-02T16:55:51.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108062024-12-02T16:55:51.386ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108072024-12-02T16:55:51.388ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108082024-12-02T16:55:51.388ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108092024-12-02T16:55:51.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108102024-12-02T16:55:51.388ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
108112024-12-02T16:55:51.388ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
108122024-12-02T16:55:51.388ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "73f369c6-b589-46fe-be24-121ce86ee828", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
108132024-12-02T16:55:51.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108142024-12-02T16:55:51.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108152024-12-02T16:55:51.389ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
108162024-12-02T16:55:51.389ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f saga_name = instance-update saga_result = SagaResult { saga_id: f8b25b04-2784-45fe-a1da-d6da8533b96f, saga_log: SagaLog { saga_id: f8b25b04-2784-45fe-a1da-d6da8533b96f, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("c727952c-f361-4182-b5ba-48701bb202e5")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("c727952c-f361-4182-b5ba-48701bb202e5")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("6b1b4926-d47f-4b9a-acaf-8d896e9e8d72"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("6b1b4926-d47f-4b9a-acaf-8d896e9e8d72"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("3d6fd9b7-bc37-40fd-9ba5-102d8fb04e5a")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("c727952c-f361-4182-b5ba-48701bb202e5"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("c727952c-f361-4182-b5ba-48701bb202e5")}} }) }
108172024-12-02T16:55:51.389ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = f8b25b04-2784-45fe-a1da-d6da8533b96f instance_id = 6b1b4926-d47f-4b9a-acaf-8d896e9e8d72 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update
108182024-12-02T16:55:51.389ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
108192024-12-02T16:55:51.389ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e
108202024-12-02T16:55:51.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108212024-12-02T16:55:51.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108222024-12-02T16:55:51.393ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
108232024-12-02T16:55:51.393ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e
108242024-12-02T16:55:51.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108252024-12-02T16:55:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108262024-12-02T16:55:51.395ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
108272024-12-02T16:55:51.395ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108282024-12-02T16:55:51.396ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dad8a5f6-04d4-4f30-9882-3c69b678922f", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
108292024-12-02T16:55:51.396ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
108302024-12-02T16:55:51.396ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e
108312024-12-02T16:55:51.397ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 116.253097ms iteration = 27 status = {}
108322024-12-02T16:55:51.400ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
108332024-12-02T16:55:51.400ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e
108342024-12-02T16:55:51.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 041591f5-a0bc-4851-bd28-fe71c76d94f3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
108352024-12-02T16:55:51.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 041591f5-a0bc-4851-bd28-fe71c76d94f3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
108362024-12-02T16:55:51.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = 041591f5-a0bc-4851-bd28-fe71c76d94f3 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
108372024-12-02T16:55:51.433ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update sec_id = 09079b37-9a62-4b04-a7f7-99297d26aab2
108382024-12-02T16:55:51.433ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e saga_name = start-instance-update saga_result = SagaResult { saga_id: 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e, saga_log: SagaLog { saga_id: 4f78da29-f6a5-402e-b9ad-3cf3a9c3a77e, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("3eca1923-5cdc-462d-9e06-a4cbab925f3d")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("3eca1923-5cdc-462d-9e06-a4cbab925f3d")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("3eca1923-5cdc-462d-9e06-a4cbab925f3d"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("3eca1923-5cdc-462d-9e06-a4cbab925f3d")}} }) }
108392024-12-02T16:55:51.471ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
108402024-12-02T16:55:51.472ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6e0031e-9d84-4e23-9f6e-b30bf553375e", "content-length": "691", "date": "Mon, 02 Dec 2024 16:55:50 GMT"} })
108412024-12-02T16:55:51.472ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
108422024-12-02T16:55:51.472ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
108432024-12-02T16:55:51.472ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
108442024-12-02T16:55:51.473ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 192.057439ms iteration = 26 status = {}
108452024-12-02T16:55:52.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a2d6f000-6a0c-45ec-bcf9-95124f0b9f49 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108462024-12-02T16:55:52.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a2d6f000-6a0c-45ec-bcf9-95124f0b9f49 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108472024-12-02T16:55:52.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a2d6f000-6a0c-45ec-bcf9-95124f0b9f49 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108482024-12-02T16:55:52.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = c57c1eda-9fa7-465c-a855-e17fafe9e10b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
108492024-12-02T16:55:52.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = c57c1eda-9fa7-465c-a855-e17fafe9e10b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
108502024-12-02T16:55:52.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = c57c1eda-9fa7-465c-a855-e17fafe9e10b response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
108512024-12-02T16:55:53.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1f9ae460-e2c8-494e-bc3b-4810973739f7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108522024-12-02T16:55:53.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1f9ae460-e2c8-494e-bc3b-4810973739f7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108532024-12-02T16:55:53.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1f9ae460-e2c8-494e-bc3b-4810973739f7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108542024-12-02T16:55:54.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8c2f2b4d-1bf6-4513-8ee9-09c7624278de roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108552024-12-02T16:55:54.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8c2f2b4d-1bf6-4513-8ee9-09c7624278de resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108562024-12-02T16:55:54.379ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8c2f2b4d-1bf6-4513-8ee9-09c7624278de response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108572024-12-02T16:55:55.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = af8dda62-44eb-439a-914a-84210a6543e1 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108582024-12-02T16:55:55.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = af8dda62-44eb-439a-914a-84210a6543e1 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108592024-12-02T16:55:55.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = af8dda62-44eb-439a-914a-84210a6543e1 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108602024-12-02T16:55:56.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1738a88e-5c8c-4fd7-b235-6a58661e4e4b roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108612024-12-02T16:55:56.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1738a88e-5c8c-4fd7-b235-6a58661e4e4b resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108622024-12-02T16:55:56.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1738a88e-5c8c-4fd7-b235-6a58661e4e4b response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108632024-12-02T16:55:56.566ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6387 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 453a5b71-1d48-4911-8106-1cb9492d56d5 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
108642024-12-02T16:55:57.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 581fb96d-1562-42aa-b7fb-3c24989d72b3 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108652024-12-02T16:55:57.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 581fb96d-1562-42aa-b7fb-3c24989d72b3 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108662024-12-02T16:55:57.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 581fb96d-1562-42aa-b7fb-3c24989d72b3 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108672024-12-02T16:55:58.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d9f94f6f-b370-497f-aacf-359085c16a45 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108682024-12-02T16:55:58.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d9f94f6f-b370-497f-aacf-359085c16a45 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108692024-12-02T16:55:58.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d9f94f6f-b370-497f-aacf-359085c16a45 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108702024-12-02T16:55:59.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c6b87291-3b64-45ed-bf01-d850f6de0e5e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108712024-12-02T16:55:59.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c6b87291-3b64-45ed-bf01-d850f6de0e5e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108722024-12-02T16:55:59.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c6b87291-3b64-45ed-bf01-d850f6de0e5e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108732024-12-02T16:55:59.798ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
108742024-12-02T16:55:59.798ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
108752024-12-02T16:55:59.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108762024-12-02T16:55:59.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108772024-12-02T16:55:59.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108782024-12-02T16:55:59.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108792024-12-02T16:55:59.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108802024-12-02T16:55:59.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108812024-12-02T16:55:59.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108822024-12-02T16:55:59.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108832024-12-02T16:55:59.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108842024-12-02T16:55:59.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108852024-12-02T16:55:59.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108862024-12-02T16:55:59.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
108872024-12-02T16:55:59.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108882024-12-02T16:55:59.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108892024-12-02T16:55:59.822ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
108902024-12-02T16:55:59.822ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.721307ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
108912024-12-02T16:55:59.827ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108922024-12-02T16:55:59.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108932024-12-02T16:55:59.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.840337ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108942024-12-02T16:56:00.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 96f4afd3-6785-44b9-bd40-2e94db940320 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108952024-12-02T16:56:00.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 96f4afd3-6785-44b9-bd40-2e94db940320 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108962024-12-02T16:56:00.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 96f4afd3-6785-44b9-bd40-2e94db940320 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108972024-12-02T16:56:01.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0ca2d865-7a33-4018-b6d2-f50704d2ade6 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108982024-12-02T16:56:01.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0ca2d865-7a33-4018-b6d2-f50704d2ade6 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
108992024-12-02T16:56:01.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 0ca2d865-7a33-4018-b6d2-f50704d2ade6 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109002024-12-02T16:56:02.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8b042953-c2da-42fb-be9c-5729eb7bd5c5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109012024-12-02T16:56:02.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8b042953-c2da-42fb-be9c-5729eb7bd5c5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109022024-12-02T16:56:02.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1905 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 8b042953-c2da-42fb-be9c-5729eb7bd5c5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109032024-12-02T16:56:03.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a9755877-6e5d-4ecd-a4c2-e2febcf26067 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109042024-12-02T16:56:03.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a9755877-6e5d-4ecd-a4c2-e2febcf26067 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109052024-12-02T16:56:03.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = a9755877-6e5d-4ecd-a4c2-e2febcf26067 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109062024-12-02T16:56:04.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 953a1162-45b1-4077-b8f0-271143bf6107 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109072024-12-02T16:56:04.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 953a1162-45b1-4077-b8f0-271143bf6107 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109082024-12-02T16:56:04.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 953a1162-45b1-4077-b8f0-271143bf6107 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109092024-12-02T16:56:05.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 20954516-c54a-49f0-bee0-3a7c55e2d223 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109102024-12-02T16:56:05.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 20954516-c54a-49f0-bee0-3a7c55e2d223 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109112024-12-02T16:56:05.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 20954516-c54a-49f0-bee0-3a7c55e2d223 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109122024-12-02T16:56:06.562ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1716 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 2664f0bd-fbe7-4571-aba6-a60c17807c96 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
109132024-12-02T16:56:06.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d705b68b-2690-48ed-89fd-41bde6ebf0bb roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109142024-12-02T16:56:06.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d705b68b-2690-48ed-89fd-41bde6ebf0bb resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109152024-12-02T16:56:06.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d705b68b-2690-48ed-89fd-41bde6ebf0bb response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109162024-12-02T16:56:07.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1c68190b-6e26-48f7-8e4e-3f3452ada321 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109172024-12-02T16:56:07.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1c68190b-6e26-48f7-8e4e-3f3452ada321 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109182024-12-02T16:56:07.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1c68190b-6e26-48f7-8e4e-3f3452ada321 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109192024-12-02T16:56:08.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c3c26fc1-01da-41ef-81af-f151ec7afb88 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109202024-12-02T16:56:08.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c3c26fc1-01da-41ef-81af-f151ec7afb88 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109212024-12-02T16:56:08.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = c3c26fc1-01da-41ef-81af-f151ec7afb88 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109222024-12-02T16:56:09.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 91895c33-dcfb-4967-8d96-69018a2ec820 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109232024-12-02T16:56:09.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 91895c33-dcfb-4967-8d96-69018a2ec820 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109242024-12-02T16:56:09.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 91895c33-dcfb-4967-8d96-69018a2ec820 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109252024-12-02T16:56:09.798ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
109262024-12-02T16:56:09.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109272024-12-02T16:56:09.798ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
109282024-12-02T16:56:09.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109292024-12-02T16:56:09.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109302024-12-02T16:56:09.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109312024-12-02T16:56:09.800ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109322024-12-02T16:56:09.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109332024-12-02T16:56:09.801ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109342024-12-02T16:56:09.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109352024-12-02T16:56:09.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109362024-12-02T16:56:09.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109372024-12-02T16:56:09.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109382024-12-02T16:56:09.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109392024-12-02T16:56:09.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109402024-12-02T16:56:09.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
109412024-12-02T16:56:09.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109422024-12-02T16:56:09.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109432024-12-02T16:56:09.819ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
109442024-12-02T16:56:09.819ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.216435ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
109452024-12-02T16:56:09.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.139852ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109462024-12-02T16:56:10.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 67f1d71e-0b4e-41ee-9307-e430cf51111a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109472024-12-02T16:56:10.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 67f1d71e-0b4e-41ee-9307-e430cf51111a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109482024-12-02T16:56:10.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 67f1d71e-0b4e-41ee-9307-e430cf51111a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109492024-12-02T16:56:11.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1524b447-41d8-4452-a215-fedf1553f42f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109502024-12-02T16:56:11.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1524b447-41d8-4452-a215-fedf1553f42f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109512024-12-02T16:56:11.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1524b447-41d8-4452-a215-fedf1553f42f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109522024-12-02T16:56:12.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 213cacfe-7a01-4c55-89b4-5d7094fa060a roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109532024-12-02T16:56:12.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 213cacfe-7a01-4c55-89b4-5d7094fa060a resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109542024-12-02T16:56:12.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 213cacfe-7a01-4c55-89b4-5d7094fa060a response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109552024-12-02T16:56:13.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4d66a846-e9e1-4dd7-83ef-8657ede5e4d7 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109562024-12-02T16:56:13.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4d66a846-e9e1-4dd7-83ef-8657ede5e4d7 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109572024-12-02T16:56:13.799ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2738 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4d66a846-e9e1-4dd7-83ef-8657ede5e4d7 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109582024-12-02T16:56:14.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d8f0eed7-9e06-4496-a189-f6a2736927bc roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109592024-12-02T16:56:14.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d8f0eed7-9e06-4496-a189-f6a2736927bc resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109602024-12-02T16:56:14.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d8f0eed7-9e06-4496-a189-f6a2736927bc response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109612024-12-02T16:56:15.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 739981fd-6cd0-48a3-8099-f095a2484215 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109622024-12-02T16:56:15.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 739981fd-6cd0-48a3-8099-f095a2484215 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109632024-12-02T16:56:15.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2609 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 739981fd-6cd0-48a3-8099-f095a2484215 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109642024-12-02T16:56:16.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = a3406eaf-2094-4acf-b62d-5b228e669c5a roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
109652024-12-02T16:56:16.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = a3406eaf-2094-4acf-b62d-5b228e669c5a resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
109662024-12-02T16:56:16.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = a3406eaf-2094-4acf-b62d-5b228e669c5a response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?sort_by=id_ascending
109672024-12-02T16:56:16.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = 0ef694be-e98e-4f19-a75d-a5edc6fba24d roles = RoleSet { roles: {} } uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
109682024-12-02T16:56:16.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = 0ef694be-e98e-4f19-a75d-a5edc6fba24d resource = Database result = Ok(()) uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
109692024-12-02T16:56:16.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:55476 req_id = 0ef694be-e98e-4f19-a75d-a5edc6fba24d response_code = 200 uri = /metrics/collectors/8df106e3-854c-42b1-b488-0558252fd241/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMTk5NDE4MC05MWE1LTQ2NjctYWM4Zi1kZTAwYzliMDk0NTgifX0%3D
109702024-12-02T16:56:16.561ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1293 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 44edda58-8df0-40a4-811e-f3b74f1cf4a3 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
109712024-12-02T16:56:16.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6730c053-76d8-4abf-a07a-56f145c862b9 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109722024-12-02T16:56:16.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6730c053-76d8-4abf-a07a-56f145c862b9 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109732024-12-02T16:56:16.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 6730c053-76d8-4abf-a07a-56f145c862b9 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109742024-12-02T16:56:17.772ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:63606
109752024-12-02T16:56:17.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63606 req_id = bb44f203-e7fa-41b4-8ddb-8e670a8adb76 roles = RoleSet { roles: {} } uri = /metrics/producers
109762024-12-02T16:56:17.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63606 req_id = bb44f203-e7fa-41b4-8ddb-8e670a8adb76 resource = Database result = Ok(()) uri = /metrics/producers
109772024-12-02T16:56:17.813ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = d6743efc-3f8c-4f9c-82eb-c8c8561c254a
109782024-12-02T16:56:17.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40776 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63606 req_id = bb44f203-e7fa-41b4-8ddb-8e670a8adb76 response_code = 201 uri = /metrics/producers
109792024-12-02T16:56:17.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fcd3acf5-a218-4c24-a54f-56811cb1c459 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109802024-12-02T16:56:17.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fcd3acf5-a218-4c24-a54f-56811cb1c459 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109812024-12-02T16:56:17.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2558 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fcd3acf5-a218-4c24-a54f-56811cb1c459 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109822024-12-02T16:56:18.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 788851a1-afda-4b57-b1ec-b0075ecec874 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109832024-12-02T16:56:18.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 788851a1-afda-4b57-b1ec-b0075ecec874 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109842024-12-02T16:56:18.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 788851a1-afda-4b57-b1ec-b0075ecec874 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
109852024-12-02T16:56:19.763ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:52157
109862024-12-02T16:56:19.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52157 req_id = a9023ae8-cbbf-41e3-81b8-9528afa42b01 roles = RoleSet { roles: {} } uri = /metrics/producers
109872024-12-02T16:56:19.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52157 req_id = a9023ae8-cbbf-41e3-81b8-9528afa42b01 resource = Database result = Ok(()) uri = /metrics/producers
109882024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
109892024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
109902024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109912024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
109922024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
109932024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
109942024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
109952024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109962024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
109972024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
109982024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109992024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
110002024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
110012024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110022024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110032024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
110042024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
110052024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110062024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
110072024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110082024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
110092024-12-02T16:56:19.798ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
110102024-12-02T16:56:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110112024-12-02T16:56:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110122024-12-02T16:56:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110132024-12-02T16:56:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110142024-12-02T16:56:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110152024-12-02T16:56:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110162024-12-02T16:56:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
110172024-12-02T16:56:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110182024-12-02T16:56:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110192024-12-02T16:56:19.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110202024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
110212024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
110222024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
110232024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110242024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
110252024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
110262024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
110272024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110282024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
110292024-12-02T16:56:19.800ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
110302024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110312024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
110322024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
110332024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
110342024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
110352024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110362024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110372024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110382024-12-02T16:56:19.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110392024-12-02T16:56:19.801ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110402024-12-02T16:56:19.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110412024-12-02T16:56:19.802ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.301979ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
110422024-12-02T16:56:19.802ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110432024-12-02T16:56:19.802ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
110442024-12-02T16:56:19.802ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110452024-12-02T16:56:19.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110462024-12-02T16:56:19.803ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110472024-12-02T16:56:19.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110482024-12-02T16:56:19.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110492024-12-02T16:56:19.803ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = 999318be-e8de-4392-9ed9-30887ef5bc8f
110502024-12-02T16:56:19.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40563 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52157 req_id = a9023ae8-cbbf-41e3-81b8-9528afa42b01 response_code = 201 uri = /metrics/producers
110512024-12-02T16:56:19.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
110522024-12-02T16:56:19.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110532024-12-02T16:56:19.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110542024-12-02T16:56:19.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110552024-12-02T16:56:19.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110562024-12-02T16:56:19.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110572024-12-02T16:56:19.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110582024-12-02T16:56:19.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110592024-12-02T16:56:19.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110602024-12-02T16:56:19.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110612024-12-02T16:56:19.807ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26141, tv_nsec: 538627341 } })
110622024-12-02T16:56:19.807ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
110632024-12-02T16:56:19.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.660067ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
110642024-12-02T16:56:19.807ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26141, tv_nsec: 539312297 } })
110652024-12-02T16:56:19.808ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
110662024-12-02T16:56:19.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110672024-12-02T16:56:19.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
110682024-12-02T16:56:19.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110692024-12-02T16:56:19.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110702024-12-02T16:56:19.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
110712024-12-02T16:56:19.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110722024-12-02T16:56:19.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110732024-12-02T16:56:19.814ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110742024-12-02T16:56:19.814ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
110752024-12-02T16:56:19.814ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110762024-12-02T16:56:19.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110772024-12-02T16:56:19.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110782024-12-02T16:56:19.816ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110792024-12-02T16:56:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110802024-12-02T16:56:19.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110812024-12-02T16:56:19.816ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 26141, tv_nsec: 548285325 } })
110822024-12-02T16:56:19.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110832024-12-02T16:56:19.817ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
110842024-12-02T16:56:19.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110852024-12-02T16:56:19.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110862024-12-02T16:56:19.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110872024-12-02T16:56:19.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110882024-12-02T16:56:19.819ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110892024-12-02T16:56:19.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110902024-12-02T16:56:19.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
110912024-12-02T16:56:19.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110922024-12-02T16:56:19.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110932024-12-02T16:56:19.835ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
110942024-12-02T16:56:19.835ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.61288ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
110952024-12-02T16:56:19.840ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 40.860297ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
110962024-12-02T16:56:19.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110972024-12-02T16:56:19.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110982024-12-02T16:56:19.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110992024-12-02T16:56:19.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 46.120994ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
111002024-12-02T16:56:19.845ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111012024-12-02T16:56:19.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111022024-12-02T16:56:19.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111032024-12-02T16:56:19.846ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111042024-12-02T16:56:19.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.992789ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111052024-12-02T16:56:19.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111062024-12-02T16:56:19.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111072024-12-02T16:56:19.848ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111082024-12-02T16:56:19.848ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111092024-12-02T16:56:19.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111102024-12-02T16:56:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111112024-12-02T16:56:19.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111122024-12-02T16:56:19.849ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111132024-12-02T16:56:19.849ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
111142024-12-02T16:56:19.849ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 50.431441ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
111152024-12-02T16:56:19.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111162024-12-02T16:56:19.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111172024-12-02T16:56:19.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
111182024-12-02T16:56:19.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
111192024-12-02T16:56:19.864ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
111202024-12-02T16:56:19.864ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.2424ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
111212024-12-02T16:56:19.864ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 65.518473ms iteration = 30 status = {"physical_disks_added":0}
111222024-12-02T16:56:19.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111232024-12-02T16:56:19.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 84.255337ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
111242024-12-02T16:56:19.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf, lookup_type: ById(c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf) } result = Ok(())
111252024-12-02T16:56:19.885ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111262024-12-02T16:56:19.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111272024-12-02T16:56:19.886ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111282024-12-02T16:56:19.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111292024-12-02T16:56:19.887ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.474885ms iteration = 26 status = 0
111302024-12-02T16:56:19.895ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
111312024-12-02T16:56:19.895ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111322024-12-02T16:56:19.896ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e0f004d-0f2c-4495-99fd-7ed725cea54c", "content-length": "26", "date": "Mon, 02 Dec 2024 16:56:19 GMT"} })
111332024-12-02T16:56:19.896ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111342024-12-02T16:56:19.898ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111352024-12-02T16:56:19.898ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
111362024-12-02T16:56:19.898ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111372024-12-02T16:56:19.899ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0af2fd83-4e27-42ea-a3ce-6d99d3a040b3", "content-length": "26", "date": "Mon, 02 Dec 2024 16:56:19 GMT"} })
111382024-12-02T16:56:19.899ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111392024-12-02T16:56:19.900ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111402024-12-02T16:56:19.909ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f zone_address = fd00:1122:3344:101::2
111412024-12-02T16:56:19.909ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111422024-12-02T16:56:19.909ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5900e3e7-7d18-46d8-99a7-fa138998bd11", "content-length": "26", "date": "Mon, 02 Dec 2024 16:56:19 GMT"} })
111432024-12-02T16:56:19.909ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111442024-12-02T16:56:19.911ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
111452024-12-02T16:56:19.912ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111462024-12-02T16:56:19.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111472024-12-02T16:56:19.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 115.438429ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
111482024-12-02T16:56:19.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4ffd5bb3-4071-42c7-abd0-6528e44503cd roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
111492024-12-02T16:56:19.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4ffd5bb3-4071-42c7-abd0-6528e44503cd resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
111502024-12-02T16:56:19.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4ffd5bb3-4071-42c7-abd0-6528e44503cd response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
111512024-12-02T16:56:19.993ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 194.575281ms iteration = 26 status = {}
111522024-12-02T16:56:20.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111532024-12-02T16:56:20.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111542024-12-02T16:56:20.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111552024-12-02T16:56:20.011ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
111562024-12-02T16:56:20.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111572024-12-02T16:56:20.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111582024-12-02T16:56:20.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111592024-12-02T16:56:20.014ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
111602024-12-02T16:56:20.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111612024-12-02T16:56:20.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111622024-12-02T16:56:20.081ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
111632024-12-02T16:56:20.082ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b984970-a34c-4e35-91a9-e39fc11e6cbb", "content-length": "2", "date": "Mon, 02 Dec 2024 16:56:19 GMT"} })
111642024-12-02T16:56:20.084ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
111652024-12-02T16:56:20.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
111662024-12-02T16:56:20.085ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
111672024-12-02T16:56:20.085ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
111682024-12-02T16:56:20.085ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e83b4cc-c757-42ae-ab0f-605959acfcb6", "content-length": "372", "date": "Mon, 02 Dec 2024 16:56:19 GMT"} })
111692024-12-02T16:56:20.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111702024-12-02T16:56:20.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111712024-12-02T16:56:20.087ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 288.883975ms iteration = 26 status = null
111722024-12-02T16:56:20.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111732024-12-02T16:56:20.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111742024-12-02T16:56:20.123ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: f20fd957-050e-42b9-9588-ca3e72455b0c, rack_id: 8028b602-7c16-4586-9ea7-3a3600d5d09f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(47293cf6-b7fb-46b9-9b35-99462eca8d04) } rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
111752024-12-02T16:56:20.123ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111762024-12-02T16:56:20.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111772024-12-02T16:56:20.125ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
111782024-12-02T16:56:20.125ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c29632fe-a4d8-443a-9da2-ad94275e499f", "content-length": "691", "date": "Mon, 02 Dec 2024 16:56:19 GMT"} })
111792024-12-02T16:56:20.125ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
111802024-12-02T16:56:20.125ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
111812024-12-02T16:56:20.125ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
111822024-12-02T16:56:20.127ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 328.118998ms iteration = 27 status = {}
111832024-12-02T16:56:20.127ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
111842024-12-02T16:56:20.127ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
111852024-12-02T16:56:20.127ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fdacf8a6-1fc3-4b8e-8a98-c5be85a0f5b3", "date": "Mon, 02 Dec 2024 16:56:19 GMT"} })
111862024-12-02T16:56:20.127ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111872024-12-02T16:56:20.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111882024-12-02T16:56:20.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111892024-12-02T16:56:20.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111902024-12-02T16:56:20.132ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
111912024-12-02T16:56:20.133ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3319f56e-d16e-4eb0-9a71-f358c0723f15", "content-length": "134", "date": "Mon, 02 Dec 2024 16:56:19 GMT"} })
111922024-12-02T16:56:20.133ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
111932024-12-02T16:56:20.133ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 47293cf6-b7fb-46b9-9b35-99462eca8d04
111942024-12-02T16:56:20.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111952024-12-02T16:56:20.133ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
111962024-12-02T16:56:20.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111972024-12-02T16:56:20.133ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
111982024-12-02T16:56:20.133ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
111992024-12-02T16:56:20.133ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112002024-12-02T16:56:20.133ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112012024-12-02T16:56:20.133ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112022024-12-02T16:56:20.133ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112032024-12-02T16:56:20.133ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112042024-12-02T16:56:20.134ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f
112052024-12-02T16:56:20.134ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112062024-12-02T16:56:20.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112072024-12-02T16:56:20.136ZINFOnexus (BackgroundTasks): VPC route manager sled c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
112082024-12-02T16:56:20.136ZDEBGnexus (BackgroundTasks): client request SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112092024-12-02T16:56:20.136ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
112102024-12-02T16:56:20.136ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5bb78f3-b220-4c9c-abd3-976143e9a369", "content-length": "2", "date": "Mon, 02 Dec 2024 16:56:19 GMT"} })
112112024-12-02T16:56:20.136ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
112122024-12-02T16:56:20.136ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "da4bae38-f3c1-4599-af5b-9205bd302d53", "content-length": "52", "date": "Mon, 02 Dec 2024 16:56:19 GMT"} })
112132024-12-02T16:56:20.136ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch_location = Switch0
112142024-12-02T16:56:20.136ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
112152024-12-02T16:56:20.136ZDEBGnexus (BackgroundTasks): client response SledAgent = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "710f4220-625f-47a2-9a98-557c49dbcae0", "date": "Mon, 02 Dec 2024 16:56:19 GMT"} })
112162024-12-02T16:56:20.137ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 337.857433ms iteration = 28 status = {}
112172024-12-02T16:56:20.227ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cadf7054-aa41-4b73-9e7a-6de75527d5b4", "date": "Mon, 02 Dec 2024 16:56:19 GMT"} })
112182024-12-02T16:56:20.227ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f switch = Switch0
112192024-12-02T16:56:20.227ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
112202024-12-02T16:56:20.228ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 8028b602-7c16-4586-9ea7-3a3600d5d09f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "478af348-9be3-4782-982d-4008492a5921", "content-length": "682", "date": "Mon, 02 Dec 2024 16:56:19 GMT"} })
112212024-12-02T16:56:20.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112222024-12-02T16:56:20.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112232024-12-02T16:56:20.232ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112242024-12-02T16:56:20.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112252024-12-02T16:56:20.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112262024-12-02T16:56:20.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112272024-12-02T16:56:20.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112282024-12-02T16:56:20.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112292024-12-02T16:56:20.244ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 445.985258ms iteration = 26 status = {}
112302024-12-02T16:56:20.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 13918b65-dd90-46fc-8b88-e3baab83e889 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112312024-12-02T16:56:20.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 13918b65-dd90-46fc-8b88-e3baab83e889 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112322024-12-02T16:56:20.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2680 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 13918b65-dd90-46fc-8b88-e3baab83e889 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112332024-12-02T16:56:21.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1f027245-6d56-4018-944a-83b7effadde0 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112342024-12-02T16:56:21.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1f027245-6d56-4018-944a-83b7effadde0 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112352024-12-02T16:56:21.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 1f027245-6d56-4018-944a-83b7effadde0 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112362024-12-02T16:56:22.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = e07960f5-cb1b-4838-a97a-0e9acc833622 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
112372024-12-02T16:56:22.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = e07960f5-cb1b-4838-a97a-0e9acc833622 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
112382024-12-02T16:56:22.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45987 req_id = e07960f5-cb1b-4838-a97a-0e9acc833622 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
112392024-12-02T16:56:22.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3f42312b-1445-4315-ac1b-6553a2789d82 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112402024-12-02T16:56:22.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3f42312b-1445-4315-ac1b-6553a2789d82 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112412024-12-02T16:56:22.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3f42312b-1445-4315-ac1b-6553a2789d82 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112422024-12-02T16:56:24.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 40691eb6-17b1-4be0-874f-4c08238a4775 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112432024-12-02T16:56:24.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 40691eb6-17b1-4be0-874f-4c08238a4775 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112442024-12-02T16:56:24.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 40691eb6-17b1-4be0-874f-4c08238a4775 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112452024-12-02T16:56:25.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d5164a32-867c-4f18-9a61-8dd8fbf7b8fa roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112462024-12-02T16:56:25.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d5164a32-867c-4f18-9a61-8dd8fbf7b8fa resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112472024-12-02T16:56:25.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d5164a32-867c-4f18-9a61-8dd8fbf7b8fa response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112482024-12-02T16:56:25.490ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:36273
112492024-12-02T16:56:25.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 67357436-957c-4469-b3d4-4779464fd190 roles = RoleSet { roles: {} } uri = /metrics/producers
112502024-12-02T16:56:25.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 67357436-957c-4469-b3d4-4779464fd190 resource = Database result = Ok(()) uri = /metrics/producers
112512024-12-02T16:56:25.538ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = c94a6654-1297-4865-84af-bb83693635c3
112522024-12-02T16:56:25.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48283 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36273 req_id = 67357436-957c-4469-b3d4-4779464fd190 response_code = 201 uri = /metrics/producers
112532024-12-02T16:56:26.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3d9aadb3-785f-4706-b3bc-0bc3eca1731f roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112542024-12-02T16:56:26.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3d9aadb3-785f-4706-b3bc-0bc3eca1731f resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112552024-12-02T16:56:26.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 3d9aadb3-785f-4706-b3bc-0bc3eca1731f response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112562024-12-02T16:56:26.562ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1384 local_addr = [fd00:1122:3344:101::b]:33416 method = GET remote_addr = [fd00:1122:3344:101::d]:38833 req_id = 1f2afcb2-af9b-4665-bede-bdca3f594e04 response_code = 200 uri = /09079b37-9a62-4b04-a7f7-99297d26aab2
112572024-12-02T16:56:27.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d5e5d7c6-3443-4b53-8c94-f41abf7cb81e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112582024-12-02T16:56:27.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d5e5d7c6-3443-4b53-8c94-f41abf7cb81e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112592024-12-02T16:56:27.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d5e5d7c6-3443-4b53-8c94-f41abf7cb81e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112602024-12-02T16:56:28.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fdefc688-7d81-44d5-b663-008c37dac18e roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112612024-12-02T16:56:28.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fdefc688-7d81-44d5-b663-008c37dac18e resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112622024-12-02T16:56:28.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = fdefc688-7d81-44d5-b663-008c37dac18e response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112632024-12-02T16:56:29.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7b490811-5347-4373-93b7-f12ca0949eaf roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112642024-12-02T16:56:29.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7b490811-5347-4373-93b7-f12ca0949eaf resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112652024-12-02T16:56:29.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 7b490811-5347-4373-93b7-f12ca0949eaf response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112662024-12-02T16:56:29.799ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
112672024-12-02T16:56:29.799ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
112682024-12-02T16:56:29.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112692024-12-02T16:56:29.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112702024-12-02T16:56:29.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112712024-12-02T16:56:29.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112722024-12-02T16:56:29.802ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112732024-12-02T16:56:29.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112742024-12-02T16:56:29.804ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112752024-12-02T16:56:29.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112762024-12-02T16:56:29.806ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112772024-12-02T16:56:29.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112782024-12-02T16:56:29.808ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112792024-12-02T16:56:29.811ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c575ce6d-3e43-4b59-886a-60182869b755, lookup_type: ById(c575ce6d-3e43-4b59-886a-60182869b755) } result = Ok(())
112802024-12-02T16:56:29.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112812024-12-02T16:56:29.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112822024-12-02T16:56:29.823ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c575ce6d-3e43-4b59-886a-60182869b755 original_time_created = 2024-12-02 16:43:40.663693 UTC target_id = c575ce6d-3e43-4b59-886a-60182869b755 time_created = 2024-12-02 16:43:40.663693 UTC
112832024-12-02T16:56:29.823ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.141711ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c575ce6d-3e43-4b59-886a-60182869b755","time_created":"2024-12-02T16:43:40.663693Z"}
112842024-12-02T16:56:29.830ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112852024-12-02T16:56:29.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112862024-12-02T16:56:29.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.778255ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112872024-12-02T16:56:30.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ba78abfd-7502-4d37-b82f-2fb176d740ed roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112882024-12-02T16:56:30.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ba78abfd-7502-4d37-b82f-2fb176d740ed resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112892024-12-02T16:56:30.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = ba78abfd-7502-4d37-b82f-2fb176d740ed response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112902024-12-02T16:56:31.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4a25aa2b-2a12-4fae-93f0-c890cb5b2853 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112912024-12-02T16:56:31.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4a25aa2b-2a12-4fae-93f0-c890cb5b2853 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112922024-12-02T16:56:31.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 4a25aa2b-2a12-4fae-93f0-c890cb5b2853 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112932024-12-02T16:56:32.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 399fbbc3-204c-4ddc-a4bc-acff69a83220 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112942024-12-02T16:56:32.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 399fbbc3-204c-4ddc-a4bc-acff69a83220 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112952024-12-02T16:56:32.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = 399fbbc3-204c-4ddc-a4bc-acff69a83220 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
112962024-12-02T16:56:32.978ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:33256
112972024-12-02T16:56:32.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33256 req_id = 4a2332f9-d0e3-4e20-a425-60764886626a roles = RoleSet { roles: {} } uri = /metrics/producers
112982024-12-02T16:56:32.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33256 req_id = 4a2332f9-d0e3-4e20-a425-60764886626a resource = Database result = Ok(()) uri = /metrics/producers
112992024-12-02T16:56:33.024ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
113002024-12-02T16:56:33.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46400 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33256 req_id = 4a2332f9-d0e3-4e20-a425-60764886626a response_code = 201 uri = /metrics/producers
113012024-12-02T16:56:33.153ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35812
113022024-12-02T16:56:33.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35812 req_id = 1fbbd291-6f63-45b4-90a2-94673c515d17 roles = RoleSet { roles: {} } uri = /metrics/producers
113032024-12-02T16:56:33.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35812 req_id = 1fbbd291-6f63-45b4-90a2-94673c515d17 resource = Database result = Ok(()) uri = /metrics/producers
113042024-12-02T16:56:33.165ZINFOnexus: assigned collector to new producer collector_id = 8df106e3-854c-42b1-b488-0558252fd241 file = nexus/src/app/oximeter.rs:76 producer_id = f1994180-91a5-4667-ac8f-de00c9b09458
113052024-12-02T16:56:33.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11875 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35812 req_id = 1fbbd291-6f63-45b4-90a2-94673c515d17 response_code = 201 uri = /metrics/producers
113062024-12-02T16:56:33.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d1ea0b45-882d-41eb-89d1-f88ad47fefb5 roles = RoleSet { roles: {} } uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
113072024-12-02T16:56:33.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d1ea0b45-882d-41eb-89d1-f88ad47fefb5 resource = Database result = Ok(()) uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf
113082024-12-02T16:56:33.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1892 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:56748 req_id = d1ea0b45-882d-41eb-89d1-f88ad47fefb5 response_code = 200 uri = /probes/c7a2c151-18c9-47fb-a7c3-c0e2388e5cbf