Max level shown:
12024-12-19T01:00:02.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3f031e3d-3433-4af7-b083-1e07fd279bdc roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
22024-12-19T01:00:02.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3f031e3d-3433-4af7-b083-1e07fd279bdc resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
32024-12-19T01:00:02.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3f031e3d-3433-4af7-b083-1e07fd279bdc response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
42024-12-19T01:00:03.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6cc8f3de-f36a-456c-8221-40920f85a026 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52024-12-19T01:00:03.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6cc8f3de-f36a-456c-8221-40920f85a026 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62024-12-19T01:00:03.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6cc8f3de-f36a-456c-8221-40920f85a026 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
72024-12-19T01:00:04.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e002c504-8919-48b7-a900-3ebcdf4d16eb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82024-12-19T01:00:04.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e002c504-8919-48b7-a900-3ebcdf4d16eb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92024-12-19T01:00:04.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1735 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e002c504-8919-48b7-a900-3ebcdf4d16eb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
102024-12-19T01:00:05.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6fe2d0cf-6d4b-491e-a2cd-6c980d218c04 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
112024-12-19T01:00:05.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6fe2d0cf-6d4b-491e-a2cd-6c980d218c04 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
122024-12-19T01:00:05.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6fe2d0cf-6d4b-491e-a2cd-6c980d218c04 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
132024-12-19T01:00:05.768ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1306 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 76d3106a-e958-4dbe-8515-78d0702159ea response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
142024-12-19T01:00:06.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ad7b69fd-ea0e-4ade-b81f-3fc700d4883b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
152024-12-19T01:00:06.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ad7b69fd-ea0e-4ade-b81f-3fc700d4883b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
162024-12-19T01:00:06.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2720 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ad7b69fd-ea0e-4ade-b81f-3fc700d4883b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
172024-12-19T01:00:07.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8df6a743-93ca-4489-bf7e-6e78e038fa62 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
182024-12-19T01:00:07.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8df6a743-93ca-4489-bf7e-6e78e038fa62 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
192024-12-19T01:00:07.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8df6a743-93ca-4489-bf7e-6e78e038fa62 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
202024-12-19T01:00:08.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f7963040-4638-4c4e-b25c-29d2acc7eb33 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
212024-12-19T01:00:08.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f7963040-4638-4c4e-b25c-29d2acc7eb33 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
222024-12-19T01:00:08.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f7963040-4638-4c4e-b25c-29d2acc7eb33 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
232024-12-19T01:00:09.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 983e6221-aec6-4f98-95f4-955a52627bdc roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
242024-12-19T01:00:09.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 983e6221-aec6-4f98-95f4-955a52627bdc resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
252024-12-19T01:00:09.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 983e6221-aec6-4f98-95f4-955a52627bdc response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
262024-12-19T01:00:10.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2d0c9950-4126-44dc-b757-99434c9444da roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
272024-12-19T01:00:10.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2d0c9950-4126-44dc-b757-99434c9444da resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
282024-12-19T01:00:10.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2d0c9950-4126-44dc-b757-99434c9444da response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
292024-12-19T01:00:11.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a3d8a5dc-26e8-4d21-b947-c097729bf178 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
302024-12-19T01:00:11.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a3d8a5dc-26e8-4d21-b947-c097729bf178 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
312024-12-19T01:00:11.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a3d8a5dc-26e8-4d21-b947-c097729bf178 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
322024-12-19T01:00:11.371ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
332024-12-19T01:00:11.371ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
342024-12-19T01:00:11.371ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
352024-12-19T01:00:11.371ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
362024-12-19T01:00:11.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
372024-12-19T01:00:11.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
382024-12-19T01:00:11.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
392024-12-19T01:00:11.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
402024-12-19T01:00:11.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
412024-12-19T01:00:11.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
422024-12-19T01:00:11.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
432024-12-19T01:00:11.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
442024-12-19T01:00:11.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
452024-12-19T01:00:11.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
462024-12-19T01:00:11.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
472024-12-19T01:00:11.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
482024-12-19T01:00:11.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
492024-12-19T01:00:11.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
502024-12-19T01:00:11.393ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
512024-12-19T01:00:11.393ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.976278ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
522024-12-19T01:00:11.402ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.091633ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
532024-12-19T01:00:12.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ccf595d0-2906-4c1f-a955-0cd737369170 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
542024-12-19T01:00:12.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ccf595d0-2906-4c1f-a955-0cd737369170 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
552024-12-19T01:00:12.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ccf595d0-2906-4c1f-a955-0cd737369170 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
562024-12-19T01:00:13.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8dc6a099-01fb-459c-adfb-1dc8e42bdcf3 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
572024-12-19T01:00:13.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8dc6a099-01fb-459c-adfb-1dc8e42bdcf3 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
582024-12-19T01:00:13.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8dc6a099-01fb-459c-adfb-1dc8e42bdcf3 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
592024-12-19T01:00:14.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4dc2b860-e263-482f-8eda-06c66c0a1b98 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
602024-12-19T01:00:14.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4dc2b860-e263-482f-8eda-06c66c0a1b98 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
612024-12-19T01:00:14.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4dc2b860-e263-482f-8eda-06c66c0a1b98 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
622024-12-19T01:00:15.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4751b30c-9f9e-43fa-87df-01a8a778478c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
632024-12-19T01:00:15.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4751b30c-9f9e-43fa-87df-01a8a778478c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
642024-12-19T01:00:15.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4751b30c-9f9e-43fa-87df-01a8a778478c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
652024-12-19T01:00:15.769ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1465 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = b1de0072-82f3-471e-af35-1027e7ecc94b response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
662024-12-19T01:00:16.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dba0a86e-ac6f-44e1-9039-b64b7ba98173 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
672024-12-19T01:00:16.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dba0a86e-ac6f-44e1-9039-b64b7ba98173 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
682024-12-19T01:00:16.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dba0a86e-ac6f-44e1-9039-b64b7ba98173 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
692024-12-19T01:00:17.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 20a62f52-87cb-4319-8feb-85416b1bb7c0 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
702024-12-19T01:00:17.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 20a62f52-87cb-4319-8feb-85416b1bb7c0 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
712024-12-19T01:00:17.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 20a62f52-87cb-4319-8feb-85416b1bb7c0 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
722024-12-19T01:00:18.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 43afacb1-6aa1-45d2-9715-1a30c92e869f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
732024-12-19T01:00:18.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 43afacb1-6aa1-45d2-9715-1a30c92e869f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
742024-12-19T01:00:18.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 43afacb1-6aa1-45d2-9715-1a30c92e869f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
752024-12-19T01:00:19.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ea300cc6-d012-4e96-9d23-c97b9caace2c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
762024-12-19T01:00:19.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ea300cc6-d012-4e96-9d23-c97b9caace2c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
772024-12-19T01:00:19.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ea300cc6-d012-4e96-9d23-c97b9caace2c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
782024-12-19T01:00:20.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0f63e40b-6757-45d4-843c-48cc83898e35 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
792024-12-19T01:00:20.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0f63e40b-6757-45d4-843c-48cc83898e35 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
802024-12-19T01:00:20.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0f63e40b-6757-45d4-843c-48cc83898e35 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
812024-12-19T01:00:20.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46978 req_id = f21743eb-fa57-4375-af8a-6cfa7c6c2189 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
822024-12-19T01:00:20.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46978 req_id = f21743eb-fa57-4375-af8a-6cfa7c6c2189 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
832024-12-19T01:00:20.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46978 req_id = f21743eb-fa57-4375-af8a-6cfa7c6c2189 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
842024-12-19T01:00:20.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46978 req_id = db636a62-3425-4aab-9bba-af12da1dde69 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
852024-12-19T01:00:20.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46978 req_id = db636a62-3425-4aab-9bba-af12da1dde69 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
862024-12-19T01:00:20.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46978 req_id = db636a62-3425-4aab-9bba-af12da1dde69 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
872024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
882024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
892024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
902024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
912024-12-19T01:00:21.371ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a
922024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
932024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.79\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a"}
942024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
952024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
962024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
972024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
982024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
992024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
1002024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1012024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1022024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
1032024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1042024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
1052024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1062024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
1072024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1082024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
1092024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1102024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
1112024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
1122024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1132024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1142024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
1152024-12-19T01:00:21.371ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1162024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
1172024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
1182024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1192024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1202024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
1212024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
1222024-12-19T01:00:21.371ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1232024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
1242024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1252024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1262024-12-19T01:00:21.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1272024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
1282024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
1292024-12-19T01:00:21.372ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 00:50:21.371906080 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1302024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
1312024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1322024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
1332024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1342024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
1352024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1362024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
1372024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1382024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
1392024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
1402024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1412024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
1422024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1432024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
1442024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1452024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
1462024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1472024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
1482024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1492024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1502024-12-19T01:00:21.372ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a880a2e-2471-4fd8-9ad5-3e0c3fbde317.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 910, tv_nsec: 217925722 } })
1512024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1522024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1532024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1542024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1552024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1562024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1572024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1582024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1592024-12-19T01:00:21.372ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0018a454-75c0-41b1-be69-9476391f01e1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("050cdbd7-4ebc-471c-b4dc-ec1b3741f763.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 910, tv_nsec: 218135515 } })
1602024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1612024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1622024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1632024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1642024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1652024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1662024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1672024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1682024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1692024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1702024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1712024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1722024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1732024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1742024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1752024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
1762024-12-19T01:00:21.372ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.084125ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
1772024-12-19T01:00:21.373ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
1782024-12-19T01:00:21.373ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.208006ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
1792024-12-19T01:00:21.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1802024-12-19T01:00:21.375ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.614399ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
1812024-12-19T01:00:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1822024-12-19T01:00:21.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1832024-12-19T01:00:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.343099ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1842024-12-19T01:00:21.377ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1852024-12-19T01:00:21.378ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1862024-12-19T01:00:21.378ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1872024-12-19T01:00:21.378ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1882024-12-19T01:00:21.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1892024-12-19T01:00:21.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1902024-12-19T01:00:21.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1912024-12-19T01:00:21.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1922024-12-19T01:00:21.380ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1932024-12-19T01:00:21.380ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1942024-12-19T01:00:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1952024-12-19T01:00:21.382ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1962024-12-19T01:00:21.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1972024-12-19T01:00:21.382ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1982024-12-19T01:00:21.382ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.990729ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
1992024-12-19T01:00:21.383ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2002024-12-19T01:00:21.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2012024-12-19T01:00:21.383ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 00:50:21.371906080 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2022024-12-19T01:00:21.383ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.004783ms iteration = 3 status = {"expiration":"2024-12-19T00:50:21.371906080Z","pruned":[]}
2032024-12-19T01:00:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2042024-12-19T01:00:21.385ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2052024-12-19T01:00:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2062024-12-19T01:00:21.389ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2072024-12-19T01:00:21.390ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 18.44577ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
2082024-12-19T01:00:21.391ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2092024-12-19T01:00:21.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2102024-12-19T01:00:21.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2112024-12-19T01:00:21.392ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 910, tv_nsec: 238242768 } })
2122024-12-19T01:00:21.392ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
2132024-12-19T01:00:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2142024-12-19T01:00:21.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2152024-12-19T01:00:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2162024-12-19T01:00:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2172024-12-19T01:00:21.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2182024-12-19T01:00:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2192024-12-19T01:00:21.398ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 910, tv_nsec: 243809783 } })
2202024-12-19T01:00:21.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2212024-12-19T01:00:21.398ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
2222024-12-19T01:00:21.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
2232024-12-19T01:00:21.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2242024-12-19T01:00:21.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2252024-12-19T01:00:21.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2262024-12-19T01:00:21.402ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2272024-12-19T01:00:21.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2282024-12-19T01:00:21.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2292024-12-19T01:00:21.414ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2302024-12-19T01:00:21.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2312024-12-19T01:00:21.419ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2322024-12-19T01:00:21.419ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2332024-12-19T01:00:21.419ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2342024-12-19T01:00:21.419ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2352024-12-19T01:00:21.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2362024-12-19T01:00:21.419ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2372024-12-19T01:00:21.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2382024-12-19T01:00:21.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2392024-12-19T01:00:21.420ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 910, tv_nsec: 266615383 } })
2402024-12-19T01:00:21.421ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2412024-12-19T01:00:21.421ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
2422024-12-19T01:00:21.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2432024-12-19T01:00:21.421ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2442024-12-19T01:00:21.421ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2452024-12-19T01:00:21.421ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2462024-12-19T01:00:21.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2472024-12-19T01:00:21.421ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2482024-12-19T01:00:21.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2492024-12-19T01:00:21.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2502024-12-19T01:00:21.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
2512024-12-19T01:00:21.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2522024-12-19T01:00:21.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2532024-12-19T01:00:21.424ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2542024-12-19T01:00:21.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2552024-12-19T01:00:21.427ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2562024-12-19T01:00:21.428ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2572024-12-19T01:00:21.428ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2582024-12-19T01:00:21.428ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.769141ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2592024-12-19T01:00:21.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2602024-12-19T01:00:21.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2612024-12-19T01:00:21.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2622024-12-19T01:00:21.432ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2632024-12-19T01:00:21.433ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2642024-12-19T01:00:21.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2652024-12-19T01:00:21.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2662024-12-19T01:00:21.436ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2672024-12-19T01:00:21.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2682024-12-19T01:00:21.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2692024-12-19T01:00:21.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2702024-12-19T01:00:21.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2712024-12-19T01:00:21.443ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 71.882826ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
2722024-12-19T01:00:21.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2732024-12-19T01:00:21.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2742024-12-19T01:00:21.450ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2752024-12-19T01:00:21.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2762024-12-19T01:00:21.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2772024-12-19T01:00:21.456ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2782024-12-19T01:00:21.456ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
2792024-12-19T01:00:21.456ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.331848ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
2802024-12-19T01:00:21.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2812024-12-19T01:00:21.462ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2822024-12-19T01:00:21.464ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2832024-12-19T01:00:21.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2842024-12-19T01:00:21.465ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2852024-12-19T01:00:21.465ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2862024-12-19T01:00:21.465ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2872024-12-19T01:00:21.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2882024-12-19T01:00:21.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2892024-12-19T01:00:21.466ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2902024-12-19T01:00:21.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2912024-12-19T01:00:21.469ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
2922024-12-19T01:00:21.471ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 99.843936ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2932024-12-19T01:00:21.477ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2942024-12-19T01:00:21.477ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2952024-12-19T01:00:21.477ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 105.919999ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2962024-12-19T01:00:21.477ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2972024-12-19T01:00:21.478ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2982024-12-19T01:00:21.478ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.165921ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2992024-12-19T01:00:21.478ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3002024-12-19T01:00:21.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3012024-12-19T01:00:21.480ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3022024-12-19T01:00:21.480ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.636545ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3032024-12-19T01:00:21.481ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3042024-12-19T01:00:21.481ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3052024-12-19T01:00:21.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3062024-12-19T01:00:21.481ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3072024-12-19T01:00:21.483ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3082024-12-19T01:00:21.483ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3092024-12-19T01:00:21.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3102024-12-19T01:00:21.485ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3112024-12-19T01:00:21.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3122024-12-19T01:00:21.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3132024-12-19T01:00:21.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3142024-12-19T01:00:21.488ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3152024-12-19T01:00:21.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3162024-12-19T01:00:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3172024-12-19T01:00:21.489ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3182024-12-19T01:00:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3192024-12-19T01:00:21.491ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3202024-12-19T01:00:21.491ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3212024-12-19T01:00:21.491ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 0 version = 2
3222024-12-19T01:00:21.491ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3232024-12-19T01:00:21.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3242024-12-19T01:00:21.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
3252024-12-19T01:00:21.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3262024-12-19T01:00:21.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
3272024-12-19T01:00:21.493ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
3282024-12-19T01:00:21.495ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3292024-12-19T01:00:21.495ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3302024-12-19T01:00:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3312024-12-19T01:00:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3322024-12-19T01:00:21.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3332024-12-19T01:00:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3342024-12-19T01:00:21.496ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3352024-12-19T01:00:21.496ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3362024-12-19T01:00:21.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3372024-12-19T01:00:21.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3382024-12-19T01:00:21.499ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3392024-12-19T01:00:21.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3402024-12-19T01:00:21.503ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3412024-12-19T01:00:21.503ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 131.07195ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3422024-12-19T01:00:21.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3432024-12-19T01:00:21.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ccfcbb5b-b6f8-4132-8182-8f303d0655fc roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
3442024-12-19T01:00:21.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ccfcbb5b-b6f8-4132-8182-8f303d0655fc resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
3452024-12-19T01:00:21.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ccfcbb5b-b6f8-4132-8182-8f303d0655fc response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
3462024-12-19T01:00:21.520ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3472024-12-19T01:00:21.520ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3482024-12-19T01:00:21.520ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.077184ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3492024-12-19T01:00:21.525ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 1 version = 2
3502024-12-19T01:00:21.525ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3512024-12-19T01:00:21.525ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 00:59:02.707744 UTC dns_group = external generation = 2
3522024-12-19T01:00:21.525ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 153.341732ms iteration = 4 status = {"generation":2}
3532024-12-19T01:00:21.526ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3542024-12-19T01:00:21.526ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3552024-12-19T01:00:21.526ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 00:59:01.994004 UTC dns_group = internal generation = 1
3562024-12-19T01:00:21.526ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 154.632169ms iteration = 4 status = {"generation":1}
3572024-12-19T01:00:21.527ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3582024-12-19T01:00:21.527ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3592024-12-19T01:00:21.527ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "603d50ba-dc8a-484f-9ee0-ec606fb78953", "content-length": "26", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} })
3602024-12-19T01:00:21.527ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3612024-12-19T01:00:21.529ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3622024-12-19T01:00:21.539ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.85715ms iteration = 8 status = {"physical_disks_added":0}
3632024-12-19T01:00:21.548ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T00:58:19.687181Z, time_modified: 2024-12-19T00:58:19.687181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
3642024-12-19T01:00:21.548ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 177.087124ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]}},"default_endpoint":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
3652024-12-19T01:00:21.566ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3662024-12-19T01:00:21.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3672024-12-19T01:00:21.570ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3682024-12-19T01:00:21.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3692024-12-19T01:00:21.574ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3702024-12-19T01:00:21.578ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
3712024-12-19T01:00:21.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3722024-12-19T01:00:21.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3732024-12-19T01:00:21.580ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 208.702664ms iteration = 5 status = 0
3742024-12-19T01:00:21.596ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
3752024-12-19T01:00:21.596ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3762024-12-19T01:00:21.596ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2143743-fd2e-4823-a38c-59825e7a5087", "content-length": "26", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} })
3772024-12-19T01:00:21.596ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3782024-12-19T01:00:21.599ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3792024-12-19T01:00:21.648ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
3802024-12-19T01:00:21.648ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 276.633597ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
3812024-12-19T01:00:21.666ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3822024-12-19T01:00:21.697ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3832024-12-19T01:00:21.698ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c7e7e44f-c22c-449f-a306-378a1c5d3f90", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3842024-12-19T01:00:21.698ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3852024-12-19T01:00:21.700ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "18eea870-1c52-4e5b-8042-272e0892e946", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3862024-12-19T01:00:21.700ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3872024-12-19T01:00:21.701ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3882024-12-19T01:00:21.701ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 329.598506ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3892024-12-19T01:00:21.719ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
3902024-12-19T01:00:21.719ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3912024-12-19T01:00:21.719ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e29f54b-60c7-4f04-b6b7-3cfedefc19b3", "content-length": "26", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} })
3922024-12-19T01:00:21.719ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3932024-12-19T01:00:21.722ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
3942024-12-19T01:00:21.778ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 406.330718ms iteration = 5 status = {}
3952024-12-19T01:00:21.792ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3962024-12-19T01:00:21.793ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe969e01-1347-40b5-b841-4fec951a7a13", "content-length": "1", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} })
3972024-12-19T01:00:21.794ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3982024-12-19T01:00:21.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3992024-12-19T01:00:21.822ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4002024-12-19T01:00:21.822ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4012024-12-19T01:00:21.822ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3836fc2b-58a1-4205-bcc0-5ef445a05fcd", "content-length": "372", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} })
4022024-12-19T01:00:21.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4032024-12-19T01:00:21.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4042024-12-19T01:00:21.824ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 452.602136ms iteration = 5 status = null
4052024-12-19T01:00:21.825ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4062024-12-19T01:00:21.826ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4809567b-4fef-4774-95ab-f94e0a8be8d0", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4072024-12-19T01:00:21.826ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4082024-12-19T01:00:21.827ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "03c21d65-d797-4520-a0e1-abdc82e8a77f", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4092024-12-19T01:00:21.827ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4102024-12-19T01:00:21.829ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "600518b3-f187-4a15-b78f-ec18b8674149", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4112024-12-19T01:00:21.829ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4122024-12-19T01:00:21.831ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
4132024-12-19T01:00:21.831ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 459.57914ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4142024-12-19T01:00:21.842ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4152024-12-19T01:00:21.842ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e651e003-2183-44a6-a681-f6b7cf65cdb7", "content-length": "691", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} })
4162024-12-19T01:00:21.842ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
4172024-12-19T01:00:21.842ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
4182024-12-19T01:00:21.842ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
4192024-12-19T01:00:21.844ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 472.164651ms iteration = 5 status = {}
4202024-12-19T01:00:21.858ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
4212024-12-19T01:00:21.858ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4222024-12-19T01:00:21.859ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "43650ab2-7592-4ae1-b12c-3edd0a120455", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} })
4232024-12-19T01:00:21.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4242024-12-19T01:00:21.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4252024-12-19T01:00:21.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4262024-12-19T01:00:21.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4272024-12-19T01:00:21.905ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4282024-12-19T01:00:21.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4292024-12-19T01:00:21.907ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
4302024-12-19T01:00:21.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4312024-12-19T01:00:21.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4322024-12-19T01:00:21.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4332024-12-19T01:00:21.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4342024-12-19T01:00:21.963ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
4352024-12-19T01:00:21.963ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4362024-12-19T01:00:22.025ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4372024-12-19T01:00:22.025ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a75eb06-18f5-4075-b710-cf2d103a6dfc", "content-length": "134", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} })
4382024-12-19T01:00:22.025ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
4392024-12-19T01:00:22.025ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
4402024-12-19T01:00:22.025ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
4412024-12-19T01:00:22.025ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4422024-12-19T01:00:22.025ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4432024-12-19T01:00:22.025ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4442024-12-19T01:00:22.025ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4452024-12-19T01:00:22.025ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4462024-12-19T01:00:22.025ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
4472024-12-19T01:00:22.025ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
4482024-12-19T01:00:22.026ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
4492024-12-19T01:00:22.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4502024-12-19T01:00:22.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4512024-12-19T01:00:22.028ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4522024-12-19T01:00:22.028ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b9896ef-5619-4da0-9383-80edf20a9fdb", "content-length": "2", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} })
4532024-12-19T01:00:22.028ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4542024-12-19T01:00:22.028ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1808d1e-ba0b-44cc-8b83-5defc878281b", "content-length": "52", "date": "Thu, 19 Dec 2024 01:00:21 GMT"} })
4552024-12-19T01:00:22.028ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
4562024-12-19T01:00:22.028ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4572024-12-19T01:00:22.041ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ef5f3b53-9682-48c2-95a9-54820458c59e", "date": "Thu, 19 Dec 2024 01:00:22 GMT"} })
4582024-12-19T01:00:22.043ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 671.554609ms iteration = 6 status = {}
4592024-12-19T01:00:22.140ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dbda9aaa-293b-45ce-a53c-bd83fc999748", "date": "Thu, 19 Dec 2024 01:00:22 GMT"} })
4602024-12-19T01:00:22.140ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
4612024-12-19T01:00:22.140ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4622024-12-19T01:00:22.140ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd710002-e34e-47e6-ac44-c7c82840e9a1", "content-length": "682", "date": "Thu, 19 Dec 2024 01:00:22 GMT"} })
4632024-12-19T01:00:22.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4642024-12-19T01:00:22.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4652024-12-19T01:00:22.144ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4662024-12-19T01:00:22.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4672024-12-19T01:00:22.149ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4682024-12-19T01:00:22.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4692024-12-19T01:00:22.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4702024-12-19T01:00:22.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4712024-12-19T01:00:22.159ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 787.27266ms iteration = 5 status = {}
4722024-12-19T01:00:22.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 24aa5953-924d-493c-92e9-ba1a09e52b59 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
4732024-12-19T01:00:22.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 24aa5953-924d-493c-92e9-ba1a09e52b59 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
4742024-12-19T01:00:22.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 24aa5953-924d-493c-92e9-ba1a09e52b59 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
4752024-12-19T01:00:22.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2fa32024-3ce4-4c46-91eb-0f5d5594eec8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4762024-12-19T01:00:22.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2fa32024-3ce4-4c46-91eb-0f5d5594eec8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4772024-12-19T01:00:22.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1863 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2fa32024-3ce4-4c46-91eb-0f5d5594eec8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4782024-12-19T01:00:23.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 39b70817-b00c-48c2-a880-2d558e6345dc roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4792024-12-19T01:00:23.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 39b70817-b00c-48c2-a880-2d558e6345dc resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4802024-12-19T01:00:23.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 39b70817-b00c-48c2-a880-2d558e6345dc response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4812024-12-19T01:00:24.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7125beb8-4854-4a36-b878-47550cbf5606 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4822024-12-19T01:00:24.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7125beb8-4854-4a36-b878-47550cbf5606 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4832024-12-19T01:00:24.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7125beb8-4854-4a36-b878-47550cbf5606 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4842024-12-19T01:00:25.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6436d434-0a0e-4d4e-8349-45a6407ccb01 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4852024-12-19T01:00:25.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6436d434-0a0e-4d4e-8349-45a6407ccb01 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4862024-12-19T01:00:25.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1665 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6436d434-0a0e-4d4e-8349-45a6407ccb01 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4872024-12-19T01:00:25.769ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1564 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = bfcf114e-db14-4984-87da-3bab528509db response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
4882024-12-19T01:00:26.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9ffb4e36-0c94-4aab-845e-29fa40bcdda8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4892024-12-19T01:00:26.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9ffb4e36-0c94-4aab-845e-29fa40bcdda8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4902024-12-19T01:00:26.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9ffb4e36-0c94-4aab-845e-29fa40bcdda8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4912024-12-19T01:00:27.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b1b77f2c-e852-49ec-83b0-88abaff9016c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4922024-12-19T01:00:27.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b1b77f2c-e852-49ec-83b0-88abaff9016c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4932024-12-19T01:00:27.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b1b77f2c-e852-49ec-83b0-88abaff9016c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4942024-12-19T01:00:28.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f49da357-19e1-4bf4-8f70-e24d09796eb8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4952024-12-19T01:00:28.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f49da357-19e1-4bf4-8f70-e24d09796eb8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4962024-12-19T01:00:28.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2567 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f49da357-19e1-4bf4-8f70-e24d09796eb8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4972024-12-19T01:00:29.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1b7fe7bc-5529-4080-98f0-6e269b13f1d9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4982024-12-19T01:00:29.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1b7fe7bc-5529-4080-98f0-6e269b13f1d9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
4992024-12-19T01:00:29.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1b7fe7bc-5529-4080-98f0-6e269b13f1d9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5002024-12-19T01:00:30.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 466ce576-7394-4dcb-9b23-ce65d199a529 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5012024-12-19T01:00:30.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 466ce576-7394-4dcb-9b23-ce65d199a529 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5022024-12-19T01:00:30.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 466ce576-7394-4dcb-9b23-ce65d199a529 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5032024-12-19T01:00:31.371ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
5042024-12-19T01:00:31.371ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
5052024-12-19T01:00:31.371ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5062024-12-19T01:00:31.371ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5072024-12-19T01:00:31.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5082024-12-19T01:00:31.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5092024-12-19T01:00:31.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5102024-12-19T01:00:31.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5112024-12-19T01:00:31.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5122024-12-19T01:00:31.376ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.479861ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5132024-12-19T01:00:31.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5142024-12-19T01:00:31.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5152024-12-19T01:00:31.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5162024-12-19T01:00:31.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5172024-12-19T01:00:31.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5182024-12-19T01:00:31.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5192024-12-19T01:00:31.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
5202024-12-19T01:00:31.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5212024-12-19T01:00:31.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5222024-12-19T01:00:31.505ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
5232024-12-19T01:00:31.505ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 134.119471ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
5242024-12-19T01:00:31.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3d537dab-ae9f-44e2-81da-26c9e31e28f1 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5252024-12-19T01:00:31.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3d537dab-ae9f-44e2-81da-26c9e31e28f1 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5262024-12-19T01:00:31.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3d537dab-ae9f-44e2-81da-26c9e31e28f1 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5272024-12-19T01:00:32.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 39164ea9-a6bd-4e03-8d0e-4386548d4d3f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5282024-12-19T01:00:32.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 39164ea9-a6bd-4e03-8d0e-4386548d4d3f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5292024-12-19T01:00:32.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2176 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 39164ea9-a6bd-4e03-8d0e-4386548d4d3f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5302024-12-19T01:00:33.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a20716ab-6c96-4811-a393-452f037759ba roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5312024-12-19T01:00:33.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a20716ab-6c96-4811-a393-452f037759ba resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5322024-12-19T01:00:33.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a20716ab-6c96-4811-a393-452f037759ba response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5332024-12-19T01:00:34.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 18920cc6-982a-4923-95b4-2319674a464f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5342024-12-19T01:00:34.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 18920cc6-982a-4923-95b4-2319674a464f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5352024-12-19T01:00:34.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 18920cc6-982a-4923-95b4-2319674a464f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5362024-12-19T01:00:35.769ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1471 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = b7ea2b26-cfed-470c-9f0d-a8a2d740d56e response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
5372024-12-19T01:00:35.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b49479eb-358f-4d80-ac87-e02bb3b3aff6 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5382024-12-19T01:00:35.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b49479eb-358f-4d80-ac87-e02bb3b3aff6 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5392024-12-19T01:00:35.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b49479eb-358f-4d80-ac87-e02bb3b3aff6 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5402024-12-19T01:00:36.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 514ad2c0-114c-4b8d-b224-fddfe9c34093 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5412024-12-19T01:00:36.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 514ad2c0-114c-4b8d-b224-fddfe9c34093 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5422024-12-19T01:00:36.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 514ad2c0-114c-4b8d-b224-fddfe9c34093 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5432024-12-19T01:00:37.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8a7267b3-6ecf-4892-9f7b-8a41a761cfc7 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5442024-12-19T01:00:37.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8a7267b3-6ecf-4892-9f7b-8a41a761cfc7 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5452024-12-19T01:00:37.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8a7267b3-6ecf-4892-9f7b-8a41a761cfc7 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5462024-12-19T01:00:38.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 83c83ba9-1e7c-4f79-8567-2ac542e9e625 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5472024-12-19T01:00:38.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 83c83ba9-1e7c-4f79-8567-2ac542e9e625 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5482024-12-19T01:00:38.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 83c83ba9-1e7c-4f79-8567-2ac542e9e625 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5492024-12-19T01:00:39.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e506ad8e-411f-4cea-b875-9a2ce9d9eb16 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5502024-12-19T01:00:39.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e506ad8e-411f-4cea-b875-9a2ce9d9eb16 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5512024-12-19T01:00:39.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e506ad8e-411f-4cea-b875-9a2ce9d9eb16 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5522024-12-19T01:00:40.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9d722c04-d57f-4349-8eed-0db872cc352d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5532024-12-19T01:00:40.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9d722c04-d57f-4349-8eed-0db872cc352d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5542024-12-19T01:00:40.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9d722c04-d57f-4349-8eed-0db872cc352d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5552024-12-19T01:00:41.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
5562024-12-19T01:00:41.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
5572024-12-19T01:00:41.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5582024-12-19T01:00:41.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5592024-12-19T01:00:41.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5602024-12-19T01:00:41.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5612024-12-19T01:00:41.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5622024-12-19T01:00:41.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5632024-12-19T01:00:41.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5642024-12-19T01:00:41.376ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.868003ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5652024-12-19T01:00:41.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5662024-12-19T01:00:41.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5672024-12-19T01:00:41.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5682024-12-19T01:00:41.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5692024-12-19T01:00:41.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5702024-12-19T01:00:41.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5712024-12-19T01:00:41.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
5722024-12-19T01:00:41.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5732024-12-19T01:00:41.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5742024-12-19T01:00:41.493ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
5752024-12-19T01:00:41.493ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 120.928842ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
5762024-12-19T01:00:41.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a3a4fc95-1bdc-4624-84b0-794d17e52120 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5772024-12-19T01:00:41.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a3a4fc95-1bdc-4624-84b0-794d17e52120 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5782024-12-19T01:00:41.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a3a4fc95-1bdc-4624-84b0-794d17e52120 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5792024-12-19T01:00:42.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fd74b223-34e5-4aa1-97ef-c984ae882579 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5802024-12-19T01:00:42.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fd74b223-34e5-4aa1-97ef-c984ae882579 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5812024-12-19T01:00:42.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fd74b223-34e5-4aa1-97ef-c984ae882579 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5822024-12-19T01:00:43.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3f330ec1-e457-4f6a-91e4-134f03cbb878 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5832024-12-19T01:00:43.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3f330ec1-e457-4f6a-91e4-134f03cbb878 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5842024-12-19T01:00:43.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1753 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3f330ec1-e457-4f6a-91e4-134f03cbb878 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5852024-12-19T01:00:45.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1bc858da-98ae-4b5b-9f31-aec943cb5491 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5862024-12-19T01:00:45.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1bc858da-98ae-4b5b-9f31-aec943cb5491 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5872024-12-19T01:00:45.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1bc858da-98ae-4b5b-9f31-aec943cb5491 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5882024-12-19T01:00:45.769ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1283 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 3e4e07f6-ebb6-4369-a56c-14d15ac9ce0e response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
5892024-12-19T01:00:46.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f2f54295-5b4f-4f64-94fb-ee22b163b462 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5902024-12-19T01:00:46.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f2f54295-5b4f-4f64-94fb-ee22b163b462 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5912024-12-19T01:00:46.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f2f54295-5b4f-4f64-94fb-ee22b163b462 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5922024-12-19T01:00:47.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c1305cbf-0541-449a-a5c8-cc13a6fa4fc4 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5932024-12-19T01:00:47.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c1305cbf-0541-449a-a5c8-cc13a6fa4fc4 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5942024-12-19T01:00:47.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c1305cbf-0541-449a-a5c8-cc13a6fa4fc4 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5952024-12-19T01:00:48.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3e8f4846-5111-4bd3-b323-b4ca64917ee9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5962024-12-19T01:00:48.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3e8f4846-5111-4bd3-b323-b4ca64917ee9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5972024-12-19T01:00:48.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3e8f4846-5111-4bd3-b323-b4ca64917ee9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5982024-12-19T01:00:49.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6245a2f1-745f-447e-a844-92247b5f8c4e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
5992024-12-19T01:00:49.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6245a2f1-745f-447e-a844-92247b5f8c4e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
6002024-12-19T01:00:49.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6245a2f1-745f-447e-a844-92247b5f8c4e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
6012024-12-19T01:00:50.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dd0e728c-43d9-4ea5-b59c-01f075034bf6 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
6022024-12-19T01:00:50.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dd0e728c-43d9-4ea5-b59c-01f075034bf6 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
6032024-12-19T01:00:50.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dd0e728c-43d9-4ea5-b59c-01f075034bf6 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
6042024-12-19T01:00:51.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c89e1752-c768-429d-bb73-7253c6047ad0 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
6052024-12-19T01:00:51.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c89e1752-c768-429d-bb73-7253c6047ad0 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
6062024-12-19T01:00:51.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c89e1752-c768-429d-bb73-7253c6047ad0 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
6072024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
6082024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
6092024-12-19T01:00:51.372ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6102024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6112024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6122024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
6132024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6142024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6152024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
6162024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6172024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
6182024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
6192024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6202024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6212024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
6222024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
6232024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6242024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6252024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
6262024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6272024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
6282024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6292024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
6302024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
6312024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
6322024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
6332024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6342024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
6352024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6362024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
6372024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6382024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
6392024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
6402024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6412024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6422024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6432024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6442024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6452024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6462024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6472024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6482024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6492024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6502024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6512024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
6522024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6532024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6542024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6552024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6562024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6572024-12-19T01:00:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
6582024-12-19T01:00:51.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6592024-12-19T01:00:51.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6602024-12-19T01:00:51.376ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6612024-12-19T01:00:51.376ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.048695ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6622024-12-19T01:00:51.377ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6632024-12-19T01:00:51.377ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6642024-12-19T01:00:51.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6652024-12-19T01:00:51.379ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6662024-12-19T01:00:51.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6672024-12-19T01:00:51.379ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6682024-12-19T01:00:51.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6692024-12-19T01:00:51.379ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6702024-12-19T01:00:51.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6712024-12-19T01:00:51.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6722024-12-19T01:00:51.379ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 940, tv_nsec: 225431032 } })
6732024-12-19T01:00:51.380ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
6742024-12-19T01:00:51.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6752024-12-19T01:00:51.381ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 940, tv_nsec: 226816841 } })
6762024-12-19T01:00:51.381ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
6772024-12-19T01:00:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6782024-12-19T01:00:51.381ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6792024-12-19T01:00:51.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6802024-12-19T01:00:51.383ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.418095ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
6812024-12-19T01:00:51.383ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6822024-12-19T01:00:51.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6832024-12-19T01:00:51.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6842024-12-19T01:00:51.384ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6852024-12-19T01:00:51.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6862024-12-19T01:00:51.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6872024-12-19T01:00:51.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6882024-12-19T01:00:51.385ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6892024-12-19T01:00:51.386ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.383325ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
6902024-12-19T01:00:51.386ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6912024-12-19T01:00:51.388ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 940, tv_nsec: 233980718 } })
6922024-12-19T01:00:51.388ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
6932024-12-19T01:00:51.390ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6942024-12-19T01:00:51.390ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6952024-12-19T01:00:51.390ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6962024-12-19T01:00:51.390ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6972024-12-19T01:00:51.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6982024-12-19T01:00:51.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6992024-12-19T01:00:51.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7002024-12-19T01:00:51.392ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.793722ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7012024-12-19T01:00:51.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7022024-12-19T01:00:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7032024-12-19T01:00:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7042024-12-19T01:00:51.393ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 21.667594ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7052024-12-19T01:00:51.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7062024-12-19T01:00:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7072024-12-19T01:00:51.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7082024-12-19T01:00:51.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7092024-12-19T01:00:51.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7102024-12-19T01:00:51.398ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7112024-12-19T01:00:51.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7122024-12-19T01:00:51.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
7132024-12-19T01:00:51.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7142024-12-19T01:00:51.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7152024-12-19T01:00:51.405ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7162024-12-19T01:00:51.406ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 33.846479ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7172024-12-19T01:00:51.408ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7182024-12-19T01:00:51.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7192024-12-19T01:00:51.426ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7202024-12-19T01:00:51.427ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7212024-12-19T01:00:51.427ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7222024-12-19T01:00:51.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7232024-12-19T01:00:51.429ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7242024-12-19T01:00:51.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7252024-12-19T01:00:51.490ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7262024-12-19T01:00:51.490ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7272024-12-19T01:00:51.490ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7feb4263-2c14-49c0-918e-179f5ebe5211", "content-length": "26", "date": "Thu, 19 Dec 2024 01:00:51 GMT"} })
7282024-12-19T01:00:51.490ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7292024-12-19T01:00:51.491ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7302024-12-19T01:00:51.498ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7312024-12-19T01:00:51.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7322024-12-19T01:00:51.504ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
7332024-12-19T01:00:51.504ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7342024-12-19T01:00:51.504ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "456426fe-9467-4768-b41b-47622e3dc981", "content-length": "26", "date": "Thu, 19 Dec 2024 01:00:51 GMT"} })
7352024-12-19T01:00:51.504ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7362024-12-19T01:00:51.506ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
7372024-12-19T01:00:51.515ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 143.268155ms iteration = 9 status = {"physical_disks_added":0}
7382024-12-19T01:00:51.525ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7392024-12-19T01:00:51.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7402024-12-19T01:00:51.572ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7412024-12-19T01:00:51.572ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7422024-12-19T01:00:51.572ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1710ff7c-0dcc-4fd5-9c18-5a78ee3c39d3", "content-length": "26", "date": "Thu, 19 Dec 2024 01:00:51 GMT"} })
7432024-12-19T01:00:51.572ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7442024-12-19T01:00:51.574ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7452024-12-19T01:00:51.594ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7462024-12-19T01:00:51.594ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7472024-12-19T01:00:51.595ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 223.088719ms iteration = 6 status = {}
7482024-12-19T01:00:51.595ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a77e9108-676f-4e32-abbf-d37c749d0e7c", "content-length": "372", "date": "Thu, 19 Dec 2024 01:00:51 GMT"} })
7492024-12-19T01:00:51.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7502024-12-19T01:00:51.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7512024-12-19T01:00:51.606ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7522024-12-19T01:00:51.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7532024-12-19T01:00:51.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7542024-12-19T01:00:51.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7552024-12-19T01:00:51.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7562024-12-19T01:00:51.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
7572024-12-19T01:00:51.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7582024-12-19T01:00:51.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7592024-12-19T01:00:51.615ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 243.156932ms iteration = 6 status = 0
7602024-12-19T01:00:51.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7612024-12-19T01:00:51.616ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
7622024-12-19T01:00:51.616ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 244.120985ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
7632024-12-19T01:00:51.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7642024-12-19T01:00:51.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 270.369821ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7652024-12-19T01:00:51.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 280.674921ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7662024-12-19T01:00:51.653ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7672024-12-19T01:00:51.653ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7682024-12-19T01:00:51.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7692024-12-19T01:00:51.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7702024-12-19T01:00:51.655ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7712024-12-19T01:00:51.655ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c932cd7c-a56d-4841-b8be-84bf2eb032c2", "content-length": "1", "date": "Thu, 19 Dec 2024 01:00:51 GMT"} })
7722024-12-19T01:00:51.657ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7732024-12-19T01:00:51.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7742024-12-19T01:00:51.660ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 288.018121ms iteration = 6 status = null
7752024-12-19T01:00:51.664ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7762024-12-19T01:00:51.665ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7772024-12-19T01:00:51.665ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7782024-12-19T01:00:51.665ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "48f33496-52a4-4e8c-b9ad-547acb93bea1", "date": "Thu, 19 Dec 2024 01:00:51 GMT"} })
7792024-12-19T01:00:51.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7802024-12-19T01:00:51.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7812024-12-19T01:00:51.668ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7822024-12-19T01:00:51.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7832024-12-19T01:00:51.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7842024-12-19T01:00:51.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7852024-12-19T01:00:51.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7862024-12-19T01:00:51.671ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7872024-12-19T01:00:51.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7882024-12-19T01:00:51.675ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7892024-12-19T01:00:51.675ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7902024-12-19T01:00:51.675ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7a1a12cb-c3c7-4d77-8384-33f21a8362b7", "date": "Thu, 19 Dec 2024 01:00:51 GMT"} })
7912024-12-19T01:00:51.677ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 305.823693ms iteration = 7 status = {}
7922024-12-19T01:00:51.691ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7932024-12-19T01:00:51.691ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7942024-12-19T01:00:51.691ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 319.59712ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7952024-12-19T01:00:51.703ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7962024-12-19T01:00:51.706ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7972024-12-19T01:00:51.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7982024-12-19T01:00:51.706ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7992024-12-19T01:00:51.706ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8002024-12-19T01:00:51.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8012024-12-19T01:00:51.708ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
8022024-12-19T01:00:51.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8032024-12-19T01:00:51.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8042024-12-19T01:00:51.716ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8052024-12-19T01:00:51.716ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "257d9e54-409a-4f76-aad1-8f6b05d567a0", "content-length": "134", "date": "Thu, 19 Dec 2024 01:00:51 GMT"} })
8062024-12-19T01:00:51.716ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8072024-12-19T01:00:51.717ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
8082024-12-19T01:00:51.717ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8092024-12-19T01:00:51.717ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8102024-12-19T01:00:51.717ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8112024-12-19T01:00:51.717ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8122024-12-19T01:00:51.717ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8132024-12-19T01:00:51.717ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8142024-12-19T01:00:51.717ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8152024-12-19T01:00:51.717ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8162024-12-19T01:00:51.717ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
8172024-12-19T01:00:51.717ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8182024-12-19T01:00:51.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8192024-12-19T01:00:51.720ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8202024-12-19T01:00:51.720ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bce1581-2cf4-4167-b355-d454f57e3ff3", "content-length": "2", "date": "Thu, 19 Dec 2024 01:00:51 GMT"} })
8212024-12-19T01:00:51.720ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8222024-12-19T01:00:51.720ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "80e4a63b-9706-4be9-8921-3f394d5428aa", "content-length": "52", "date": "Thu, 19 Dec 2024 01:00:51 GMT"} })
8232024-12-19T01:00:51.720ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
8242024-12-19T01:00:51.720ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8252024-12-19T01:00:51.741ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8262024-12-19T01:00:51.821ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9d8ef72c-8aa2-4359-80c7-778b0ac87260", "date": "Thu, 19 Dec 2024 01:00:51 GMT"} })
8272024-12-19T01:00:51.821ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
8282024-12-19T01:00:51.821ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8292024-12-19T01:00:51.822ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d15bbe98-4c2a-43af-bb65-16c3663bc24a", "content-length": "682", "date": "Thu, 19 Dec 2024 01:00:51 GMT"} })
8302024-12-19T01:00:51.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8312024-12-19T01:00:51.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8322024-12-19T01:00:51.822ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e8f2d9e-bc97-4e40-86f1-4ba1d3137851", "content-length": "691", "date": "Thu, 19 Dec 2024 01:00:51 GMT"} })
8332024-12-19T01:00:51.822ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8342024-12-19T01:00:51.822ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8352024-12-19T01:00:51.822ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8362024-12-19T01:00:51.824ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 451.892276ms iteration = 6 status = {}
8372024-12-19T01:00:51.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8382024-12-19T01:00:51.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8392024-12-19T01:00:51.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8402024-12-19T01:00:51.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8412024-12-19T01:00:51.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8422024-12-19T01:00:51.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8432024-12-19T01:00:52.049ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 677.187726ms iteration = 6 status = {}
8442024-12-19T01:00:52.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3abf3b85-414e-4f7e-93e1-ac038743ce2e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8452024-12-19T01:00:52.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3abf3b85-414e-4f7e-93e1-ac038743ce2e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8462024-12-19T01:00:52.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3abf3b85-414e-4f7e-93e1-ac038743ce2e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8472024-12-19T01:00:52.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 0ec036cc-8219-4010-8339-69bfb6881821 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
8482024-12-19T01:00:52.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 0ec036cc-8219-4010-8339-69bfb6881821 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
8492024-12-19T01:00:52.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 0ec036cc-8219-4010-8339-69bfb6881821 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
8502024-12-19T01:00:53.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 66f29d1f-7de1-4bf9-b1d4-1c7c7c1995eb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8512024-12-19T01:00:53.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 66f29d1f-7de1-4bf9-b1d4-1c7c7c1995eb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8522024-12-19T01:00:53.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 66f29d1f-7de1-4bf9-b1d4-1c7c7c1995eb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8532024-12-19T01:00:53.743ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:52373
8542024-12-19T01:00:53.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52373 req_id = 1e37d71a-8f5e-411f-b2a2-aad5f9d6eb6d roles = RoleSet { roles: {} } uri = /metrics/producers
8552024-12-19T01:00:53.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52373 req_id = 1e37d71a-8f5e-411f-b2a2-aad5f9d6eb6d resource = Database result = Ok(()) uri = /metrics/producers
8562024-12-19T01:00:53.877ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = de9bec7d-f8ce-44a0-879c-5e088768f91c
8572024-12-19T01:00:53.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134152 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52373 req_id = 1e37d71a-8f5e-411f-b2a2-aad5f9d6eb6d response_code = 201 uri = /metrics/producers
8582024-12-19T01:00:54.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 42cf1bcb-7076-4672-bf06-e46f358f3ae8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8592024-12-19T01:00:54.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 42cf1bcb-7076-4672-bf06-e46f358f3ae8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8602024-12-19T01:00:54.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 42cf1bcb-7076-4672-bf06-e46f358f3ae8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8612024-12-19T01:00:55.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 45fd2ba8-894d-4d89-8fb3-952d8de16dd7 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8622024-12-19T01:00:55.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 45fd2ba8-894d-4d89-8fb3-952d8de16dd7 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8632024-12-19T01:00:55.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1749 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 45fd2ba8-894d-4d89-8fb3-952d8de16dd7 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8642024-12-19T01:00:55.375ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:53183
8652024-12-19T01:00:55.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53183 req_id = 4b125fa8-65da-4a37-992e-6ad6c2c9897e roles = RoleSet { roles: {} } uri = /metrics/producers
8662024-12-19T01:00:55.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53183 req_id = 4b125fa8-65da-4a37-992e-6ad6c2c9897e resource = Database result = Ok(()) uri = /metrics/producers
8672024-12-19T01:00:55.379ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:49806
8682024-12-19T01:00:55.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49806 req_id = 6eaf771f-c981-4cd2-9be7-381a1a1c874f roles = RoleSet { roles: {} } uri = /metrics/producers
8692024-12-19T01:00:55.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49806 req_id = 6eaf771f-c981-4cd2-9be7-381a1a1c874f resource = Database result = Ok(()) uri = /metrics/producers
8702024-12-19T01:00:55.519ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 9544d6fb-0646-44f2-8d7c-f02b0fe1f856
8712024-12-19T01:00:55.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143741 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53183 req_id = 4b125fa8-65da-4a37-992e-6ad6c2c9897e response_code = 201 uri = /metrics/producers
8722024-12-19T01:00:55.520ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = a59c27fd-a846-41a8-8577-0c2618144732
8732024-12-19T01:00:55.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141669 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49806 req_id = 6eaf771f-c981-4cd2-9be7-381a1a1c874f response_code = 201 uri = /metrics/producers
8742024-12-19T01:00:55.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1454 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = b849acd5-263a-4e59-88d9-a02b00247eb8 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
8752024-12-19T01:00:55.917ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:54546
8762024-12-19T01:00:55.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54546 req_id = 16c5742c-8f9c-4015-8e62-5dee073db50b roles = RoleSet { roles: {} } uri = /metrics/producers
8772024-12-19T01:00:55.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54546 req_id = 16c5742c-8f9c-4015-8e62-5dee073db50b resource = Database result = Ok(()) uri = /metrics/producers
8782024-12-19T01:00:55.925ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 51ab14f8-f146-4958-aacf-1a2334aec785
8792024-12-19T01:00:55.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8293 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54546 req_id = 16c5742c-8f9c-4015-8e62-5dee073db50b response_code = 201 uri = /metrics/producers
8802024-12-19T01:00:56.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c8aecaae-1888-4840-a0d1-8610e7f1d128 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8812024-12-19T01:00:56.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c8aecaae-1888-4840-a0d1-8610e7f1d128 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8822024-12-19T01:00:56.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2652 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c8aecaae-1888-4840-a0d1-8610e7f1d128 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8832024-12-19T01:00:56.575ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:58908
8842024-12-19T01:00:56.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58908 req_id = 18a9cb14-a900-48f6-8018-3c09eed8f07b roles = RoleSet { roles: {} } uri = /metrics/producers
8852024-12-19T01:00:56.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58908 req_id = 18a9cb14-a900-48f6-8018-3c09eed8f07b resource = Database result = Ok(()) uri = /metrics/producers
8862024-12-19T01:00:56.617ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 9f4eb089-639f-444f-a6bb-061685ba22f0
8872024-12-19T01:00:56.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41831 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58908 req_id = 18a9cb14-a900-48f6-8018-3c09eed8f07b response_code = 201 uri = /metrics/producers
8882024-12-19T01:00:57.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1deba74e-064d-4ed4-86c2-6273c8687a09 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8892024-12-19T01:00:57.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1deba74e-064d-4ed4-86c2-6273c8687a09 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8902024-12-19T01:00:57.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1deba74e-064d-4ed4-86c2-6273c8687a09 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8912024-12-19T01:00:58.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 37c8d68d-59b8-48cb-a76f-edf225e9ccc8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8922024-12-19T01:00:58.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 37c8d68d-59b8-48cb-a76f-edf225e9ccc8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8932024-12-19T01:00:58.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 37c8d68d-59b8-48cb-a76f-edf225e9ccc8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8942024-12-19T01:00:59.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1b67a23a-a5cc-48ae-b94b-c812ff52033b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8952024-12-19T01:00:59.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1b67a23a-a5cc-48ae-b94b-c812ff52033b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8962024-12-19T01:00:59.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1b67a23a-a5cc-48ae-b94b-c812ff52033b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8972024-12-19T01:01:00.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0a754b89-6f2d-4a65-8b03-bff5eced5818 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8982024-12-19T01:01:00.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0a754b89-6f2d-4a65-8b03-bff5eced5818 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
8992024-12-19T01:01:00.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0a754b89-6f2d-4a65-8b03-bff5eced5818 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9002024-12-19T01:01:01.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 529789a3-7d7f-4d31-8ece-b0fb23ec17f6 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9012024-12-19T01:01:01.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 529789a3-7d7f-4d31-8ece-b0fb23ec17f6 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9022024-12-19T01:01:01.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 529789a3-7d7f-4d31-8ece-b0fb23ec17f6 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9032024-12-19T01:01:01.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
9042024-12-19T01:01:01.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
9052024-12-19T01:01:01.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9062024-12-19T01:01:01.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9072024-12-19T01:01:01.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9082024-12-19T01:01:01.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9092024-12-19T01:01:01.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9102024-12-19T01:01:01.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9112024-12-19T01:01:01.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9122024-12-19T01:01:01.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9132024-12-19T01:01:01.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9142024-12-19T01:01:01.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9152024-12-19T01:01:01.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9162024-12-19T01:01:01.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9172024-12-19T01:01:01.403ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.227364ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9182024-12-19T01:01:01.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9192024-12-19T01:01:01.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
9202024-12-19T01:01:01.410ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9212024-12-19T01:01:01.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9222024-12-19T01:01:01.421ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
9232024-12-19T01:01:01.421ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.790376ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
9242024-12-19T01:01:02.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c2d5e98f-3c44-412e-8e33-4482339a7c32 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9252024-12-19T01:01:02.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c2d5e98f-3c44-412e-8e33-4482339a7c32 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9262024-12-19T01:01:02.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c2d5e98f-3c44-412e-8e33-4482339a7c32 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9272024-12-19T01:01:03.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 79e1fc44-65a4-49bc-92fc-1c9920a20612 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9282024-12-19T01:01:03.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 79e1fc44-65a4-49bc-92fc-1c9920a20612 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9292024-12-19T01:01:03.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 79e1fc44-65a4-49bc-92fc-1c9920a20612 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9302024-12-19T01:01:04.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 24d618b8-f922-4d0c-9049-eae6eab4f95d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9312024-12-19T01:01:04.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 24d618b8-f922-4d0c-9049-eae6eab4f95d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9322024-12-19T01:01:04.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 24d618b8-f922-4d0c-9049-eae6eab4f95d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9332024-12-19T01:01:05.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0866368d-c1e6-492f-acf8-f3dfbdf7e35e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9342024-12-19T01:01:05.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0866368d-c1e6-492f-acf8-f3dfbdf7e35e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9352024-12-19T01:01:05.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0866368d-c1e6-492f-acf8-f3dfbdf7e35e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9362024-12-19T01:01:05.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46978 req_id = 75661cf2-c565-415c-982e-0f957f3b4e10 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
9372024-12-19T01:01:05.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46978 req_id = 75661cf2-c565-415c-982e-0f957f3b4e10 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
9382024-12-19T01:01:05.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3474 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46978 req_id = 75661cf2-c565-415c-982e-0f957f3b4e10 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
9392024-12-19T01:01:05.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46978 req_id = 44f0643d-28a2-4141-844b-39ce7fb5c718 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
9402024-12-19T01:01:05.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46978 req_id = 44f0643d-28a2-4141-844b-39ce7fb5c718 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
9412024-12-19T01:01:05.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46978 req_id = 44f0643d-28a2-4141-844b-39ce7fb5c718 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
9422024-12-19T01:01:05.769ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1470 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = c0d7e6bd-e074-4c2c-bb3b-f41d2d526ef9 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
9432024-12-19T01:01:06.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ffe7bffa-6d7a-4c98-97c4-3c93256f371a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9442024-12-19T01:01:06.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ffe7bffa-6d7a-4c98-97c4-3c93256f371a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9452024-12-19T01:01:06.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ffe7bffa-6d7a-4c98-97c4-3c93256f371a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9462024-12-19T01:01:07.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d0300d02-dca3-43d0-a128-998442b3658b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9472024-12-19T01:01:07.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d0300d02-dca3-43d0-a128-998442b3658b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9482024-12-19T01:01:07.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d0300d02-dca3-43d0-a128-998442b3658b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9492024-12-19T01:01:08.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f6780e06-b092-4055-8c28-e8f3877bc731 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9502024-12-19T01:01:08.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f6780e06-b092-4055-8c28-e8f3877bc731 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9512024-12-19T01:01:08.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f6780e06-b092-4055-8c28-e8f3877bc731 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9522024-12-19T01:01:09.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e993036-4aea-4d5a-90d4-63525c7fca64 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9532024-12-19T01:01:09.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e993036-4aea-4d5a-90d4-63525c7fca64 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9542024-12-19T01:01:09.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e993036-4aea-4d5a-90d4-63525c7fca64 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9552024-12-19T01:01:10.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7fefbc6a-5bd3-455c-a9c0-49284a6129a1 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9562024-12-19T01:01:10.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7fefbc6a-5bd3-455c-a9c0-49284a6129a1 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9572024-12-19T01:01:10.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7fefbc6a-5bd3-455c-a9c0-49284a6129a1 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9582024-12-19T01:01:11.371ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
9592024-12-19T01:01:11.371ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
9602024-12-19T01:01:11.371ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9612024-12-19T01:01:11.371ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9622024-12-19T01:01:11.371ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:34746
9632024-12-19T01:01:11.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34746 req_id = b9490f00-f94f-4562-9af2-2199adaa28d9 roles = RoleSet { roles: {} } uri = /metrics/producers
9642024-12-19T01:01:11.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9652024-12-19T01:01:11.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9662024-12-19T01:01:11.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34746 req_id = b9490f00-f94f-4562-9af2-2199adaa28d9 resource = Database result = Ok(()) uri = /metrics/producers
9672024-12-19T01:01:11.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9682024-12-19T01:01:11.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9692024-12-19T01:01:11.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9702024-12-19T01:01:11.375ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.818322ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9712024-12-19T01:01:11.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9722024-12-19T01:01:11.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9732024-12-19T01:01:11.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9742024-12-19T01:01:11.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9752024-12-19T01:01:11.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9762024-12-19T01:01:11.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9772024-12-19T01:01:11.382ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = ac09f416-2290-4c96-b514-dc021f54a2f5
9782024-12-19T01:01:11.382ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10297 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34746 req_id = b9490f00-f94f-4562-9af2-2199adaa28d9 response_code = 201 uri = /metrics/producers
9792024-12-19T01:01:11.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
9802024-12-19T01:01:11.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9812024-12-19T01:01:11.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9822024-12-19T01:01:11.395ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
9832024-12-19T01:01:11.395ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.221575ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
9842024-12-19T01:01:11.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bbffd7f6-184b-4871-ab9b-76303cddf2cd roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9852024-12-19T01:01:11.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bbffd7f6-184b-4871-ab9b-76303cddf2cd resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9862024-12-19T01:01:11.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bbffd7f6-184b-4871-ab9b-76303cddf2cd response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9872024-12-19T01:01:12.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 71abcf3d-4699-4eab-bb2f-bd4c9c387b6e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9882024-12-19T01:01:12.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 71abcf3d-4699-4eab-bb2f-bd4c9c387b6e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9892024-12-19T01:01:12.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 71abcf3d-4699-4eab-bb2f-bd4c9c387b6e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9902024-12-19T01:01:13.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3d42b305-2bf9-4d4d-83ea-cb54329f685e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9912024-12-19T01:01:13.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3d42b305-2bf9-4d4d-83ea-cb54329f685e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9922024-12-19T01:01:13.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3d42b305-2bf9-4d4d-83ea-cb54329f685e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9932024-12-19T01:01:14.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 962ba719-9959-43ce-b9fc-e286391e969b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9942024-12-19T01:01:14.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 962ba719-9959-43ce-b9fc-e286391e969b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9952024-12-19T01:01:14.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 962ba719-9959-43ce-b9fc-e286391e969b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9962024-12-19T01:01:15.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7cbd9e18-cc41-46a4-86fe-d2c18ab36215 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9972024-12-19T01:01:15.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7cbd9e18-cc41-46a4-86fe-d2c18ab36215 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9982024-12-19T01:01:15.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7cbd9e18-cc41-46a4-86fe-d2c18ab36215 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
9992024-12-19T01:01:15.769ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1377 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 7c589f4d-1ce7-49f8-871b-f1328d77d9e9 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
10002024-12-19T01:01:16.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ca9c4048-64a3-41be-b677-ea1b85748af4 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10012024-12-19T01:01:16.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ca9c4048-64a3-41be-b677-ea1b85748af4 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10022024-12-19T01:01:16.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1884 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ca9c4048-64a3-41be-b677-ea1b85748af4 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10032024-12-19T01:01:17.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dbd4dca5-661a-4bf7-adba-2ffe3d053764 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10042024-12-19T01:01:17.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dbd4dca5-661a-4bf7-adba-2ffe3d053764 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10052024-12-19T01:01:17.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dbd4dca5-661a-4bf7-adba-2ffe3d053764 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10062024-12-19T01:01:18.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f652006b-ff89-4e5a-aa5b-92ddb3877a82 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10072024-12-19T01:01:18.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f652006b-ff89-4e5a-aa5b-92ddb3877a82 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10082024-12-19T01:01:18.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f652006b-ff89-4e5a-aa5b-92ddb3877a82 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10092024-12-19T01:01:19.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 99cef73c-07c1-4a93-98c8-22c434420e8d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10102024-12-19T01:01:19.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 99cef73c-07c1-4a93-98c8-22c434420e8d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10112024-12-19T01:01:19.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 99cef73c-07c1-4a93-98c8-22c434420e8d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10122024-12-19T01:01:20.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ae29317c-5612-4949-a64e-cafb74ddc173 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10132024-12-19T01:01:20.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ae29317c-5612-4949-a64e-cafb74ddc173 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10142024-12-19T01:01:20.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ae29317c-5612-4949-a64e-cafb74ddc173 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
10152024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
10162024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
10172024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10182024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
10192024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10202024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
10212024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
10222024-12-19T01:01:21.372ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 00:51:21.372232208 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
10232024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
10242024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
10252024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
10262024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10272024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
10282024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10292024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
10302024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
10312024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
10322024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10332024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
10342024-12-19T01:01:21.372ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a
10352024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
10362024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.54\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a"}
10372024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
10382024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
10392024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10402024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
10412024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10422024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
10432024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10442024-12-19T01:01:21.372ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
10452024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
10462024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
10472024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10482024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
10492024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10502024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
10512024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10522024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10532024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
10542024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
10552024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10562024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
10572024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10582024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10592024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
10602024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10612024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
10622024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10632024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
10642024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10652024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
10662024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10672024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
10682024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10692024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
10702024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10712024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
10722024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10732024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
10742024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10752024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
10762024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
10772024-12-19T01:01:21.372ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10782024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10792024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10802024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10812024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
10822024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10832024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10842024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10852024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10862024-12-19T01:01:21.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
10872024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
10882024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10892024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
10902024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10912024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10922024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
10932024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10942024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10952024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10962024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10972024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10982024-12-19T01:01:21.373ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0018a454-75c0-41b1-be69-9476391f01e1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("050cdbd7-4ebc-471c-b4dc-ec1b3741f763.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 970, tv_nsec: 218393066 } })
10992024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11002024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11012024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
11022024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11032024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11042024-12-19T01:01:21.373ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a880a2e-2471-4fd8-9ad5-3e0c3fbde317.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 970, tv_nsec: 218430656 } })
11052024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
11062024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11072024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11082024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11092024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11102024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11112024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
11122024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.235537ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
11132024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11142024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11152024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
11162024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.382229ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
11172024-12-19T01:01:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11182024-12-19T01:01:21.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11192024-12-19T01:01:21.376ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 00:51:21.372232208 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
11202024-12-19T01:01:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.253478ms iteration = 4 status = {"expiration":"2024-12-19T00:51:21.372232208Z","pruned":[]}
11212024-12-19T01:01:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.113966ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11222024-12-19T01:01:21.376ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 970, tv_nsec: 222049646 } })
11232024-12-19T01:01:21.376ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11242024-12-19T01:01:21.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11252024-12-19T01:01:21.377ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
11262024-12-19T01:01:21.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11272024-12-19T01:01:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11282024-12-19T01:01:21.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11292024-12-19T01:01:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11302024-12-19T01:01:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11312024-12-19T01:01:21.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11322024-12-19T01:01:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11332024-12-19T01:01:21.383ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11342024-12-19T01:01:21.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
11352024-12-19T01:01:21.386ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11362024-12-19T01:01:21.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11372024-12-19T01:01:21.388ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11382024-12-19T01:01:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11392024-12-19T01:01:21.393ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.679741ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
11402024-12-19T01:01:21.395ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 970, tv_nsec: 240550917 } })
11412024-12-19T01:01:21.396ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
11422024-12-19T01:01:21.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11432024-12-19T01:01:21.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11442024-12-19T01:01:21.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11452024-12-19T01:01:21.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11462024-12-19T01:01:21.445ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11472024-12-19T01:01:21.445ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11482024-12-19T01:01:21.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11492024-12-19T01:01:21.445ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11502024-12-19T01:01:21.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11512024-12-19T01:01:21.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11522024-12-19T01:01:21.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11532024-12-19T01:01:21.447ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
11542024-12-19T01:01:21.447ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
11552024-12-19T01:01:21.447ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 75.173181ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
11562024-12-19T01:01:21.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11572024-12-19T01:01:21.448ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11582024-12-19T01:01:21.448ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11592024-12-19T01:01:21.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11602024-12-19T01:01:21.450ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11612024-12-19T01:01:21.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11622024-12-19T01:01:21.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11632024-12-19T01:01:21.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11642024-12-19T01:01:21.451ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 970, tv_nsec: 296368495 } })
11652024-12-19T01:01:21.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
11662024-12-19T01:01:21.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11672024-12-19T01:01:21.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11682024-12-19T01:01:21.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11692024-12-19T01:01:21.454ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11702024-12-19T01:01:21.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11712024-12-19T01:01:21.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11722024-12-19T01:01:21.454ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11732024-12-19T01:01:21.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11742024-12-19T01:01:21.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11752024-12-19T01:01:21.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11762024-12-19T01:01:21.456ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 83.636136ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
11772024-12-19T01:01:21.456ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11782024-12-19T01:01:21.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11792024-12-19T01:01:21.457ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11802024-12-19T01:01:21.458ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11812024-12-19T01:01:21.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11822024-12-19T01:01:21.460ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11832024-12-19T01:01:21.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11842024-12-19T01:01:21.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11852024-12-19T01:01:21.461ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11862024-12-19T01:01:21.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
11872024-12-19T01:01:21.461ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11882024-12-19T01:01:21.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11892024-12-19T01:01:21.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
11902024-12-19T01:01:21.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11912024-12-19T01:01:21.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11922024-12-19T01:01:21.469ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11932024-12-19T01:01:21.469ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11942024-12-19T01:01:21.469ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11952024-12-19T01:01:21.469ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11962024-12-19T01:01:21.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11972024-12-19T01:01:21.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11982024-12-19T01:01:21.471ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11992024-12-19T01:01:21.473ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12002024-12-19T01:01:21.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12012024-12-19T01:01:21.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12022024-12-19T01:01:21.474ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12032024-12-19T01:01:21.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12042024-12-19T01:01:21.476ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 103.590867ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
12052024-12-19T01:01:21.482ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12062024-12-19T01:01:21.483ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12072024-12-19T01:01:21.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12082024-12-19T01:01:21.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12092024-12-19T01:01:21.484ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12102024-12-19T01:01:21.486ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12112024-12-19T01:01:21.486ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12122024-12-19T01:01:21.486ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12132024-12-19T01:01:21.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12142024-12-19T01:01:21.487ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12152024-12-19T01:01:21.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12162024-12-19T01:01:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12172024-12-19T01:01:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12182024-12-19T01:01:21.489ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12192024-12-19T01:01:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12202024-12-19T01:01:21.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
12212024-12-19T01:01:21.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12222024-12-19T01:01:21.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12232024-12-19T01:01:21.492ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12242024-12-19T01:01:21.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12252024-12-19T01:01:21.508ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12262024-12-19T01:01:21.508ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 136.020927ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12272024-12-19T01:01:21.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
12282024-12-19T01:01:21.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12292024-12-19T01:01:21.518ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12302024-12-19T01:01:21.521ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
12312024-12-19T01:01:21.521ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
12322024-12-19T01:01:21.521ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
12332024-12-19T01:01:21.521ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12342024-12-19T01:01:21.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12352024-12-19T01:01:21.523ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
12362024-12-19T01:01:21.523ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
12372024-12-19T01:01:21.523ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 150.95276ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
12382024-12-19T01:01:21.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12392024-12-19T01:01:21.525ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 152.771144ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12402024-12-19T01:01:21.528ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
12412024-12-19T01:01:21.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12422024-12-19T01:01:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12432024-12-19T01:01:21.534ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
12442024-12-19T01:01:21.534ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12452024-12-19T01:01:21.535ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd13aa4e-e123-4d50-b3fe-a9784ddc95fb", "content-length": "26", "date": "Thu, 19 Dec 2024 01:01:21 GMT"} })
12462024-12-19T01:01:21.535ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12472024-12-19T01:01:21.538ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12482024-12-19T01:01:21.546ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 173.670428ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12492024-12-19T01:01:21.549ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12502024-12-19T01:01:21.549ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12512024-12-19T01:01:21.549ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 176.838862ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12522024-12-19T01:01:21.572ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
12532024-12-19T01:01:21.573ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
12542024-12-19T01:01:21.573ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
12552024-12-19T01:01:21.573ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12562024-12-19T01:01:21.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12572024-12-19T01:01:21.614ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
12582024-12-19T01:01:21.671ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12592024-12-19T01:01:21.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12602024-12-19T01:01:21.678ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
12612024-12-19T01:01:21.678ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12622024-12-19T01:01:21.678ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6270af19-a2b1-4130-8280-09d13c50e1fc", "content-length": "26", "date": "Thu, 19 Dec 2024 01:01:21 GMT"} })
12632024-12-19T01:01:21.678ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12642024-12-19T01:01:21.680ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
12652024-12-19T01:01:21.684ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12662024-12-19T01:01:21.684ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "079d522b-24bc-471e-a17e-0eebd5971986", "content-length": "1", "date": "Thu, 19 Dec 2024 01:01:20 GMT"} })
12672024-12-19T01:01:21.686ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12682024-12-19T01:01:21.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12692024-12-19T01:01:21.741ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
12702024-12-19T01:01:21.741ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12712024-12-19T01:01:21.741ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "66b10143-0d32-48ff-bfb9-7829d455721d", "content-length": "26", "date": "Thu, 19 Dec 2024 01:01:21 GMT"} })
12722024-12-19T01:01:21.741ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12732024-12-19T01:01:21.743ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12742024-12-19T01:01:21.757ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
12752024-12-19T01:01:21.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 41ad1a2a-9002-4b56-99a4-092d4aa0a3f1 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
12762024-12-19T01:01:21.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 41ad1a2a-9002-4b56-99a4-092d4aa0a3f1 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
12772024-12-19T01:01:21.814ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
12782024-12-19T01:01:21.814ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9099feed-3248-4732-a741-b83d17d35d04", "date": "Thu, 19 Dec 2024 01:01:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12792024-12-19T01:01:21.814ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12802024-12-19T01:01:21.816ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "687b23e1-4852-4082-a084-c845416052ff", "date": "Thu, 19 Dec 2024 01:01:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12812024-12-19T01:01:21.816ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12822024-12-19T01:01:21.817ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
12832024-12-19T01:01:21.817ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 445.787623ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
12842024-12-19T01:01:21.820ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
12852024-12-19T01:01:21.821ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e3c988c-8835-48d1-a629-2af90351f978", "content-length": "64", "date": "Thu, 19 Dec 2024 01:01:21 GMT"} })
12862024-12-19T01:01:21.821ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12872024-12-19T01:01:21.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12882024-12-19T01:01:21.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 450.670069ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
12892024-12-19T01:01:21.825ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12902024-12-19T01:01:21.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12912024-12-19T01:01:21.827ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12922024-12-19T01:01:21.829ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12932024-12-19T01:01:21.829ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12942024-12-19T01:01:21.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12952024-12-19T01:01:21.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12962024-12-19T01:01:21.831ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12972024-12-19T01:01:21.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12982024-12-19T01:01:21.834ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12992024-12-19T01:01:21.834ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13002024-12-19T01:01:21.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13012024-12-19T01:01:21.835ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 462.986636ms iteration = 7 status = null
13022024-12-19T01:01:21.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 41ad1a2a-9002-4b56-99a4-092d4aa0a3f1 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
13032024-12-19T01:01:21.835ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13042024-12-19T01:01:21.837ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13052024-12-19T01:01:21.838ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13062024-12-19T01:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13072024-12-19T01:01:21.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13082024-12-19T01:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
13092024-12-19T01:01:21.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13102024-12-19T01:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13112024-12-19T01:01:21.842ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
13122024-12-19T01:01:21.842ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 469.93503ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
13132024-12-19T01:01:21.843ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 471.509882ms iteration = 3 status = {"nsuccess":5}
13142024-12-19T01:01:21.846ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 474.607034ms iteration = 7 status = 0
13152024-12-19T01:01:21.869ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 497.606676ms iteration = 7 status = {}
13162024-12-19T01:01:21.881ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13172024-12-19T01:01:21.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13182024-12-19T01:01:21.885ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 513.34858ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13192024-12-19T01:01:21.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13202024-12-19T01:01:21.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13212024-12-19T01:01:21.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13222024-12-19T01:01:21.892ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13232024-12-19T01:01:21.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13242024-12-19T01:01:21.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13252024-12-19T01:01:21.893ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13262024-12-19T01:01:21.895ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
13272024-12-19T01:01:21.895ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6520f651-b73e-4a50-8205-b7dec5c54347", "date": "Thu, 19 Dec 2024 01:01:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
13282024-12-19T01:01:21.896ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
13292024-12-19T01:01:21.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13302024-12-19T01:01:21.897ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a6824629-c5ea-4eb1-b2f3-4d7391f5492e", "date": "Thu, 19 Dec 2024 01:01:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
13312024-12-19T01:01:21.897ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
13322024-12-19T01:01:21.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
13332024-12-19T01:01:21.898ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13342024-12-19T01:01:21.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13352024-12-19T01:01:21.899ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a7c7f25b-113f-4ba6-9544-4ebdc3697552", "date": "Thu, 19 Dec 2024 01:01:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
13362024-12-19T01:01:21.899ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
13372024-12-19T01:01:21.900ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13382024-12-19T01:01:21.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13392024-12-19T01:01:21.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13402024-12-19T01:01:21.901ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
13412024-12-19T01:01:21.901ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 529.163615ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
13422024-12-19T01:01:21.938ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13432024-12-19T01:01:21.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13442024-12-19T01:01:21.940ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13452024-12-19T01:01:21.942ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13462024-12-19T01:01:21.942ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13472024-12-19T01:01:21.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13482024-12-19T01:01:21.944ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
13492024-12-19T01:01:21.944ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
13502024-12-19T01:01:21.944ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13512024-12-19T01:01:21.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13522024-12-19T01:01:21.948ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13532024-12-19T01:01:21.951ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13542024-12-19T01:01:21.951ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13552024-12-19T01:01:21.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13562024-12-19T01:01:21.953ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
13572024-12-19T01:01:21.953ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 580.841177ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
13582024-12-19T01:01:21.954ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
13592024-12-19T01:01:21.954ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
13602024-12-19T01:01:21.954ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 00:59:01.994004 UTC dns_group = internal generation = 1
13612024-12-19T01:01:21.954ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 582.434328ms iteration = 5 status = {"generation":1}
13622024-12-19T01:01:21.958ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
13632024-12-19T01:01:21.958ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 0 version = 2
13642024-12-19T01:01:21.958ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13652024-12-19T01:01:21.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13662024-12-19T01:01:21.961ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13672024-12-19T01:01:21.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13682024-12-19T01:01:21.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13692024-12-19T01:01:21.965ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13702024-12-19T01:01:21.965ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13712024-12-19T01:01:21.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13722024-12-19T01:01:21.967ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
13732024-12-19T01:01:21.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13742024-12-19T01:01:21.967ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 1 version = 2
13752024-12-19T01:01:21.967ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
13762024-12-19T01:01:21.967ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 00:59:02.707744 UTC dns_group = external generation = 2
13772024-12-19T01:01:21.967ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 595.280652ms iteration = 5 status = {"generation":2}
13782024-12-19T01:01:21.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13792024-12-19T01:01:21.980ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13802024-12-19T01:01:21.981ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "811e14a5-2a60-402f-982a-058695e88d40", "content-length": "134", "date": "Thu, 19 Dec 2024 01:01:21 GMT"} })
13812024-12-19T01:01:21.981ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
13822024-12-19T01:01:21.981ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
13832024-12-19T01:01:21.981ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
13842024-12-19T01:01:21.981ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13852024-12-19T01:01:21.981ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13862024-12-19T01:01:21.982ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13872024-12-19T01:01:21.982ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13882024-12-19T01:01:21.982ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13892024-12-19T01:01:21.982ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13902024-12-19T01:01:21.982ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13912024-12-19T01:01:21.982ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
13922024-12-19T01:01:21.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13932024-12-19T01:01:21.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13942024-12-19T01:01:21.985ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13952024-12-19T01:01:21.985ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "53f9360c-6d1e-444b-9468-75d06be1214f", "content-length": "2", "date": "Thu, 19 Dec 2024 01:01:21 GMT"} })
13962024-12-19T01:01:21.985ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13972024-12-19T01:01:21.985ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "51c48f20-544d-47fc-911b-871eb5c729f0", "content-length": "52", "date": "Thu, 19 Dec 2024 01:01:21 GMT"} })
13982024-12-19T01:01:21.985ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
13992024-12-19T01:01:21.985ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14002024-12-19T01:01:21.987ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 614.735487ms iteration = 10 status = {"physical_disks_added":0}
14012024-12-19T01:01:21.987ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T00:58:19.687181Z, time_modified: 2024-12-19T00:58:19.687181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }) }
14022024-12-19T01:01:21.987ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 615.123322ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]}},"default_endpoint":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
14032024-12-19T01:01:21.992ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
14042024-12-19T01:01:21.992ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14052024-12-19T01:01:22.030ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14062024-12-19T01:01:22.100ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a878fa5a-155d-4176-83db-c0cd74a621de", "date": "Thu, 19 Dec 2024 01:01:21 GMT"} })
14072024-12-19T01:01:22.100ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
14082024-12-19T01:01:22.100ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14092024-12-19T01:01:22.101ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf700bc0-9e83-4f10-a983-1dbf095c6a03", "content-length": "682", "date": "Thu, 19 Dec 2024 01:01:22 GMT"} })
14102024-12-19T01:01:22.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14112024-12-19T01:01:22.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14122024-12-19T01:01:22.102ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d145a34-b7f2-417c-8b50-fb676212690e", "content-length": "691", "date": "Thu, 19 Dec 2024 01:01:22 GMT"} })
14132024-12-19T01:01:22.102ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "df69e807-5923-4326-a10b-80fadea4d689", "content-length": "372", "date": "Thu, 19 Dec 2024 01:01:22 GMT"} })
14142024-12-19T01:01:22.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14152024-12-19T01:01:22.102ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
14162024-12-19T01:01:22.102ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
14172024-12-19T01:01:22.102ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
14182024-12-19T01:01:22.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14192024-12-19T01:01:22.103ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 731.148528ms iteration = 7 status = {}
14202024-12-19T01:01:22.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14212024-12-19T01:01:22.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14222024-12-19T01:01:22.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14232024-12-19T01:01:22.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14242024-12-19T01:01:22.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14252024-12-19T01:01:22.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14262024-12-19T01:01:22.167ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
14272024-12-19T01:01:22.167ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
14282024-12-19T01:01:22.220ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 848.188816ms iteration = 7 status = {}
14292024-12-19T01:01:22.297ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6d59ed03-6d1c-4527-9888-fe9657aba2d0", "date": "Thu, 19 Dec 2024 01:01:22 GMT"} })
14302024-12-19T01:01:22.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14312024-12-19T01:01:22.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14322024-12-19T01:01:22.302ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14332024-12-19T01:01:22.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14342024-12-19T01:01:22.306ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14352024-12-19T01:01:22.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14362024-12-19T01:01:22.310ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14372024-12-19T01:01:22.310ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14382024-12-19T01:01:22.311ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "722e9059-1405-4275-9c62-22e37f34c9b3", "date": "Thu, 19 Dec 2024 01:01:22 GMT"} })
14392024-12-19T01:01:22.312ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 940.119695ms iteration = 8 status = {}
14402024-12-19T01:01:22.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 3f326681-4c84-4420-9c94-fce9a57e54f4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
14412024-12-19T01:01:22.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 3f326681-4c84-4420-9c94-fce9a57e54f4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
14422024-12-19T01:01:22.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 3f326681-4c84-4420-9c94-fce9a57e54f4 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
14432024-12-19T01:01:22.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 473d6bb2-e3b4-4b92-afc2-76ae9e61dde8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14442024-12-19T01:01:22.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 473d6bb2-e3b4-4b92-afc2-76ae9e61dde8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14452024-12-19T01:01:22.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 473d6bb2-e3b4-4b92-afc2-76ae9e61dde8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14462024-12-19T01:01:23.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0e096cb3-fc78-4228-8118-ebcfc7d1fda7 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14472024-12-19T01:01:23.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0e096cb3-fc78-4228-8118-ebcfc7d1fda7 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14482024-12-19T01:01:23.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0e096cb3-fc78-4228-8118-ebcfc7d1fda7 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14492024-12-19T01:01:24.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 72a93724-8f0b-4275-a51e-d9cbcd727480 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14502024-12-19T01:01:24.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 72a93724-8f0b-4275-a51e-d9cbcd727480 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14512024-12-19T01:01:24.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 72a93724-8f0b-4275-a51e-d9cbcd727480 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14522024-12-19T01:01:25.769ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1357 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 1a1d951c-1bfc-4e20-9a96-3d3e9c19585c response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
14532024-12-19T01:01:25.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = eb8ae17e-a0f2-427a-898c-d8fdbef041ec roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14542024-12-19T01:01:25.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = eb8ae17e-a0f2-427a-898c-d8fdbef041ec resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14552024-12-19T01:01:25.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = eb8ae17e-a0f2-427a-898c-d8fdbef041ec response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14562024-12-19T01:01:26.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e0edc1bf-59e6-4491-9ee1-c71ff6338c9e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14572024-12-19T01:01:26.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e0edc1bf-59e6-4491-9ee1-c71ff6338c9e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14582024-12-19T01:01:26.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e0edc1bf-59e6-4491-9ee1-c71ff6338c9e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14592024-12-19T01:01:27.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f4ef1fbf-9065-4a38-87ec-0fcb64f4dc7e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14602024-12-19T01:01:27.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f4ef1fbf-9065-4a38-87ec-0fcb64f4dc7e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14612024-12-19T01:01:27.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f4ef1fbf-9065-4a38-87ec-0fcb64f4dc7e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14622024-12-19T01:01:28.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c492124b-d31d-4495-b028-4bbf0a414a05 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14632024-12-19T01:01:28.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c492124b-d31d-4495-b028-4bbf0a414a05 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14642024-12-19T01:01:28.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c492124b-d31d-4495-b028-4bbf0a414a05 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14652024-12-19T01:01:30.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2d3b8332-7bbc-4de6-b32c-2f6ceb25b301 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14662024-12-19T01:01:30.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2d3b8332-7bbc-4de6-b32c-2f6ceb25b301 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14672024-12-19T01:01:30.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2d3b8332-7bbc-4de6-b32c-2f6ceb25b301 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14682024-12-19T01:01:31.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c0e39ddb-ca97-459b-a9cc-f325926b002a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14692024-12-19T01:01:31.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c0e39ddb-ca97-459b-a9cc-f325926b002a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14702024-12-19T01:01:31.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c0e39ddb-ca97-459b-a9cc-f325926b002a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14712024-12-19T01:01:31.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
14722024-12-19T01:01:31.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
14732024-12-19T01:01:31.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14742024-12-19T01:01:31.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14752024-12-19T01:01:31.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14762024-12-19T01:01:31.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14772024-12-19T01:01:31.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14782024-12-19T01:01:31.405ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14792024-12-19T01:01:31.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14802024-12-19T01:01:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14812024-12-19T01:01:31.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14822024-12-19T01:01:31.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14832024-12-19T01:01:31.409ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14842024-12-19T01:01:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14852024-12-19T01:01:31.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14862024-12-19T01:01:31.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
14872024-12-19T01:01:31.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14882024-12-19T01:01:31.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14892024-12-19T01:01:31.424ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
14902024-12-19T01:01:31.424ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.460002ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
14912024-12-19T01:01:31.434ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.991402ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14922024-12-19T01:01:32.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 97ba1aec-cd41-40df-b513-3694f3c2258a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14932024-12-19T01:01:32.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 97ba1aec-cd41-40df-b513-3694f3c2258a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14942024-12-19T01:01:32.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 97ba1aec-cd41-40df-b513-3694f3c2258a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14952024-12-19T01:01:33.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c255a105-5655-404a-b744-31ac1b6bcaee roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14962024-12-19T01:01:33.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c255a105-5655-404a-b744-31ac1b6bcaee resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14972024-12-19T01:01:33.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c255a105-5655-404a-b744-31ac1b6bcaee response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
14982024-12-19T01:01:33.757ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
14992024-12-19T01:01:33.757ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
15002024-12-19T01:01:33.787ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
15012024-12-19T01:01:33.787ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:48122
15022024-12-19T01:01:33.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48122 req_id = 455f762c-5b7b-4ddb-a35f-5b78444c0cdb roles = RoleSet { roles: {} } uri = /metrics/producers
15032024-12-19T01:01:33.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48122 req_id = 455f762c-5b7b-4ddb-a35f-5b78444c0cdb resource = Database result = Ok(()) uri = /metrics/producers
15042024-12-19T01:01:33.821ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
15052024-12-19T01:01:33.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33400 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:48122 req_id = 455f762c-5b7b-4ddb-a35f-5b78444c0cdb response_code = 201 uri = /metrics/producers
15062024-12-19T01:01:33.821ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "455f762c-5b7b-4ddb-a35f-5b78444c0cdb", "content-length": "41", "date": "Thu, 19 Dec 2024 01:01:33 GMT"} })
15072024-12-19T01:01:33.823ZDEBGnexus (producer-registration-task): registered with nexus successfully
15082024-12-19T01:01:33.823ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
15092024-12-19T01:01:34.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4e189d2e-d597-45f0-bee8-805b2cea9609 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15102024-12-19T01:01:34.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4e189d2e-d597-45f0-bee8-805b2cea9609 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15112024-12-19T01:01:34.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4e189d2e-d597-45f0-bee8-805b2cea9609 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15122024-12-19T01:01:35.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a0d1184a-f01d-431a-a288-92da26bb29b3 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15132024-12-19T01:01:35.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a0d1184a-f01d-431a-a288-92da26bb29b3 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15142024-12-19T01:01:35.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a0d1184a-f01d-431a-a288-92da26bb29b3 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15152024-12-19T01:01:35.769ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1401 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 7e9dad80-557a-42a8-a208-179e9fe5bb85 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
15162024-12-19T01:01:36.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1151e1c3-6068-48bd-9f19-d96fd7ed3623 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15172024-12-19T01:01:36.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1151e1c3-6068-48bd-9f19-d96fd7ed3623 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15182024-12-19T01:01:36.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1151e1c3-6068-48bd-9f19-d96fd7ed3623 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15192024-12-19T01:01:37.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fc4d707c-1981-4ddf-8204-d23f7e6583ac roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15202024-12-19T01:01:37.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fc4d707c-1981-4ddf-8204-d23f7e6583ac resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15212024-12-19T01:01:37.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1775 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fc4d707c-1981-4ddf-8204-d23f7e6583ac response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15222024-12-19T01:01:38.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 996b21b9-c9dd-4392-9b8a-4444e2ff9877 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15232024-12-19T01:01:38.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 996b21b9-c9dd-4392-9b8a-4444e2ff9877 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15242024-12-19T01:01:38.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 996b21b9-c9dd-4392-9b8a-4444e2ff9877 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15252024-12-19T01:01:39.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 953347ce-b55a-4b39-a4da-6ebd72cbf9d6 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15262024-12-19T01:01:39.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 953347ce-b55a-4b39-a4da-6ebd72cbf9d6 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15272024-12-19T01:01:39.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 953347ce-b55a-4b39-a4da-6ebd72cbf9d6 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15282024-12-19T01:01:40.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6f4f9c7f-25ba-47d8-8e59-8cb1f214825d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15292024-12-19T01:01:40.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6f4f9c7f-25ba-47d8-8e59-8cb1f214825d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15302024-12-19T01:01:40.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6f4f9c7f-25ba-47d8-8e59-8cb1f214825d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15312024-12-19T01:01:41.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 79efa032-c85c-47b8-989f-6ad2c5b73a9b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15322024-12-19T01:01:41.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 79efa032-c85c-47b8-989f-6ad2c5b73a9b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15332024-12-19T01:01:41.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 79efa032-c85c-47b8-989f-6ad2c5b73a9b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15342024-12-19T01:01:41.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
15352024-12-19T01:01:41.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
15362024-12-19T01:01:41.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15372024-12-19T01:01:41.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15382024-12-19T01:01:41.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15392024-12-19T01:01:41.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15402024-12-19T01:01:41.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15412024-12-19T01:01:41.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15422024-12-19T01:01:41.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.47242ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15432024-12-19T01:01:41.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15442024-12-19T01:01:41.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15452024-12-19T01:01:41.410ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15462024-12-19T01:01:41.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15472024-12-19T01:01:41.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15482024-12-19T01:01:41.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15492024-12-19T01:01:41.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15502024-12-19T01:01:41.416ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
15512024-12-19T01:01:41.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15522024-12-19T01:01:41.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15532024-12-19T01:01:41.427ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
15542024-12-19T01:01:41.427ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.463569ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
15552024-12-19T01:01:42.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3e629d7f-faf3-4821-8ba7-51558b95eadb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15562024-12-19T01:01:42.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3e629d7f-faf3-4821-8ba7-51558b95eadb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15572024-12-19T01:01:42.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3e629d7f-faf3-4821-8ba7-51558b95eadb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15582024-12-19T01:01:43.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d87800eb-1fbd-459a-a7f8-203b96f4eb76 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15592024-12-19T01:01:43.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d87800eb-1fbd-459a-a7f8-203b96f4eb76 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15602024-12-19T01:01:43.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d87800eb-1fbd-459a-a7f8-203b96f4eb76 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15612024-12-19T01:01:44.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 73496097-0d14-488a-b7f0-8df205d1fae2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15622024-12-19T01:01:44.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 73496097-0d14-488a-b7f0-8df205d1fae2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15632024-12-19T01:01:44.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1686 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 73496097-0d14-488a-b7f0-8df205d1fae2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15642024-12-19T01:01:45.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 212ce0fb-b18c-4ee8-801f-199a4d01e2da roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15652024-12-19T01:01:45.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 212ce0fb-b18c-4ee8-801f-199a4d01e2da resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15662024-12-19T01:01:45.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 212ce0fb-b18c-4ee8-801f-199a4d01e2da response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15672024-12-19T01:01:45.769ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1323 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = d386e0b7-c0ba-407a-b21e-c8961c5aea7a response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
15682024-12-19T01:01:46.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 319e380b-bf7c-4e8c-b063-4ff4531047e7 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15692024-12-19T01:01:46.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 319e380b-bf7c-4e8c-b063-4ff4531047e7 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15702024-12-19T01:01:46.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 319e380b-bf7c-4e8c-b063-4ff4531047e7 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15712024-12-19T01:01:47.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1a3c273c-696c-4990-837d-d0a6691cd1e2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15722024-12-19T01:01:47.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1a3c273c-696c-4990-837d-d0a6691cd1e2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15732024-12-19T01:01:47.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1891 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1a3c273c-696c-4990-837d-d0a6691cd1e2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15742024-12-19T01:01:48.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3d6ba3c6-e61f-4532-a2ae-55d10009485c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15752024-12-19T01:01:48.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3d6ba3c6-e61f-4532-a2ae-55d10009485c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15762024-12-19T01:01:48.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3d6ba3c6-e61f-4532-a2ae-55d10009485c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15772024-12-19T01:01:49.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e18e0d6-8746-44f2-8607-481af53623ab roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15782024-12-19T01:01:49.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e18e0d6-8746-44f2-8607-481af53623ab resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15792024-12-19T01:01:49.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e18e0d6-8746-44f2-8607-481af53623ab response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15802024-12-19T01:01:50.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9831ec82-b4c1-4cce-b643-771cd074aa56 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15812024-12-19T01:01:50.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9831ec82-b4c1-4cce-b643-771cd074aa56 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15822024-12-19T01:01:50.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9831ec82-b4c1-4cce-b643-771cd074aa56 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
15832024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
15842024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
15852024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15862024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15872024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
15882024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
15892024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
15902024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15912024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
15922024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
15932024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15942024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
15952024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
15962024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15972024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
15982024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15992024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16002024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16012024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
16022024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16032024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
16042024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16052024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
16062024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16072024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
16082024-12-19T01:01:51.372ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16092024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
16102024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16112024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
16122024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16132024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16142024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
16152024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16162024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
16172024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16182024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16192024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16202024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16212024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16222024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16232024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16242024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16252024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16262024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16272024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16282024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16292024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16302024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16312024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16322024-12-19T01:01:51.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16332024-12-19T01:01:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16342024-12-19T01:01:51.375ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1000, tv_nsec: 220904437 } })
16352024-12-19T01:01:51.375ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1000, tv_nsec: 221024829 } })
16362024-12-19T01:01:51.376ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
16372024-12-19T01:01:51.376ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
16382024-12-19T01:01:51.376ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.254007ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16392024-12-19T01:01:51.377ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16402024-12-19T01:01:51.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16412024-12-19T01:01:51.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16422024-12-19T01:01:51.380ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16432024-12-19T01:01:51.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16442024-12-19T01:01:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16452024-12-19T01:01:51.381ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16462024-12-19T01:01:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16472024-12-19T01:01:51.382ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16482024-12-19T01:01:51.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16492024-12-19T01:01:51.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16502024-12-19T01:01:51.385ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16512024-12-19T01:01:51.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16522024-12-19T01:01:51.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16532024-12-19T01:01:51.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16542024-12-19T01:01:51.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16552024-12-19T01:01:51.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16562024-12-19T01:01:51.391ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1000, tv_nsec: 236983325 } })
16572024-12-19T01:01:51.392ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
16582024-12-19T01:01:51.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16592024-12-19T01:01:51.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16602024-12-19T01:01:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16612024-12-19T01:01:51.394ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16622024-12-19T01:01:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16632024-12-19T01:01:51.425ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16642024-12-19T01:01:51.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16652024-12-19T01:01:51.427ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.322051ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
16662024-12-19T01:01:51.429ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16672024-12-19T01:01:51.431ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16682024-12-19T01:01:51.431ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
16692024-12-19T01:01:51.431ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16702024-12-19T01:01:51.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.997781ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
16712024-12-19T01:01:51.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16722024-12-19T01:01:51.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16732024-12-19T01:01:51.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16742024-12-19T01:01:51.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16752024-12-19T01:01:51.433ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16762024-12-19T01:01:51.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16772024-12-19T01:01:51.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16782024-12-19T01:01:51.435ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16792024-12-19T01:01:51.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16802024-12-19T01:01:51.435ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16812024-12-19T01:01:51.435ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16822024-12-19T01:01:51.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16832024-12-19T01:01:51.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16842024-12-19T01:01:51.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16852024-12-19T01:01:51.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 65.611811ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16862024-12-19T01:01:51.438ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16872024-12-19T01:01:51.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16882024-12-19T01:01:51.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16892024-12-19T01:01:51.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16902024-12-19T01:01:51.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16912024-12-19T01:01:51.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16922024-12-19T01:01:51.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 73.295295ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16932024-12-19T01:01:51.447ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16942024-12-19T01:01:51.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16952024-12-19T01:01:51.448ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16962024-12-19T01:01:51.448ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16972024-12-19T01:01:51.448ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf66603a-5425-4a83-8f58-bb7b09a50d0b", "content-length": "26", "date": "Thu, 19 Dec 2024 01:01:51 GMT"} })
16982024-12-19T01:01:51.448ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16992024-12-19T01:01:51.449ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
17002024-12-19T01:01:51.449ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17012024-12-19T01:01:51.449ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d650e1ec-5ae7-4aa6-8743-c44a0e727a4a", "content-length": "26", "date": "Thu, 19 Dec 2024 01:01:51 GMT"} })
17022024-12-19T01:01:51.450ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17032024-12-19T01:01:51.450ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17042024-12-19T01:01:51.452ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17052024-12-19T01:01:51.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a57bf93d-f284-4441-b6bc-cea393e53dbb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
17062024-12-19T01:01:51.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a57bf93d-f284-4441-b6bc-cea393e53dbb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
17072024-12-19T01:01:51.461ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 88.823156ms iteration = 11 status = {"physical_disks_added":0}
17082024-12-19T01:01:51.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2611 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a57bf93d-f284-4441-b6bc-cea393e53dbb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
17092024-12-19T01:01:51.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17102024-12-19T01:01:51.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17112024-12-19T01:01:51.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17122024-12-19T01:01:51.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
17132024-12-19T01:01:51.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17142024-12-19T01:01:51.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17152024-12-19T01:01:51.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17162024-12-19T01:01:51.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17172024-12-19T01:01:51.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 96.879006ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17182024-12-19T01:01:51.470ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17192024-12-19T01:01:51.473ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
17202024-12-19T01:01:51.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
17212024-12-19T01:01:51.473ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17222024-12-19T01:01:51.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17232024-12-19T01:01:51.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17242024-12-19T01:01:51.473ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8184b5f1-0604-456a-9bd5-6b8412814148", "content-length": "26", "date": "Thu, 19 Dec 2024 01:01:51 GMT"} })
17252024-12-19T01:01:51.473ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17262024-12-19T01:01:51.474ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
17272024-12-19T01:01:51.475ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
17282024-12-19T01:01:51.475ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.878587ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
17292024-12-19T01:01:51.475ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 103.237701ms iteration = 8 status = 0
17302024-12-19T01:01:51.475ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17312024-12-19T01:01:51.475ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17322024-12-19T01:01:51.475ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17332024-12-19T01:01:51.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17342024-12-19T01:01:51.479ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.84453ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
17352024-12-19T01:01:51.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17362024-12-19T01:01:51.484ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17372024-12-19T01:01:51.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17382024-12-19T01:01:51.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17392024-12-19T01:01:51.486ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17402024-12-19T01:01:51.486ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.640333ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17412024-12-19T01:01:51.508ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17422024-12-19T01:01:51.508ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17432024-12-19T01:01:51.508ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 136.433763ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17442024-12-19T01:01:51.537ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 165.04545ms iteration = 8 status = {}
17452024-12-19T01:01:51.549ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17462024-12-19T01:01:51.549ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "143fd0ff-6516-4740-b10e-2d46a2e4a9e3", "content-length": "1", "date": "Thu, 19 Dec 2024 01:01:50 GMT"} })
17472024-12-19T01:01:51.551ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17482024-12-19T01:01:51.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17492024-12-19T01:01:51.553ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 181.380463ms iteration = 8 status = null
17502024-12-19T01:01:51.556ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17512024-12-19T01:01:51.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17522024-12-19T01:01:51.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17532024-12-19T01:01:51.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17542024-12-19T01:01:51.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17552024-12-19T01:01:51.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17562024-12-19T01:01:51.580ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17572024-12-19T01:01:51.580ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17582024-12-19T01:01:51.580ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a0dcd44-8507-42fb-a4da-ae5052192568", "content-length": "372", "date": "Thu, 19 Dec 2024 01:01:51 GMT"} })
17592024-12-19T01:01:51.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17602024-12-19T01:01:51.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17612024-12-19T01:01:51.627ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17622024-12-19T01:01:51.630ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17632024-12-19T01:01:51.630ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17642024-12-19T01:01:51.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17652024-12-19T01:01:51.642ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
17662024-12-19T01:01:51.642ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17672024-12-19T01:01:51.642ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "145f5d46-f44f-4bf0-8c26-fe345a37cf72", "date": "Thu, 19 Dec 2024 01:01:51 GMT"} })
17682024-12-19T01:01:51.642ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17692024-12-19T01:01:51.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17702024-12-19T01:01:51.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17712024-12-19T01:01:51.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17722024-12-19T01:01:51.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17732024-12-19T01:01:51.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17742024-12-19T01:01:51.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17752024-12-19T01:01:51.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17762024-12-19T01:01:51.672ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17772024-12-19T01:01:51.675ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
17782024-12-19T01:01:51.675ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17792024-12-19T01:01:51.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17802024-12-19T01:01:51.676ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17812024-12-19T01:01:51.676ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17822024-12-19T01:01:51.685ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17832024-12-19T01:01:51.686ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0854f81-605a-403b-bec3-b991e723da75", "content-length": "134", "date": "Thu, 19 Dec 2024 01:01:50 GMT"} })
17842024-12-19T01:01:51.686ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17852024-12-19T01:01:51.686ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
17862024-12-19T01:01:51.686ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17872024-12-19T01:01:51.686ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17882024-12-19T01:01:51.686ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17892024-12-19T01:01:51.686ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17902024-12-19T01:01:51.686ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17912024-12-19T01:01:51.686ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17922024-12-19T01:01:51.686ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17932024-12-19T01:01:51.686ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17942024-12-19T01:01:51.687ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
17952024-12-19T01:01:51.687ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17962024-12-19T01:01:51.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17972024-12-19T01:01:51.699ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17982024-12-19T01:01:51.700ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4738ae6-3f4f-4a9e-898a-fe21e937dfef", "content-length": "2", "date": "Thu, 19 Dec 2024 01:01:50 GMT"} })
17992024-12-19T01:01:51.700ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18002024-12-19T01:01:51.700ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a529035-6367-413d-b14f-914cf80b1ebe", "content-length": "52", "date": "Thu, 19 Dec 2024 01:01:50 GMT"} })
18012024-12-19T01:01:51.700ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
18022024-12-19T01:01:51.700ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18032024-12-19T01:01:51.761ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "52c3dff1-87c1-4e89-85ea-4e8df1008092", "content-length": "691", "date": "Thu, 19 Dec 2024 01:01:51 GMT"} })
18042024-12-19T01:01:51.761ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
18052024-12-19T01:01:51.761ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18062024-12-19T01:01:51.761ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18072024-12-19T01:01:51.761ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a512e307-f537-4ad0-9e89-0bb91d59ad80", "date": "Thu, 19 Dec 2024 01:01:51 GMT"} })
18082024-12-19T01:01:51.763ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 391.02625ms iteration = 9 status = {}
18092024-12-19T01:01:51.763ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 391.430775ms iteration = 8 status = {}
18102024-12-19T01:01:51.859ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "033a9d3f-458f-4568-aea5-652003344baf", "date": "Thu, 19 Dec 2024 01:01:51 GMT"} })
18112024-12-19T01:01:51.859ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
18122024-12-19T01:01:51.859ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18132024-12-19T01:01:51.859ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "adb504b4-4c9d-427e-ac61-7a388c082b15", "content-length": "682", "date": "Thu, 19 Dec 2024 01:01:51 GMT"} })
18142024-12-19T01:01:51.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18152024-12-19T01:01:51.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18162024-12-19T01:01:51.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18172024-12-19T01:01:51.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18182024-12-19T01:01:51.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18192024-12-19T01:01:51.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18202024-12-19T01:01:51.869ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18212024-12-19T01:01:51.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18222024-12-19T01:01:51.876ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 504.567382ms iteration = 8 status = {}
18232024-12-19T01:01:52.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bfd9d765-4d09-4ee9-befb-113936d51b80 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18242024-12-19T01:01:52.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bfd9d765-4d09-4ee9-befb-113936d51b80 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18252024-12-19T01:01:52.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = ae15ac10-030e-4ac5-9553-5f11d10e45d5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
18262024-12-19T01:01:52.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = ae15ac10-030e-4ac5-9553-5f11d10e45d5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
18272024-12-19T01:01:52.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bfd9d765-4d09-4ee9-befb-113936d51b80 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18282024-12-19T01:01:52.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = ae15ac10-030e-4ac5-9553-5f11d10e45d5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
18292024-12-19T01:01:53.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fe60a583-ba8a-445a-b748-c3262e3f807b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18302024-12-19T01:01:53.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fe60a583-ba8a-445a-b748-c3262e3f807b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18312024-12-19T01:01:53.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fe60a583-ba8a-445a-b748-c3262e3f807b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18322024-12-19T01:01:54.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a72a2930-449c-4e3b-b4d4-78dbc6c30139 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18332024-12-19T01:01:54.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a72a2930-449c-4e3b-b4d4-78dbc6c30139 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18342024-12-19T01:01:54.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a72a2930-449c-4e3b-b4d4-78dbc6c30139 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18352024-12-19T01:01:55.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b46bac3b-afcb-4009-87d2-071617b22bd4 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18362024-12-19T01:01:55.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b46bac3b-afcb-4009-87d2-071617b22bd4 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18372024-12-19T01:01:55.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b46bac3b-afcb-4009-87d2-071617b22bd4 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18382024-12-19T01:01:55.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1445 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = d1ce4b85-e261-4b9d-a55a-83d06f1eddf1 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
18392024-12-19T01:01:56.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a6140d50-2fd7-4e5e-8c64-fd311e433a61 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18402024-12-19T01:01:56.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a6140d50-2fd7-4e5e-8c64-fd311e433a61 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18412024-12-19T01:01:56.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a6140d50-2fd7-4e5e-8c64-fd311e433a61 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18422024-12-19T01:01:57.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = eae17fb3-ecb0-43bb-a10a-1bb35b4a3a3f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18432024-12-19T01:01:57.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = eae17fb3-ecb0-43bb-a10a-1bb35b4a3a3f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18442024-12-19T01:01:57.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = eae17fb3-ecb0-43bb-a10a-1bb35b4a3a3f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18452024-12-19T01:01:58.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e8d5e11c-9678-46e7-afe3-b19283823b50 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18462024-12-19T01:01:58.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e8d5e11c-9678-46e7-afe3-b19283823b50 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18472024-12-19T01:01:58.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e8d5e11c-9678-46e7-afe3-b19283823b50 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18482024-12-19T01:01:59.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 233ae24a-bbcd-4c54-a745-59d82af8f7dd roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18492024-12-19T01:01:59.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 233ae24a-bbcd-4c54-a745-59d82af8f7dd resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18502024-12-19T01:01:59.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 233ae24a-bbcd-4c54-a745-59d82af8f7dd response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18512024-12-19T01:02:00.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 736a8be9-1670-41e1-982c-e75651a241a6 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18522024-12-19T01:02:00.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 736a8be9-1670-41e1-982c-e75651a241a6 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18532024-12-19T01:02:00.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 736a8be9-1670-41e1-982c-e75651a241a6 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18542024-12-19T01:02:01.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
18552024-12-19T01:02:01.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
18562024-12-19T01:02:01.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18572024-12-19T01:02:01.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18582024-12-19T01:02:01.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18592024-12-19T01:02:01.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18602024-12-19T01:02:01.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18612024-12-19T01:02:01.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18622024-12-19T01:02:01.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18632024-12-19T01:02:01.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.254548ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18642024-12-19T01:02:01.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18652024-12-19T01:02:01.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18662024-12-19T01:02:01.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18672024-12-19T01:02:01.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18682024-12-19T01:02:01.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18692024-12-19T01:02:01.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18702024-12-19T01:02:01.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
18712024-12-19T01:02:01.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18722024-12-19T01:02:01.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18732024-12-19T01:02:01.390ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
18742024-12-19T01:02:01.390ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.806321ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
18752024-12-19T01:02:01.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 11ceb2e9-32a6-4578-b423-d5d6fcd9be36 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18762024-12-19T01:02:01.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 11ceb2e9-32a6-4578-b423-d5d6fcd9be36 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18772024-12-19T01:02:01.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 11ceb2e9-32a6-4578-b423-d5d6fcd9be36 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18782024-12-19T01:02:02.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f9e7b73d-abf2-4242-b98a-98d7e915ccc6 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18792024-12-19T01:02:02.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f9e7b73d-abf2-4242-b98a-98d7e915ccc6 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18802024-12-19T01:02:02.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f9e7b73d-abf2-4242-b98a-98d7e915ccc6 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18812024-12-19T01:02:03.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9ddfd825-42a3-4e6d-817a-dcd369f3ac9d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18822024-12-19T01:02:03.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9ddfd825-42a3-4e6d-817a-dcd369f3ac9d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18832024-12-19T01:02:03.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9ddfd825-42a3-4e6d-817a-dcd369f3ac9d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18842024-12-19T01:02:04.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e57fffcc-419f-46fe-8a18-cb930b8f2de0 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18852024-12-19T01:02:04.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e57fffcc-419f-46fe-8a18-cb930b8f2de0 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18862024-12-19T01:02:04.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e57fffcc-419f-46fe-8a18-cb930b8f2de0 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18872024-12-19T01:02:05.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 338e6b80-696f-4a61-8ba3-f6d59a4a832b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18882024-12-19T01:02:05.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 338e6b80-696f-4a61-8ba3-f6d59a4a832b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18892024-12-19T01:02:05.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 338e6b80-696f-4a61-8ba3-f6d59a4a832b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18902024-12-19T01:02:05.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1310 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 81e0f193-1825-4b8d-ba28-f30e22371890 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
18912024-12-19T01:02:06.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7269142f-eb47-4a38-b623-65d06e487e11 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18922024-12-19T01:02:06.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7269142f-eb47-4a38-b623-65d06e487e11 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18932024-12-19T01:02:06.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7269142f-eb47-4a38-b623-65d06e487e11 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18942024-12-19T01:02:07.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3311bac7-9f95-4ba5-99fd-078c8601309a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18952024-12-19T01:02:07.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3311bac7-9f95-4ba5-99fd-078c8601309a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18962024-12-19T01:02:07.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3311bac7-9f95-4ba5-99fd-078c8601309a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18972024-12-19T01:02:08.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 65b9e0a5-5827-44cd-88b4-36f6d3c12d22 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18982024-12-19T01:02:08.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 65b9e0a5-5827-44cd-88b4-36f6d3c12d22 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
18992024-12-19T01:02:08.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 65b9e0a5-5827-44cd-88b4-36f6d3c12d22 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19002024-12-19T01:02:09.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e50fe9ee-058f-492a-9873-ce5bbce14c37 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19012024-12-19T01:02:09.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e50fe9ee-058f-492a-9873-ce5bbce14c37 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19022024-12-19T01:02:09.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e50fe9ee-058f-492a-9873-ce5bbce14c37 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19032024-12-19T01:02:10.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fdca5946-d8fe-4aee-a0db-79915512b835 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19042024-12-19T01:02:10.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fdca5946-d8fe-4aee-a0db-79915512b835 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19052024-12-19T01:02:10.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fdca5946-d8fe-4aee-a0db-79915512b835 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19062024-12-19T01:02:11.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
19072024-12-19T01:02:11.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
19082024-12-19T01:02:11.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19092024-12-19T01:02:11.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19102024-12-19T01:02:11.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19112024-12-19T01:02:11.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19122024-12-19T01:02:11.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19132024-12-19T01:02:11.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19142024-12-19T01:02:11.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19152024-12-19T01:02:11.376ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.039945ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19162024-12-19T01:02:11.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19172024-12-19T01:02:11.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19182024-12-19T01:02:11.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19192024-12-19T01:02:11.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19202024-12-19T01:02:11.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19212024-12-19T01:02:11.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19222024-12-19T01:02:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
19232024-12-19T01:02:11.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19242024-12-19T01:02:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19252024-12-19T01:02:11.396ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
19262024-12-19T01:02:11.396ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.688171ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
19272024-12-19T01:02:11.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d33ddb8d-62a3-41d0-8434-5f027ee8ba36 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19282024-12-19T01:02:11.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d33ddb8d-62a3-41d0-8434-5f027ee8ba36 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19292024-12-19T01:02:11.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d33ddb8d-62a3-41d0-8434-5f027ee8ba36 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19302024-12-19T01:02:12.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c62ebc6d-3c8b-4a5f-87d8-4d845a3af227 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19312024-12-19T01:02:12.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c62ebc6d-3c8b-4a5f-87d8-4d845a3af227 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19322024-12-19T01:02:12.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c62ebc6d-3c8b-4a5f-87d8-4d845a3af227 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19332024-12-19T01:02:13.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 62e8e5a5-406f-4207-92cc-4fa11ba999e6 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19342024-12-19T01:02:13.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 62e8e5a5-406f-4207-92cc-4fa11ba999e6 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19352024-12-19T01:02:13.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2602 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 62e8e5a5-406f-4207-92cc-4fa11ba999e6 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19362024-12-19T01:02:14.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f819335-5ede-4688-898d-be97d25e072b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19372024-12-19T01:02:14.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f819335-5ede-4688-898d-be97d25e072b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19382024-12-19T01:02:14.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f819335-5ede-4688-898d-be97d25e072b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19392024-12-19T01:02:15.769ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1256 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 03981191-7853-4c7d-85fe-885810e51a7b response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
19402024-12-19T01:02:15.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e15b01ba-5e69-4862-aa8d-4f1f76964f32 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19412024-12-19T01:02:15.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e15b01ba-5e69-4862-aa8d-4f1f76964f32 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19422024-12-19T01:02:15.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e15b01ba-5e69-4862-aa8d-4f1f76964f32 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19432024-12-19T01:02:17.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 77da3d43-79bc-4bbb-9b2c-8c878444ec7e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19442024-12-19T01:02:17.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 77da3d43-79bc-4bbb-9b2c-8c878444ec7e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19452024-12-19T01:02:17.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 77da3d43-79bc-4bbb-9b2c-8c878444ec7e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19462024-12-19T01:02:18.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 40feee82-f88a-4a77-9403-a88b7462dc44 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19472024-12-19T01:02:18.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 40feee82-f88a-4a77-9403-a88b7462dc44 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19482024-12-19T01:02:18.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 40feee82-f88a-4a77-9403-a88b7462dc44 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19492024-12-19T01:02:19.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 89976810-db68-4f57-82c9-2b55d6116780 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19502024-12-19T01:02:19.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 89976810-db68-4f57-82c9-2b55d6116780 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19512024-12-19T01:02:19.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 89976810-db68-4f57-82c9-2b55d6116780 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19522024-12-19T01:02:20.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ddf0bdc2-e707-4333-854b-8dcd390dec09 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19532024-12-19T01:02:20.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ddf0bdc2-e707-4333-854b-8dcd390dec09 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19542024-12-19T01:02:20.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ddf0bdc2-e707-4333-854b-8dcd390dec09 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19552024-12-19T01:02:21.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3ed7fb6c-2041-4ffd-b659-244de2138545 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19562024-12-19T01:02:21.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3ed7fb6c-2041-4ffd-b659-244de2138545 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19572024-12-19T01:02:21.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3ed7fb6c-2041-4ffd-b659-244de2138545 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
19582024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
19592024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
19602024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
19612024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19622024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
19632024-12-19T01:02:21.372ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a
19642024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
19652024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.94\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a"}
19662024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
19672024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19682024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
19692024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
19702024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
19712024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
19722024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
19732024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19742024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
19752024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19762024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
19772024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19782024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
19792024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19802024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
19812024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19822024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
19832024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19842024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19852024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
19862024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19872024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
19882024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
19892024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19902024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
19912024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19922024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
19932024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19942024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
19952024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19962024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
19972024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
19982024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19992024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
20002024-12-19T01:02:21.372ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20012024-12-19T01:02:21.372ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
20022024-12-19T01:02:21.373ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
20032024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20042024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20052024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
20062024-12-19T01:02:21.373ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 00:52:21.372882437 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
20072024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
20082024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
20092024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
20102024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
20112024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20122024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
20132024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
20142024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20152024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
20162024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20172024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
20182024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20192024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
20202024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
20212024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20222024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20232024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
20242024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20252024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20262024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20272024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20282024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20292024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20302024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20312024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20322024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20332024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20342024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20352024-12-19T01:02:21.373ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a880a2e-2471-4fd8-9ad5-3e0c3fbde317.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1030, tv_nsec: 218414190 } })
20362024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20372024-12-19T01:02:21.373ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0018a454-75c0-41b1-be69-9476391f01e1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("050cdbd7-4ebc-471c-b4dc-ec1b3741f763.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1030, tv_nsec: 218406520 } })
20382024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20392024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20402024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20412024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20422024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
20432024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20442024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20452024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20462024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
20472024-12-19T01:02:21.373ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.270027ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
20482024-12-19T01:02:21.374ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
20492024-12-19T01:02:21.374ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.313738ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
20502024-12-19T01:02:21.375ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.911309ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
20512024-12-19T01:02:21.375ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.149843ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20522024-12-19T01:02:21.376ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20532024-12-19T01:02:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20542024-12-19T01:02:21.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20552024-12-19T01:02:21.377ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1030, tv_nsec: 222296193 } })
20562024-12-19T01:02:21.377ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
20572024-12-19T01:02:21.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20582024-12-19T01:02:21.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20592024-12-19T01:02:21.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20602024-12-19T01:02:21.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20612024-12-19T01:02:21.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20622024-12-19T01:02:21.382ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
20632024-12-19T01:02:21.383ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
20642024-12-19T01:02:21.383ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 10.407381ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
20652024-12-19T01:02:21.383ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20662024-12-19T01:02:21.384ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20672024-12-19T01:02:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20682024-12-19T01:02:21.386ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1030, tv_nsec: 231867683 } })
20692024-12-19T01:02:21.387ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
20702024-12-19T01:02:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20712024-12-19T01:02:21.388ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20722024-12-19T01:02:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20732024-12-19T01:02:21.389ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20742024-12-19T01:02:21.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20752024-12-19T01:02:21.389ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20762024-12-19T01:02:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20772024-12-19T01:02:21.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20782024-12-19T01:02:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20792024-12-19T01:02:21.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20802024-12-19T01:02:21.398ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20812024-12-19T01:02:21.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
20822024-12-19T01:02:21.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20832024-12-19T01:02:21.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20842024-12-19T01:02:21.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20852024-12-19T01:02:21.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20862024-12-19T01:02:21.403ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 00:52:21.372882437 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
20872024-12-19T01:02:21.403ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 30.533595ms iteration = 5 status = {"expiration":"2024-12-19T00:52:21.372882437Z","pruned":[]}
20882024-12-19T01:02:21.403ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20892024-12-19T01:02:21.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20902024-12-19T01:02:21.404ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20912024-12-19T01:02:21.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20922024-12-19T01:02:21.405ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20932024-12-19T01:02:21.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20942024-12-19T01:02:21.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20952024-12-19T01:02:21.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
20962024-12-19T01:02:21.408ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20972024-12-19T01:02:21.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20982024-12-19T01:02:21.409ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20992024-12-19T01:02:21.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
21002024-12-19T01:02:21.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21012024-12-19T01:02:21.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21022024-12-19T01:02:21.412ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21032024-12-19T01:02:21.412ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21042024-12-19T01:02:21.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21052024-12-19T01:02:21.415ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.251227ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21062024-12-19T01:02:21.416ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21072024-12-19T01:02:21.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21082024-12-19T01:02:21.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21092024-12-19T01:02:21.419ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21102024-12-19T01:02:21.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21112024-12-19T01:02:21.421ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21122024-12-19T01:02:21.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21132024-12-19T01:02:21.421ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21142024-12-19T01:02:21.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21152024-12-19T01:02:21.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21162024-12-19T01:02:21.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21172024-12-19T01:02:21.424ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21182024-12-19T01:02:21.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21192024-12-19T01:02:21.425ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1030, tv_nsec: 270395446 } })
21202024-12-19T01:02:21.425ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
21212024-12-19T01:02:21.426ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21222024-12-19T01:02:21.426ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21232024-12-19T01:02:21.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21242024-12-19T01:02:21.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21252024-12-19T01:02:21.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
21262024-12-19T01:02:21.429ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21272024-12-19T01:02:21.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21282024-12-19T01:02:21.431ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21292024-12-19T01:02:21.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
21302024-12-19T01:02:21.436ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21312024-12-19T01:02:21.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21322024-12-19T01:02:21.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.308484ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
21332024-12-19T01:02:21.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21342024-12-19T01:02:21.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21352024-12-19T01:02:21.453ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21362024-12-19T01:02:21.453ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21372024-12-19T01:02:21.453ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21382024-12-19T01:02:21.453ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21392024-12-19T01:02:21.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21402024-12-19T01:02:21.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21412024-12-19T01:02:21.456ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21422024-12-19T01:02:21.457ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21432024-12-19T01:02:21.457ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21442024-12-19T01:02:21.457ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21452024-12-19T01:02:21.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21462024-12-19T01:02:21.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21472024-12-19T01:02:21.458ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21482024-12-19T01:02:21.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21492024-12-19T01:02:21.464ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 91.34581ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
21502024-12-19T01:02:21.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
21512024-12-19T01:02:21.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.04975ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
21522024-12-19T01:02:21.470ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
21532024-12-19T01:02:21.470ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
21542024-12-19T01:02:21.470ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
21552024-12-19T01:02:21.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21562024-12-19T01:02:21.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21572024-12-19T01:02:21.471ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.316525ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
21582024-12-19T01:02:21.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21592024-12-19T01:02:21.476ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
21602024-12-19T01:02:21.476ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
21612024-12-19T01:02:21.476ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
21622024-12-19T01:02:21.476ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21632024-12-19T01:02:21.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21642024-12-19T01:02:21.478ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
21652024-12-19T01:02:21.478ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
21662024-12-19T01:02:21.478ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 105.654184ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
21672024-12-19T01:02:21.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21682024-12-19T01:02:21.479ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21692024-12-19T01:02:21.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21702024-12-19T01:02:21.481ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21712024-12-19T01:02:21.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21722024-12-19T01:02:21.482ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21732024-12-19T01:02:21.482ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 109.968443ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21742024-12-19T01:02:21.485ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
21752024-12-19T01:02:21.485ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
21762024-12-19T01:02:21.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21772024-12-19T01:02:21.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21782024-12-19T01:02:21.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21792024-12-19T01:02:21.491ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21802024-12-19T01:02:21.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21812024-12-19T01:02:21.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21822024-12-19T01:02:21.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21832024-12-19T01:02:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21842024-12-19T01:02:21.494ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21852024-12-19T01:02:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21862024-12-19T01:02:21.496ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
21872024-12-19T01:02:21.496ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
21882024-12-19T01:02:21.496ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 00:59:01.994004 UTC dns_group = internal generation = 1
21892024-12-19T01:02:21.496ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 123.590688ms iteration = 6 status = {"generation":1}
21902024-12-19T01:02:21.502ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 129.510928ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21912024-12-19T01:02:21.503ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 130.575313ms iteration = 12 status = {"physical_disks_added":0}
21922024-12-19T01:02:21.522ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21932024-12-19T01:02:21.523ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
21942024-12-19T01:02:21.523ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 150.305891ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
21952024-12-19T01:02:21.533ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T00:58:19.687181Z, time_modified: 2024-12-19T00:58:19.687181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }) }
21962024-12-19T01:02:21.533ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 160.787143ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]}},"default_endpoint":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
21972024-12-19T01:02:21.534ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
21982024-12-19T01:02:21.535ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21992024-12-19T01:02:21.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 163.151395ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
22002024-12-19T01:02:21.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22012024-12-19T01:02:21.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22022024-12-19T01:02:21.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22032024-12-19T01:02:21.542ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
22042024-12-19T01:02:21.542ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 0 version = 2
22052024-12-19T01:02:21.542ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22062024-12-19T01:02:21.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22072024-12-19T01:02:21.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22082024-12-19T01:02:21.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22092024-12-19T01:02:21.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22102024-12-19T01:02:21.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22112024-12-19T01:02:21.547ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
22122024-12-19T01:02:21.548ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22132024-12-19T01:02:21.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22142024-12-19T01:02:21.549ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 1 version = 2
22152024-12-19T01:02:21.549ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
22162024-12-19T01:02:21.549ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 00:59:02.707744 UTC dns_group = external generation = 2
22172024-12-19T01:02:21.549ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 176.099172ms iteration = 6 status = {"generation":2}
22182024-12-19T01:02:21.563ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
22192024-12-19T01:02:21.563ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 190.289574ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
22202024-12-19T01:02:21.563ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
22212024-12-19T01:02:21.563ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22222024-12-19T01:02:21.564ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b7cb780-3d7a-4171-9f36-e75558c3ce01", "content-length": "26", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} })
22232024-12-19T01:02:21.564ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22242024-12-19T01:02:21.566ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22252024-12-19T01:02:21.568ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
22262024-12-19T01:02:21.568ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22272024-12-19T01:02:21.568ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b84a9b85-574d-4d91-93d3-cc807c3313f2", "content-length": "26", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} })
22282024-12-19T01:02:21.568ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22292024-12-19T01:02:21.570ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22302024-12-19T01:02:21.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22312024-12-19T01:02:21.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22322024-12-19T01:02:21.663ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22332024-12-19T01:02:21.665ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22342024-12-19T01:02:21.665ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22352024-12-19T01:02:21.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22362024-12-19T01:02:21.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22372024-12-19T01:02:21.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22382024-12-19T01:02:21.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22392024-12-19T01:02:21.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22402024-12-19T01:02:21.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22412024-12-19T01:02:21.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22422024-12-19T01:02:21.678ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22432024-12-19T01:02:21.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22442024-12-19T01:02:21.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22452024-12-19T01:02:21.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
22462024-12-19T01:02:21.683ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22472024-12-19T01:02:21.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22482024-12-19T01:02:21.685ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 312.875769ms iteration = 9 status = 0
22492024-12-19T01:02:21.745ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22502024-12-19T01:02:21.745ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22512024-12-19T01:02:21.745ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc0e1ee1-df61-4778-865b-ab27c070b9bb", "content-length": "372", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} })
22522024-12-19T01:02:21.745ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22532024-12-19T01:02:21.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22542024-12-19T01:02:21.746ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
22552024-12-19T01:02:21.772ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
22562024-12-19T01:02:21.772ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22572024-12-19T01:02:21.772ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "afc27ad1-2a2e-4baf-9db1-6a1071b0274f", "content-length": "26", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} })
22582024-12-19T01:02:21.772ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22592024-12-19T01:02:21.774ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
22602024-12-19T01:02:21.855ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22612024-12-19T01:02:21.855ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "abe5c278-ec00-43d6-b916-f18562b68962", "content-length": "691", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} })
22622024-12-19T01:02:21.855ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
22632024-12-19T01:02:21.855ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
22642024-12-19T01:02:21.855ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
22652024-12-19T01:02:21.857ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 484.864243ms iteration = 9 status = {}
22662024-12-19T01:02:21.912ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
22672024-12-19T01:02:21.912ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
22682024-12-19T01:02:21.912ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "53e74b79-61a4-4c05-a009-8b2c068135a2", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} })
22692024-12-19T01:02:21.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22702024-12-19T01:02:21.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22712024-12-19T01:02:21.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22722024-12-19T01:02:21.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22732024-12-19T01:02:21.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22742024-12-19T01:02:21.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22752024-12-19T01:02:21.920ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
22762024-12-19T01:02:21.920ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22772024-12-19T01:02:21.920ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22782024-12-19T01:02:21.920ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "243dc9bc-689e-436c-913c-2114487fe1c2", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22792024-12-19T01:02:21.920ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22802024-12-19T01:02:21.920ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dc93fbe7-a931-449f-83a6-64b32d13b76b", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} })
22812024-12-19T01:02:21.923ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 550.21196ms iteration = 10 status = {}
22822024-12-19T01:02:21.923ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f8b7aef0-0517-421c-8691-95009655528a", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22832024-12-19T01:02:21.923ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22842024-12-19T01:02:21.924ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "68644954-1f23-4dfa-a80c-545e7fd67b9a", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22852024-12-19T01:02:21.924ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22862024-12-19T01:02:21.926ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22872024-12-19T01:02:21.926ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 554.013132ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
22882024-12-19T01:02:21.940ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
22892024-12-19T01:02:21.940ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "224735ca-73c6-4468-8736-75b86b0643ae", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22902024-12-19T01:02:21.940ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22912024-12-19T01:02:21.942ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "58b5648e-be65-4f41-931b-03b8402c3efb", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22922024-12-19T01:02:21.942ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22932024-12-19T01:02:21.943ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22942024-12-19T01:02:21.943ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 570.400105ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
22952024-12-19T01:02:21.953ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 580.772845ms iteration = 9 status = {}
22962024-12-19T01:02:21.954ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
22972024-12-19T01:02:21.955ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fae123f-0971-4449-a4d2-95fcde06d1a9", "content-length": "1", "date": "Thu, 19 Dec 2024 01:02:20 GMT"} })
22982024-12-19T01:02:21.956ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22992024-12-19T01:02:21.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23002024-12-19T01:02:21.958ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 586.039757ms iteration = 9 status = null
23012024-12-19T01:02:22.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23022024-12-19T01:02:22.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23032024-12-19T01:02:22.011ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
23042024-12-19T01:02:22.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23052024-12-19T01:02:22.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23062024-12-19T01:02:22.022ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
23072024-12-19T01:02:22.022ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ddc1ab7-77a7-4821-a25a-327af73539f0", "content-length": "134", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} })
23082024-12-19T01:02:22.022ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
23092024-12-19T01:02:22.022ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
23102024-12-19T01:02:22.022ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
23112024-12-19T01:02:22.022ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
23122024-12-19T01:02:22.022ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23132024-12-19T01:02:22.022ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23142024-12-19T01:02:22.022ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23152024-12-19T01:02:22.022ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
23162024-12-19T01:02:22.022ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
23172024-12-19T01:02:22.022ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
23182024-12-19T01:02:22.023ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
23192024-12-19T01:02:22.023ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23202024-12-19T01:02:22.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23212024-12-19T01:02:22.025ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
23222024-12-19T01:02:22.025ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1b56e3a-d47e-43e0-a08f-1f6ac7989370", "content-length": "2", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} })
23232024-12-19T01:02:22.025ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
23242024-12-19T01:02:22.025ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e33f6f8b-67b7-4ad0-92f6-d72bfe33594e", "content-length": "52", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} })
23252024-12-19T01:02:22.025ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
23262024-12-19T01:02:22.025ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
23272024-12-19T01:02:22.150ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e8e6885a-6b44-4263-95f4-66f3f8fb8717", "date": "Thu, 19 Dec 2024 01:02:21 GMT"} })
23282024-12-19T01:02:22.150ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
23292024-12-19T01:02:22.150ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
23302024-12-19T01:02:22.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = be204cc4-8b71-4f50-a85e-a5f33a4109bc roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23312024-12-19T01:02:22.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = be204cc4-8b71-4f50-a85e-a5f33a4109bc resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23322024-12-19T01:02:22.151ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6434fc42-fbf5-426e-8269-ccee62ba13c0", "content-length": "682", "date": "Thu, 19 Dec 2024 01:02:22 GMT"} })
23332024-12-19T01:02:22.151ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23342024-12-19T01:02:22.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23352024-12-19T01:02:22.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1912 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = be204cc4-8b71-4f50-a85e-a5f33a4109bc response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23362024-12-19T01:02:22.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23372024-12-19T01:02:22.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23382024-12-19T01:02:22.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23392024-12-19T01:02:22.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23402024-12-19T01:02:22.163ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23412024-12-19T01:02:22.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23422024-12-19T01:02:22.169ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 796.90333ms iteration = 9 status = {}
23432024-12-19T01:02:22.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = d9f3853f-a616-4d72-825e-a1488c3bed03 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
23442024-12-19T01:02:22.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = d9f3853f-a616-4d72-825e-a1488c3bed03 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
23452024-12-19T01:02:22.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = d9f3853f-a616-4d72-825e-a1488c3bed03 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
23462024-12-19T01:02:23.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f68a199-7d98-4218-a767-a87475f2ee78 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23472024-12-19T01:02:23.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f68a199-7d98-4218-a767-a87475f2ee78 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23482024-12-19T01:02:23.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f68a199-7d98-4218-a767-a87475f2ee78 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23492024-12-19T01:02:24.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e6de6d17-9247-433e-a046-e8b1f55fc956 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23502024-12-19T01:02:24.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e6de6d17-9247-433e-a046-e8b1f55fc956 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23512024-12-19T01:02:24.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e6de6d17-9247-433e-a046-e8b1f55fc956 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23522024-12-19T01:02:25.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 44ea4576-1b77-4dab-9a0f-889f42c2a708 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23532024-12-19T01:02:25.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 44ea4576-1b77-4dab-9a0f-889f42c2a708 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23542024-12-19T01:02:25.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 44ea4576-1b77-4dab-9a0f-889f42c2a708 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23552024-12-19T01:02:25.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1456 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 3a9c5b57-4c60-4200-a781-3ed294e035dc response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
23562024-12-19T01:02:26.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bf34c5d3-5553-4cc8-af0b-a983b7418c31 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23572024-12-19T01:02:26.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bf34c5d3-5553-4cc8-af0b-a983b7418c31 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23582024-12-19T01:02:26.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bf34c5d3-5553-4cc8-af0b-a983b7418c31 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23592024-12-19T01:02:27.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 62663ab2-c9c6-4e65-99f5-7cd6e2c3efa9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23602024-12-19T01:02:27.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 62663ab2-c9c6-4e65-99f5-7cd6e2c3efa9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23612024-12-19T01:02:27.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 62663ab2-c9c6-4e65-99f5-7cd6e2c3efa9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23622024-12-19T01:02:28.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 50e21d66-ba03-4ed6-be59-3440b29e7ea2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23632024-12-19T01:02:28.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 50e21d66-ba03-4ed6-be59-3440b29e7ea2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23642024-12-19T01:02:28.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 50e21d66-ba03-4ed6-be59-3440b29e7ea2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23652024-12-19T01:02:29.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4e7a194f-6191-4d33-8fa9-a75a563183b2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23662024-12-19T01:02:29.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4e7a194f-6191-4d33-8fa9-a75a563183b2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23672024-12-19T01:02:29.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4e7a194f-6191-4d33-8fa9-a75a563183b2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23682024-12-19T01:02:30.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 49b29a9f-536d-409e-9508-757e780ee588 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23692024-12-19T01:02:30.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 49b29a9f-536d-409e-9508-757e780ee588 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23702024-12-19T01:02:30.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 49b29a9f-536d-409e-9508-757e780ee588 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23712024-12-19T01:02:31.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e0823a87-c24c-443d-8192-1686688fabce roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23722024-12-19T01:02:31.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e0823a87-c24c-443d-8192-1686688fabce resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23732024-12-19T01:02:31.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e0823a87-c24c-443d-8192-1686688fabce response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23742024-12-19T01:02:31.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
23752024-12-19T01:02:31.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
23762024-12-19T01:02:31.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23772024-12-19T01:02:31.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23782024-12-19T01:02:31.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23792024-12-19T01:02:31.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23802024-12-19T01:02:31.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23812024-12-19T01:02:31.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23822024-12-19T01:02:31.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23832024-12-19T01:02:31.376ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.118946ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23842024-12-19T01:02:31.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23852024-12-19T01:02:31.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23862024-12-19T01:02:31.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23872024-12-19T01:02:31.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23882024-12-19T01:02:31.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23892024-12-19T01:02:31.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23902024-12-19T01:02:31.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
23912024-12-19T01:02:31.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23922024-12-19T01:02:31.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23932024-12-19T01:02:31.389ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
23942024-12-19T01:02:31.389ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.429247ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
23952024-12-19T01:02:32.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 87e93673-a095-4363-8b09-d41c77ef8fc0 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23962024-12-19T01:02:32.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 87e93673-a095-4363-8b09-d41c77ef8fc0 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23972024-12-19T01:02:32.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 87e93673-a095-4363-8b09-d41c77ef8fc0 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23982024-12-19T01:02:33.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2daa6a74-3114-459e-b1f6-1462acf24ecf roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
23992024-12-19T01:02:33.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2daa6a74-3114-459e-b1f6-1462acf24ecf resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24002024-12-19T01:02:33.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2daa6a74-3114-459e-b1f6-1462acf24ecf response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24012024-12-19T01:02:34.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 02262793-70d1-424a-b7b4-4b602311ebc1 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24022024-12-19T01:02:34.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 02262793-70d1-424a-b7b4-4b602311ebc1 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24032024-12-19T01:02:34.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 02262793-70d1-424a-b7b4-4b602311ebc1 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24042024-12-19T01:02:35.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9aeaef3f-8205-46ab-a756-68c5420bf10d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24052024-12-19T01:02:35.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9aeaef3f-8205-46ab-a756-68c5420bf10d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24062024-12-19T01:02:35.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9aeaef3f-8205-46ab-a756-68c5420bf10d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24072024-12-19T01:02:35.769ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1357 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 3be616fc-a46c-42de-9086-4c0f342f870a response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
24082024-12-19T01:02:36.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ba3c08c1-9990-4d74-bf0d-13fb55c31895 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24092024-12-19T01:02:36.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ba3c08c1-9990-4d74-bf0d-13fb55c31895 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24102024-12-19T01:02:36.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ba3c08c1-9990-4d74-bf0d-13fb55c31895 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24112024-12-19T01:02:37.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4b38ad67-6ceb-4e1b-a750-701b59f35626 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24122024-12-19T01:02:37.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4b38ad67-6ceb-4e1b-a750-701b59f35626 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24132024-12-19T01:02:37.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4b38ad67-6ceb-4e1b-a750-701b59f35626 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24142024-12-19T01:02:38.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 897bba47-2118-421d-8513-7924ad6974ba roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24152024-12-19T01:02:38.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 897bba47-2118-421d-8513-7924ad6974ba resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24162024-12-19T01:02:38.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 897bba47-2118-421d-8513-7924ad6974ba response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24172024-12-19T01:02:39.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ff9328c1-12ce-4176-b49b-b24d0bf0b9ab roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24182024-12-19T01:02:39.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ff9328c1-12ce-4176-b49b-b24d0bf0b9ab resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24192024-12-19T01:02:39.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ff9328c1-12ce-4176-b49b-b24d0bf0b9ab response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24202024-12-19T01:02:40.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 80b9b152-917b-454e-aaf3-ab0789d2d21a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24212024-12-19T01:02:40.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 80b9b152-917b-454e-aaf3-ab0789d2d21a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24222024-12-19T01:02:40.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 80b9b152-917b-454e-aaf3-ab0789d2d21a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24232024-12-19T01:02:41.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
24242024-12-19T01:02:41.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
24252024-12-19T01:02:41.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24262024-12-19T01:02:41.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24272024-12-19T01:02:41.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24282024-12-19T01:02:41.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24292024-12-19T01:02:41.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24302024-12-19T01:02:41.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24312024-12-19T01:02:41.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24322024-12-19T01:02:41.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.164546ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24332024-12-19T01:02:41.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24342024-12-19T01:02:41.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24352024-12-19T01:02:41.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24362024-12-19T01:02:41.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24372024-12-19T01:02:41.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24382024-12-19T01:02:41.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24392024-12-19T01:02:41.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
24402024-12-19T01:02:41.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24412024-12-19T01:02:41.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24422024-12-19T01:02:41.391ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
24432024-12-19T01:02:41.391ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.252537ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
24442024-12-19T01:02:41.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 450bf58a-8342-4460-8b5b-1e2b327ee178 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24452024-12-19T01:02:41.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 450bf58a-8342-4460-8b5b-1e2b327ee178 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24462024-12-19T01:02:41.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 450bf58a-8342-4460-8b5b-1e2b327ee178 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24472024-12-19T01:02:42.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 21251204-3cd5-40eb-a450-3c5907048b52 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24482024-12-19T01:02:42.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 21251204-3cd5-40eb-a450-3c5907048b52 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24492024-12-19T01:02:42.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 21251204-3cd5-40eb-a450-3c5907048b52 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24502024-12-19T01:02:43.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d87d5da6-aaed-4d30-83e6-6876f61560c2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24512024-12-19T01:02:43.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d87d5da6-aaed-4d30-83e6-6876f61560c2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24522024-12-19T01:02:43.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d87d5da6-aaed-4d30-83e6-6876f61560c2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24532024-12-19T01:02:44.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a35cd977-a949-4530-925f-b18cbd864eb8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24542024-12-19T01:02:44.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a35cd977-a949-4530-925f-b18cbd864eb8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24552024-12-19T01:02:44.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a35cd977-a949-4530-925f-b18cbd864eb8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24562024-12-19T01:02:45.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a4e222bd-9e0b-41dd-aca8-9f4b75c6ec80 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24572024-12-19T01:02:45.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a4e222bd-9e0b-41dd-aca8-9f4b75c6ec80 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24582024-12-19T01:02:45.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1672 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a4e222bd-9e0b-41dd-aca8-9f4b75c6ec80 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24592024-12-19T01:02:45.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1606 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = ead9166d-7f1b-466e-ad60-bbb0c408739e response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
24602024-12-19T01:02:46.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8448e2be-01b4-4315-8bc7-3d3a5c67a5d5 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24612024-12-19T01:02:46.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8448e2be-01b4-4315-8bc7-3d3a5c67a5d5 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24622024-12-19T01:02:46.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8448e2be-01b4-4315-8bc7-3d3a5c67a5d5 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24632024-12-19T01:02:47.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9ebb8a72-8f03-4a15-b4cf-259cd5e7466c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24642024-12-19T01:02:47.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9ebb8a72-8f03-4a15-b4cf-259cd5e7466c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24652024-12-19T01:02:47.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9ebb8a72-8f03-4a15-b4cf-259cd5e7466c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24662024-12-19T01:02:48.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 20cd0fc9-0d2c-45d1-b3db-deb244c9cb4f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24672024-12-19T01:02:48.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 20cd0fc9-0d2c-45d1-b3db-deb244c9cb4f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24682024-12-19T01:02:48.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 20cd0fc9-0d2c-45d1-b3db-deb244c9cb4f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24692024-12-19T01:02:49.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5ea2e71b-c597-4eaa-bc3f-b51270762eb2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24702024-12-19T01:02:49.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5ea2e71b-c597-4eaa-bc3f-b51270762eb2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24712024-12-19T01:02:49.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5ea2e71b-c597-4eaa-bc3f-b51270762eb2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24722024-12-19T01:02:50.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9204d4ce-f2dd-4352-bf75-5d7892b8ad69 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24732024-12-19T01:02:50.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9204d4ce-f2dd-4352-bf75-5d7892b8ad69 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24742024-12-19T01:02:50.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9204d4ce-f2dd-4352-bf75-5d7892b8ad69 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
24752024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
24762024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
24772024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
24782024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
24792024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24802024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24812024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24822024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
24832024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24842024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24852024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
24862024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24872024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
24882024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24892024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
24902024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24912024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
24922024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
24932024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24942024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24952024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
24962024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
24972024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24982024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24992024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
25002024-12-19T01:02:51.373ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
25012024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25022024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
25032024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25042024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
25052024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25062024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
25072024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25082024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
25092024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25102024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25112024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25122024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25132024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25142024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
25152024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25162024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25172024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25182024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25192024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25202024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
25212024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25222024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
25232024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25242024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25252024-12-19T01:02:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25262024-12-19T01:02:51.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25272024-12-19T01:02:51.376ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25282024-12-19T01:02:51.376ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25292024-12-19T01:02:51.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.210468ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
25302024-12-19T01:02:51.377ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.40962ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
25312024-12-19T01:02:51.378ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25322024-12-19T01:02:51.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25332024-12-19T01:02:51.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25342024-12-19T01:02:51.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25352024-12-19T01:02:51.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25362024-12-19T01:02:51.379ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25372024-12-19T01:02:51.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25382024-12-19T01:02:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25392024-12-19T01:02:51.381ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25402024-12-19T01:02:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25412024-12-19T01:02:51.381ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25422024-12-19T01:02:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25432024-12-19T01:02:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25442024-12-19T01:02:51.381ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25452024-12-19T01:02:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25462024-12-19T01:02:51.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25472024-12-19T01:02:51.384ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1060, tv_nsec: 229285595 } })
25482024-12-19T01:02:51.384ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1060, tv_nsec: 229615219 } })
25492024-12-19T01:02:51.384ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.525967ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
25502024-12-19T01:02:51.384ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
25512024-12-19T01:02:51.385ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
25522024-12-19T01:02:51.385ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25532024-12-19T01:02:51.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25542024-12-19T01:02:51.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25552024-12-19T01:02:51.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25562024-12-19T01:02:51.388ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25572024-12-19T01:02:51.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25582024-12-19T01:02:51.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25592024-12-19T01:02:51.391ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1060, tv_nsec: 236105447 } })
25602024-12-19T01:02:51.391ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
25612024-12-19T01:02:51.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25622024-12-19T01:02:51.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25632024-12-19T01:02:51.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25642024-12-19T01:02:51.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25652024-12-19T01:02:51.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25662024-12-19T01:02:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25672024-12-19T01:02:51.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25682024-12-19T01:02:51.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25692024-12-19T01:02:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25702024-12-19T01:02:51.396ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25712024-12-19T01:02:51.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25722024-12-19T01:02:51.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25732024-12-19T01:02:51.398ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 25.262774ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
25742024-12-19T01:02:51.433ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25752024-12-19T01:02:51.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25762024-12-19T01:02:51.435ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25772024-12-19T01:02:51.435ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
25782024-12-19T01:02:51.435ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25792024-12-19T01:02:51.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25802024-12-19T01:02:51.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25812024-12-19T01:02:51.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25822024-12-19T01:02:51.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25832024-12-19T01:02:51.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25842024-12-19T01:02:51.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25852024-12-19T01:02:51.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25862024-12-19T01:02:51.443ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.95608ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25872024-12-19T01:02:51.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25882024-12-19T01:02:51.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.147469ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25892024-12-19T01:02:51.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
25902024-12-19T01:02:51.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25912024-12-19T01:02:51.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25922024-12-19T01:02:51.450ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25932024-12-19T01:02:51.450ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.335711ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25942024-12-19T01:02:51.450ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 77.637464ms iteration = 10 status = 0
25952024-12-19T01:02:51.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25962024-12-19T01:02:51.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25972024-12-19T01:02:51.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
25982024-12-19T01:02:51.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25992024-12-19T01:02:51.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26002024-12-19T01:02:51.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26012024-12-19T01:02:51.461ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26022024-12-19T01:02:51.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26032024-12-19T01:02:51.474ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26042024-12-19T01:02:51.474ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26052024-12-19T01:02:51.474ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26062024-12-19T01:02:51.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26072024-12-19T01:02:51.474ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26082024-12-19T01:02:51.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26092024-12-19T01:02:51.477ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 104.405548ms iteration = 13 status = {"physical_disks_added":0}
26102024-12-19T01:02:51.481ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
26112024-12-19T01:02:51.481ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26122024-12-19T01:02:51.481ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "307040d1-a318-4337-b069-77a69a5c531c", "content-length": "26", "date": "Thu, 19 Dec 2024 01:02:51 GMT"} })
26132024-12-19T01:02:51.481ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26142024-12-19T01:02:51.481ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
26152024-12-19T01:02:51.481ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 108.409832ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
26162024-12-19T01:02:51.484ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26172024-12-19T01:02:51.486ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
26182024-12-19T01:02:51.486ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26192024-12-19T01:02:51.486ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
26202024-12-19T01:02:51.486ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26212024-12-19T01:02:51.486ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c50b644-9aba-4f33-b5d3-7df8c0a6664b", "content-length": "26", "date": "Thu, 19 Dec 2024 01:02:51 GMT"} })
26222024-12-19T01:02:51.486ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26232024-12-19T01:02:51.486ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "da6e6244-11e1-4935-ad82-f5a6d3dcc0a5", "content-length": "26", "date": "Thu, 19 Dec 2024 01:02:51 GMT"} })
26242024-12-19T01:02:51.486ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26252024-12-19T01:02:51.488ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26262024-12-19T01:02:51.488ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
26272024-12-19T01:02:51.508ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 135.310347ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26282024-12-19T01:02:51.517ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26292024-12-19T01:02:51.517ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
26302024-12-19T01:02:51.517ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 144.246729ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
26312024-12-19T01:02:51.520ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26322024-12-19T01:02:51.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26332024-12-19T01:02:51.528ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26342024-12-19T01:02:51.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26352024-12-19T01:02:51.530ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26362024-12-19T01:02:51.532ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26372024-12-19T01:02:51.532ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26382024-12-19T01:02:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26392024-12-19T01:02:51.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26402024-12-19T01:02:51.536ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26412024-12-19T01:02:51.536ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26422024-12-19T01:02:51.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26432024-12-19T01:02:51.604ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26442024-12-19T01:02:51.604ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ca55bf0-f5f7-4fb9-96d4-35d830964d42", "content-length": "1", "date": "Thu, 19 Dec 2024 01:02:51 GMT"} })
26452024-12-19T01:02:51.606ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26462024-12-19T01:02:51.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26472024-12-19T01:02:51.612ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 239.118417ms iteration = 10 status = null
26482024-12-19T01:02:51.617ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 244.402758ms iteration = 10 status = {}
26492024-12-19T01:02:51.628ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26502024-12-19T01:02:51.628ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26512024-12-19T01:02:51.628ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "acee05a7-c0b5-411f-b78f-5eb725ffe805", "content-length": "372", "date": "Thu, 19 Dec 2024 01:02:51 GMT"} })
26522024-12-19T01:02:51.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26532024-12-19T01:02:51.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26542024-12-19T01:02:51.644ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
26552024-12-19T01:02:51.644ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26562024-12-19T01:02:51.644ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9443ac0f-48ca-49ea-9693-cd94a7ccc825", "date": "Thu, 19 Dec 2024 01:02:51 GMT"} })
26572024-12-19T01:02:51.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26582024-12-19T01:02:51.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26592024-12-19T01:02:51.647ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26602024-12-19T01:02:51.648ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "41989f3a-f61d-40a2-8219-5b431da0b56d", "content-length": "691", "date": "Thu, 19 Dec 2024 01:02:51 GMT"} })
26612024-12-19T01:02:51.648ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
26622024-12-19T01:02:51.648ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
26632024-12-19T01:02:51.648ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
26642024-12-19T01:02:51.652ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 279.153701ms iteration = 10 status = {}
26652024-12-19T01:02:51.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26662024-12-19T01:02:51.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26672024-12-19T01:02:51.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26682024-12-19T01:02:51.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26692024-12-19T01:02:51.662ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26702024-12-19T01:02:51.662ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26712024-12-19T01:02:51.662ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f4ac4271-033e-47d6-aeaa-ee1f2d6e3894", "date": "Thu, 19 Dec 2024 01:02:51 GMT"} })
26722024-12-19T01:02:51.665ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 291.727081ms iteration = 11 status = {}
26732024-12-19T01:02:51.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26742024-12-19T01:02:51.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26752024-12-19T01:02:51.723ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
26762024-12-19T01:02:51.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26772024-12-19T01:02:51.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26782024-12-19T01:02:51.732ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26792024-12-19T01:02:51.732ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e52feb06-924e-41c8-b4a8-a3ef77550538", "content-length": "134", "date": "Thu, 19 Dec 2024 01:02:51 GMT"} })
26802024-12-19T01:02:51.732ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
26812024-12-19T01:02:51.732ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
26822024-12-19T01:02:51.733ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
26832024-12-19T01:02:51.733ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26842024-12-19T01:02:51.733ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26852024-12-19T01:02:51.733ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26862024-12-19T01:02:51.733ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26872024-12-19T01:02:51.733ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26882024-12-19T01:02:51.733ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26892024-12-19T01:02:51.733ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26902024-12-19T01:02:51.733ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
26912024-12-19T01:02:51.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26922024-12-19T01:02:51.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26932024-12-19T01:02:51.736ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26942024-12-19T01:02:51.736ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "19152a2b-5927-433c-aa49-154ab650c870", "content-length": "2", "date": "Thu, 19 Dec 2024 01:02:51 GMT"} })
26952024-12-19T01:02:51.736ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26962024-12-19T01:02:51.736ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "579dbe5e-7cfe-4efc-9adc-e4bfc3fdef65", "content-length": "52", "date": "Thu, 19 Dec 2024 01:02:51 GMT"} })
26972024-12-19T01:02:51.736ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
26982024-12-19T01:02:51.736ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26992024-12-19T01:02:51.838ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ba29a011-1a0b-4eda-bd49-a71ada2ab7b7", "date": "Thu, 19 Dec 2024 01:02:51 GMT"} })
27002024-12-19T01:02:51.838ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
27012024-12-19T01:02:51.838ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27022024-12-19T01:02:51.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7c51aa8b-c2d8-4760-b97a-19235ca3213e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27032024-12-19T01:02:51.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7c51aa8b-c2d8-4760-b97a-19235ca3213e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27042024-12-19T01:02:51.839ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ace94d0-8025-4e5c-bdaf-ad29d3890297", "content-length": "682", "date": "Thu, 19 Dec 2024 01:02:51 GMT"} })
27052024-12-19T01:02:51.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27062024-12-19T01:02:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27072024-12-19T01:02:51.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7c51aa8b-c2d8-4760-b97a-19235ca3213e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27082024-12-19T01:02:51.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27092024-12-19T01:02:51.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27102024-12-19T01:02:51.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27112024-12-19T01:02:51.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27122024-12-19T01:02:51.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27132024-12-19T01:02:51.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27142024-12-19T01:02:51.856ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 483.438344ms iteration = 10 status = {}
27152024-12-19T01:02:52.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = dcb55a9b-a431-4a6b-8069-062f36cf648f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
27162024-12-19T01:02:52.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = dcb55a9b-a431-4a6b-8069-062f36cf648f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
27172024-12-19T01:02:52.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = dcb55a9b-a431-4a6b-8069-062f36cf648f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
27182024-12-19T01:02:52.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a223d917-64af-479b-b23b-3eafb08a37bb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27192024-12-19T01:02:52.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a223d917-64af-479b-b23b-3eafb08a37bb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27202024-12-19T01:02:52.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a223d917-64af-479b-b23b-3eafb08a37bb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27212024-12-19T01:02:53.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b69457f5-d220-4c37-874a-114e3db3195d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27222024-12-19T01:02:53.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b69457f5-d220-4c37-874a-114e3db3195d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27232024-12-19T01:02:53.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b69457f5-d220-4c37-874a-114e3db3195d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27242024-12-19T01:02:54.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6a8f013a-3a4e-4555-a1b5-af3b565debbc roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27252024-12-19T01:02:54.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6a8f013a-3a4e-4555-a1b5-af3b565debbc resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27262024-12-19T01:02:54.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6a8f013a-3a4e-4555-a1b5-af3b565debbc response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27272024-12-19T01:02:55.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1361 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 2759deab-0069-4450-9315-5fa2f61680aa response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
27282024-12-19T01:02:55.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0b7c1183-6bc9-43a3-baba-11e4ede813cc roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27292024-12-19T01:02:55.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0b7c1183-6bc9-43a3-baba-11e4ede813cc resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27302024-12-19T01:02:55.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0b7c1183-6bc9-43a3-baba-11e4ede813cc response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27312024-12-19T01:02:56.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = da19933e-ef53-42b5-bc98-d4a3bb0346e2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27322024-12-19T01:02:56.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = da19933e-ef53-42b5-bc98-d4a3bb0346e2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27332024-12-19T01:02:56.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = da19933e-ef53-42b5-bc98-d4a3bb0346e2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27342024-12-19T01:02:57.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 77d0f398-9eef-47eb-a12a-70a4a841a8a7 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27352024-12-19T01:02:57.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 77d0f398-9eef-47eb-a12a-70a4a841a8a7 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27362024-12-19T01:02:57.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 77d0f398-9eef-47eb-a12a-70a4a841a8a7 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27372024-12-19T01:02:58.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a27b5f0f-e295-445e-816e-91ef7c7128fa roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27382024-12-19T01:02:58.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a27b5f0f-e295-445e-816e-91ef7c7128fa resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27392024-12-19T01:02:58.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a27b5f0f-e295-445e-816e-91ef7c7128fa response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27402024-12-19T01:03:00.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bda0b273-cbd2-430d-be9d-48b4fff70049 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27412024-12-19T01:03:00.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bda0b273-cbd2-430d-be9d-48b4fff70049 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27422024-12-19T01:03:00.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bda0b273-cbd2-430d-be9d-48b4fff70049 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27432024-12-19T01:03:01.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5e8a0aa3-c34b-482a-abbf-1800ea739152 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27442024-12-19T01:03:01.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5e8a0aa3-c34b-482a-abbf-1800ea739152 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27452024-12-19T01:03:01.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2819 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5e8a0aa3-c34b-482a-abbf-1800ea739152 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27462024-12-19T01:03:01.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
27472024-12-19T01:03:01.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
27482024-12-19T01:03:01.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27492024-12-19T01:03:01.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27502024-12-19T01:03:01.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27512024-12-19T01:03:01.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27522024-12-19T01:03:01.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27532024-12-19T01:03:01.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27542024-12-19T01:03:01.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27552024-12-19T01:03:01.375ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.143533ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27562024-12-19T01:03:01.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27572024-12-19T01:03:01.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27582024-12-19T01:03:01.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27592024-12-19T01:03:01.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27602024-12-19T01:03:01.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27612024-12-19T01:03:01.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27622024-12-19T01:03:01.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
27632024-12-19T01:03:01.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27642024-12-19T01:03:01.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27652024-12-19T01:03:01.391ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
27662024-12-19T01:03:01.391ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.827396ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
27672024-12-19T01:03:02.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a3bef51e-012e-4f1f-a0cd-742606d5c4c1 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27682024-12-19T01:03:02.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a3bef51e-012e-4f1f-a0cd-742606d5c4c1 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27692024-12-19T01:03:02.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a3bef51e-012e-4f1f-a0cd-742606d5c4c1 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27702024-12-19T01:03:03.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3e0727e2-392b-493a-932d-89c322c0bd56 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27712024-12-19T01:03:03.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3e0727e2-392b-493a-932d-89c322c0bd56 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27722024-12-19T01:03:03.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3e0727e2-392b-493a-932d-89c322c0bd56 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27732024-12-19T01:03:04.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 57b08c6b-39ed-419a-9720-23c9c05ae681 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27742024-12-19T01:03:04.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 57b08c6b-39ed-419a-9720-23c9c05ae681 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27752024-12-19T01:03:04.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 57b08c6b-39ed-419a-9720-23c9c05ae681 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27762024-12-19T01:03:05.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 524ee6c8-0500-4458-b970-64e058586c17 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27772024-12-19T01:03:05.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 524ee6c8-0500-4458-b970-64e058586c17 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27782024-12-19T01:03:05.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 524ee6c8-0500-4458-b970-64e058586c17 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27792024-12-19T01:03:05.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1537 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = e531dce1-e016-4e3f-95f7-404064d20ea2 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
27802024-12-19T01:03:06.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 90e3a414-6d1a-42b8-8c30-2ee65930322d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27812024-12-19T01:03:06.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 90e3a414-6d1a-42b8-8c30-2ee65930322d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27822024-12-19T01:03:06.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 90e3a414-6d1a-42b8-8c30-2ee65930322d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27832024-12-19T01:03:07.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d174ee15-8f0a-4e5e-87d1-bcb8e2988108 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27842024-12-19T01:03:07.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d174ee15-8f0a-4e5e-87d1-bcb8e2988108 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27852024-12-19T01:03:07.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d174ee15-8f0a-4e5e-87d1-bcb8e2988108 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27862024-12-19T01:03:08.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d2b5a692-cc0c-44f5-8116-3c34af40a5ec roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27872024-12-19T01:03:08.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d2b5a692-cc0c-44f5-8116-3c34af40a5ec resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27882024-12-19T01:03:08.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d2b5a692-cc0c-44f5-8116-3c34af40a5ec response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27892024-12-19T01:03:09.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 038acb17-4ed8-430c-9cd4-7a11ae163303 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27902024-12-19T01:03:09.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 038acb17-4ed8-430c-9cd4-7a11ae163303 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27912024-12-19T01:03:09.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 038acb17-4ed8-430c-9cd4-7a11ae163303 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27922024-12-19T01:03:10.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3793a51c-c9ad-4a4e-9d53-7e598252df0d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27932024-12-19T01:03:10.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3793a51c-c9ad-4a4e-9d53-7e598252df0d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27942024-12-19T01:03:10.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3793a51c-c9ad-4a4e-9d53-7e598252df0d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27952024-12-19T01:03:11.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 20ca9bc8-6957-44d0-b606-3dc43a02c54e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27962024-12-19T01:03:11.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 20ca9bc8-6957-44d0-b606-3dc43a02c54e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27972024-12-19T01:03:11.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 20ca9bc8-6957-44d0-b606-3dc43a02c54e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
27982024-12-19T01:03:11.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
27992024-12-19T01:03:11.372ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
28002024-12-19T01:03:11.372ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28012024-12-19T01:03:11.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28022024-12-19T01:03:11.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28032024-12-19T01:03:11.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28042024-12-19T01:03:11.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28052024-12-19T01:03:11.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28062024-12-19T01:03:11.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28072024-12-19T01:03:11.376ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.709721ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28082024-12-19T01:03:11.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28092024-12-19T01:03:11.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28102024-12-19T01:03:11.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28112024-12-19T01:03:11.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28122024-12-19T01:03:11.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28132024-12-19T01:03:11.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28142024-12-19T01:03:11.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
28152024-12-19T01:03:11.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28162024-12-19T01:03:11.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28172024-12-19T01:03:11.394ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
28182024-12-19T01:03:11.394ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.000429ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
28192024-12-19T01:03:12.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = abd973d7-9129-44e7-bf48-31c5d903ce31 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28202024-12-19T01:03:12.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = abd973d7-9129-44e7-bf48-31c5d903ce31 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28212024-12-19T01:03:12.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = abd973d7-9129-44e7-bf48-31c5d903ce31 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28222024-12-19T01:03:13.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d03d330f-5c96-4928-9576-13a8c8e11eb2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28232024-12-19T01:03:13.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d03d330f-5c96-4928-9576-13a8c8e11eb2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28242024-12-19T01:03:13.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d03d330f-5c96-4928-9576-13a8c8e11eb2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28252024-12-19T01:03:14.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 07fa36d4-ff6e-4a01-bdcc-b13ddcc6dc57 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28262024-12-19T01:03:14.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 07fa36d4-ff6e-4a01-bdcc-b13ddcc6dc57 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28272024-12-19T01:03:14.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 07fa36d4-ff6e-4a01-bdcc-b13ddcc6dc57 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28282024-12-19T01:03:15.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ecaf19ea-00d8-49f7-bf89-0d847433b28d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28292024-12-19T01:03:15.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ecaf19ea-00d8-49f7-bf89-0d847433b28d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28302024-12-19T01:03:15.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ecaf19ea-00d8-49f7-bf89-0d847433b28d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28312024-12-19T01:03:15.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1415 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 9c6bd59c-6b13-47f3-ad01-0a61d2e595f4 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
28322024-12-19T01:03:16.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7930d1e8-62f6-4599-869e-7bdcffe995b8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28332024-12-19T01:03:16.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7930d1e8-62f6-4599-869e-7bdcffe995b8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28342024-12-19T01:03:16.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7930d1e8-62f6-4599-869e-7bdcffe995b8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28352024-12-19T01:03:17.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c2ba4866-e8b6-46be-a605-867f7f919bae roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28362024-12-19T01:03:17.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c2ba4866-e8b6-46be-a605-867f7f919bae resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28372024-12-19T01:03:17.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c2ba4866-e8b6-46be-a605-867f7f919bae response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28382024-12-19T01:03:18.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 871b75c8-52b7-413d-831f-e867586f30ef roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28392024-12-19T01:03:18.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 871b75c8-52b7-413d-831f-e867586f30ef resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28402024-12-19T01:03:18.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 871b75c8-52b7-413d-831f-e867586f30ef response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28412024-12-19T01:03:19.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 54e26e43-f00a-4879-88f9-9c5ac394b6ef roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28422024-12-19T01:03:19.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 54e26e43-f00a-4879-88f9-9c5ac394b6ef resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28432024-12-19T01:03:19.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 54e26e43-f00a-4879-88f9-9c5ac394b6ef response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28442024-12-19T01:03:20.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 014b8349-d294-401b-b03a-14abfdeab068 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28452024-12-19T01:03:20.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 014b8349-d294-401b-b03a-14abfdeab068 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28462024-12-19T01:03:20.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 014b8349-d294-401b-b03a-14abfdeab068 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
28472024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
28482024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
28492024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28502024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
28512024-12-19T01:03:21.373ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
28522024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
28532024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
28542024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
28552024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28562024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
28572024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
28582024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28592024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
28602024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28612024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
28622024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28632024-12-19T01:03:21.373ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
28642024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28652024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
28662024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
28672024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28682024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
28692024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
28702024-12-19T01:03:21.373ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28712024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
28722024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28732024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28742024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
28752024-12-19T01:03:21.373ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 00:53:21.373363403 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
28762024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
28772024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
28782024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
28792024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28802024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
28812024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28822024-12-19T01:03:21.373ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a
28832024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
28842024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.52\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a"}
28852024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
28862024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
28872024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
28882024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28892024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
28902024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28912024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
28922024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28932024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
28942024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
28952024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28962024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
28972024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
28982024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28992024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
29002024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
29012024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29022024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
29032024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29042024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
29052024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29062024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
29072024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29082024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
29092024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29102024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
29112024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29122024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29132024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29142024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29152024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29162024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29172024-12-19T01:03:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29182024-12-19T01:03:21.373ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a880a2e-2471-4fd8-9ad5-3e0c3fbde317.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1090, tv_nsec: 218576187 } })
29192024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29202024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29212024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29222024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29232024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
29242024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29252024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
29262024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29272024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29282024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29292024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29302024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
29312024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29322024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29332024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
29342024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29352024-12-19T01:03:21.374ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0018a454-75c0-41b1-be69-9476391f01e1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("050cdbd7-4ebc-471c-b4dc-ec1b3741f763.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1090, tv_nsec: 218815550 } })
29362024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29372024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29382024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29392024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
29402024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.148546ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
29412024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
29422024-12-19T01:03:21.374ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.42969ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
29432024-12-19T01:03:21.375ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29442024-12-19T01:03:21.376ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29452024-12-19T01:03:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.213684ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29462024-12-19T01:03:21.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29472024-12-19T01:03:21.377ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29482024-12-19T01:03:21.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29492024-12-19T01:03:21.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29502024-12-19T01:03:21.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
29512024-12-19T01:03:21.378ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29522024-12-19T01:03:21.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29532024-12-19T01:03:21.380ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29542024-12-19T01:03:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29552024-12-19T01:03:21.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29562024-12-19T01:03:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29572024-12-19T01:03:21.380ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29582024-12-19T01:03:21.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29592024-12-19T01:03:21.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29602024-12-19T01:03:21.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29612024-12-19T01:03:21.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29622024-12-19T01:03:21.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29632024-12-19T01:03:21.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29642024-12-19T01:03:21.382ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29652024-12-19T01:03:21.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29662024-12-19T01:03:21.386ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.811564ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
29672024-12-19T01:03:21.387ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1090, tv_nsec: 232162971 } })
29682024-12-19T01:03:21.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29692024-12-19T01:03:21.387ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
29702024-12-19T01:03:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29712024-12-19T01:03:21.389ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.556661ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
29722024-12-19T01:03:21.390ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 00:53:21.373363403 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
29732024-12-19T01:03:21.390ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 16.649086ms iteration = 6 status = {"expiration":"2024-12-19T00:53:21.373363403Z","pruned":[]}
29742024-12-19T01:03:21.390ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.149903ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
29752024-12-19T01:03:21.390ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29762024-12-19T01:03:21.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29772024-12-19T01:03:21.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29782024-12-19T01:03:21.392ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29792024-12-19T01:03:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29802024-12-19T01:03:21.394ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29812024-12-19T01:03:21.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29822024-12-19T01:03:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29832024-12-19T01:03:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29842024-12-19T01:03:21.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29852024-12-19T01:03:21.394ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29862024-12-19T01:03:21.394ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29872024-12-19T01:03:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29882024-12-19T01:03:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29892024-12-19T01:03:21.395ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29902024-12-19T01:03:21.395ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29912024-12-19T01:03:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29922024-12-19T01:03:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29932024-12-19T01:03:21.397ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29942024-12-19T01:03:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29952024-12-19T01:03:21.402ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
29962024-12-19T01:03:21.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
29972024-12-19T01:03:21.404ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1090, tv_nsec: 249069771 } })
29982024-12-19T01:03:21.404ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29992024-12-19T01:03:21.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30002024-12-19T01:03:21.404ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
30012024-12-19T01:03:21.404ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1090, tv_nsec: 249524967 } })
30022024-12-19T01:03:21.405ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
30032024-12-19T01:03:21.406ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30042024-12-19T01:03:21.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30052024-12-19T01:03:21.407ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30062024-12-19T01:03:21.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30072024-12-19T01:03:21.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30082024-12-19T01:03:21.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30092024-12-19T01:03:21.409ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30102024-12-19T01:03:21.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30112024-12-19T01:03:21.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30122024-12-19T01:03:21.410ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30132024-12-19T01:03:21.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30142024-12-19T01:03:21.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30152024-12-19T01:03:21.412ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
30162024-12-19T01:03:21.412ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
30172024-12-19T01:03:21.412ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
30182024-12-19T01:03:21.412ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30192024-12-19T01:03:21.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30202024-12-19T01:03:21.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30212024-12-19T01:03:21.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30222024-12-19T01:03:21.415ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30232024-12-19T01:03:21.415ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30242024-12-19T01:03:21.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30252024-12-19T01:03:21.416ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 42.659309ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30262024-12-19T01:03:21.417ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30272024-12-19T01:03:21.417ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30282024-12-19T01:03:21.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30292024-12-19T01:03:21.418ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30302024-12-19T01:03:21.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30312024-12-19T01:03:21.418ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30322024-12-19T01:03:21.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30332024-12-19T01:03:21.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30342024-12-19T01:03:21.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
30352024-12-19T01:03:21.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30362024-12-19T01:03:21.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30372024-12-19T01:03:21.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
30382024-12-19T01:03:21.422ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30392024-12-19T01:03:21.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30402024-12-19T01:03:21.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30412024-12-19T01:03:21.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30422024-12-19T01:03:21.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30432024-12-19T01:03:21.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30442024-12-19T01:03:21.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30452024-12-19T01:03:21.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30462024-12-19T01:03:21.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30472024-12-19T01:03:21.430ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30482024-12-19T01:03:21.430ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30492024-12-19T01:03:21.435ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30502024-12-19T01:03:21.435ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30512024-12-19T01:03:21.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30522024-12-19T01:03:21.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
30532024-12-19T01:03:21.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30542024-12-19T01:03:21.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30552024-12-19T01:03:21.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30562024-12-19T01:03:21.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30572024-12-19T01:03:21.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30582024-12-19T01:03:21.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30592024-12-19T01:03:21.442ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30602024-12-19T01:03:21.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30612024-12-19T01:03:21.445ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30622024-12-19T01:03:21.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30632024-12-19T01:03:21.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30642024-12-19T01:03:21.453ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
30652024-12-19T01:03:21.453ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.444592ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
30662024-12-19T01:03:21.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
30672024-12-19T01:03:21.459ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30682024-12-19T01:03:21.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30692024-12-19T01:03:21.460ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
30702024-12-19T01:03:21.460ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
30712024-12-19T01:03:21.460ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 87.101743ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
30722024-12-19T01:03:21.464ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30732024-12-19T01:03:21.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30742024-12-19T01:03:21.465ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30752024-12-19T01:03:21.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30762024-12-19T01:03:21.466ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30772024-12-19T01:03:21.466ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30782024-12-19T01:03:21.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30792024-12-19T01:03:21.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30802024-12-19T01:03:21.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.884995ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30812024-12-19T01:03:21.467ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30822024-12-19T01:03:21.467ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 94.149328ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30832024-12-19T01:03:21.467ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30842024-12-19T01:03:21.467ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
30852024-12-19T01:03:21.467ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30862024-12-19T01:03:21.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30872024-12-19T01:03:21.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30882024-12-19T01:03:21.469ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30892024-12-19T01:03:21.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
30902024-12-19T01:03:21.470ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30912024-12-19T01:03:21.470ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30922024-12-19T01:03:21.470ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30932024-12-19T01:03:21.470ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
30942024-12-19T01:03:21.470ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
30952024-12-19T01:03:21.470ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 97.589056ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
30962024-12-19T01:03:21.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30972024-12-19T01:03:21.471ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.798638ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30982024-12-19T01:03:21.471ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
30992024-12-19T01:03:21.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31002024-12-19T01:03:21.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31012024-12-19T01:03:21.473ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31022024-12-19T01:03:21.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bdd012d5-1412-41ee-80db-de33b4f52f95 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
31032024-12-19T01:03:21.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31042024-12-19T01:03:21.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bdd012d5-1412-41ee-80db-de33b4f52f95 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
31052024-12-19T01:03:21.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bdd012d5-1412-41ee-80db-de33b4f52f95 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
31062024-12-19T01:03:21.482ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
31072024-12-19T01:03:21.482ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
31082024-12-19T01:03:21.482ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31092024-12-19T01:03:21.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31102024-12-19T01:03:21.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31112024-12-19T01:03:21.485ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31122024-12-19T01:03:21.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31132024-12-19T01:03:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31142024-12-19T01:03:21.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31152024-12-19T01:03:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31162024-12-19T01:03:21.491ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31172024-12-19T01:03:21.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
31182024-12-19T01:03:21.493ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31192024-12-19T01:03:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31202024-12-19T01:03:21.495ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
31212024-12-19T01:03:21.495ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
31222024-12-19T01:03:21.495ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 00:59:01.994004 UTC dns_group = internal generation = 1
31232024-12-19T01:03:21.495ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 121.957376ms iteration = 7 status = {"generation":1}
31242024-12-19T01:03:21.500ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 127.097276ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31252024-12-19T01:03:21.502ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 129.404128ms iteration = 14 status = {"physical_disks_added":0}
31262024-12-19T01:03:21.506ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
31272024-12-19T01:03:21.506ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
31282024-12-19T01:03:21.506ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
31292024-12-19T01:03:21.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31302024-12-19T01:03:21.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31312024-12-19T01:03:21.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31322024-12-19T01:03:21.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31332024-12-19T01:03:21.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31342024-12-19T01:03:21.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31352024-12-19T01:03:21.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31362024-12-19T01:03:21.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31372024-12-19T01:03:21.514ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31382024-12-19T01:03:21.514ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
31392024-12-19T01:03:21.514ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.813702ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
31402024-12-19T01:03:21.514ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
31412024-12-19T01:03:21.515ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31422024-12-19T01:03:21.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31432024-12-19T01:03:21.517ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31442024-12-19T01:03:21.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
31452024-12-19T01:03:21.521ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31462024-12-19T01:03:21.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31472024-12-19T01:03:21.539ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T00:58:19.687181Z, time_modified: 2024-12-19T00:58:19.687181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }) }
31482024-12-19T01:03:21.539ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 166.335399ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]}},"default_endpoint":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
31492024-12-19T01:03:21.551ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
31502024-12-19T01:03:21.551ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 0 version = 2
31512024-12-19T01:03:21.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31522024-12-19T01:03:21.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31532024-12-19T01:03:21.558ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
31542024-12-19T01:03:21.566ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31552024-12-19T01:03:21.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31562024-12-19T01:03:21.569ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
31572024-12-19T01:03:21.569ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 196.121873ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
31582024-12-19T01:03:21.598ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
31592024-12-19T01:03:21.598ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31602024-12-19T01:03:21.599ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87929911-d139-4352-8967-ccb6d4c31b53", "content-length": "26", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} })
31612024-12-19T01:03:21.599ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31622024-12-19T01:03:21.601ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31632024-12-19T01:03:21.667ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
31642024-12-19T01:03:21.667ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31652024-12-19T01:03:21.668ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d6654ac-5b94-4de7-8e93-e6f8557605d4", "content-length": "26", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} })
31662024-12-19T01:03:21.668ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31672024-12-19T01:03:21.670ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31682024-12-19T01:03:21.768ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
31692024-12-19T01:03:21.769ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31702024-12-19T01:03:21.769ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88d009e0-7f70-441e-8124-64c80e74c4f4", "content-length": "26", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} })
31712024-12-19T01:03:21.769ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31722024-12-19T01:03:21.772ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
31732024-12-19T01:03:21.798ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
31742024-12-19T01:03:21.798ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31752024-12-19T01:03:21.798ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "15f69524-5e4e-4ba2-a072-a3cc611d3c0b", "content-length": "372", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} })
31762024-12-19T01:03:21.798ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31772024-12-19T01:03:21.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31782024-12-19T01:03:21.799ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31792024-12-19T01:03:21.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
31802024-12-19T01:03:21.804ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
31812024-12-19T01:03:21.811ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 438.388733ms iteration = 11 status = {}
31822024-12-19T01:03:21.817ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
31832024-12-19T01:03:21.817ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0f207f95-79c7-4f47-931e-be4a8bfce953", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31842024-12-19T01:03:21.817ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31852024-12-19T01:03:21.819ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8100dc84-ce04-4404-a0c7-d8174f965880", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31862024-12-19T01:03:21.819ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31872024-12-19T01:03:21.819ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31882024-12-19T01:03:21.819ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "53eebd43-038e-4e81-bfa9-d269e26c0c25", "content-length": "691", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} })
31892024-12-19T01:03:21.820ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
31902024-12-19T01:03:21.820ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
31912024-12-19T01:03:21.820ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
31922024-12-19T01:03:21.821ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31932024-12-19T01:03:21.822ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31942024-12-19T01:03:21.822ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 448.812394ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
31952024-12-19T01:03:21.822ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 449.361962ms iteration = 11 status = {}
31962024-12-19T01:03:21.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31972024-12-19T01:03:21.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31982024-12-19T01:03:21.823ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
31992024-12-19T01:03:21.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32002024-12-19T01:03:21.824ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32012024-12-19T01:03:21.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32022024-12-19T01:03:21.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32032024-12-19T01:03:21.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32042024-12-19T01:03:21.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
32052024-12-19T01:03:21.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32062024-12-19T01:03:21.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32072024-12-19T01:03:21.831ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32082024-12-19T01:03:21.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32092024-12-19T01:03:21.831ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 1 version = 2
32102024-12-19T01:03:21.831ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
32112024-12-19T01:03:21.831ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 00:59:02.707744 UTC dns_group = external generation = 2
32122024-12-19T01:03:21.831ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 458.182202ms iteration = 7 status = {"generation":2}
32132024-12-19T01:03:21.831ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 458.637738ms iteration = 11 status = 0
32142024-12-19T01:03:21.833ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
32152024-12-19T01:03:21.833ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "190ee1f4-26ee-466a-9127-1072d01a4614", "content-length": "1", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} })
32162024-12-19T01:03:21.834ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32172024-12-19T01:03:21.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32182024-12-19T01:03:21.835ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32192024-12-19T01:03:21.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32202024-12-19T01:03:21.836ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32212024-12-19T01:03:21.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32222024-12-19T01:03:21.837ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32232024-12-19T01:03:21.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32242024-12-19T01:03:21.838ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 464.929033ms iteration = 11 status = null
32252024-12-19T01:03:21.838ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32262024-12-19T01:03:21.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
32272024-12-19T01:03:21.844ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32282024-12-19T01:03:21.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32292024-12-19T01:03:21.846ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32302024-12-19T01:03:21.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32312024-12-19T01:03:21.848ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32322024-12-19T01:03:21.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32332024-12-19T01:03:21.849ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32342024-12-19T01:03:21.853ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
32352024-12-19T01:03:21.853ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32362024-12-19T01:03:21.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32372024-12-19T01:03:21.858ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32382024-12-19T01:03:21.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32392024-12-19T01:03:21.860ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32402024-12-19T01:03:21.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32412024-12-19T01:03:21.862ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32422024-12-19T01:03:21.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32432024-12-19T01:03:21.865ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32442024-12-19T01:03:21.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32452024-12-19T01:03:21.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32462024-12-19T01:03:21.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32472024-12-19T01:03:21.869ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
32482024-12-19T01:03:21.869ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
32492024-12-19T01:03:21.869ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
32502024-12-19T01:03:21.869ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f63ef769-7335-461c-a37e-e17dd6532c9d", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
32512024-12-19T01:03:21.869ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
32522024-12-19T01:03:21.869ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b9732994-29b1-48e2-96ae-755388c71dba", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} })
32532024-12-19T01:03:21.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32542024-12-19T01:03:21.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32552024-12-19T01:03:21.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32562024-12-19T01:03:21.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32572024-12-19T01:03:21.874ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "de37bad8-7fb5-4fff-8f4d-7762f3804dd4", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
32582024-12-19T01:03:21.874ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
32592024-12-19T01:03:21.875ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32602024-12-19T01:03:21.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32612024-12-19T01:03:21.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32622024-12-19T01:03:21.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32632024-12-19T01:03:21.876ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "caac9748-4507-45dc-9599-6d540db0412f", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
32642024-12-19T01:03:21.876ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
32652024-12-19T01:03:21.877ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32662024-12-19T01:03:21.878ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
32672024-12-19T01:03:21.878ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 505.418613ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
32682024-12-19T01:03:21.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32692024-12-19T01:03:21.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32702024-12-19T01:03:21.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
32712024-12-19T01:03:21.880ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32722024-12-19T01:03:21.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32732024-12-19T01:03:21.882ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32742024-12-19T01:03:21.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32752024-12-19T01:03:21.883ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
32762024-12-19T01:03:21.883ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32772024-12-19T01:03:21.883ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1b2d3bed-0f49-4bc3-9878-02b06b72d668", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} })
32782024-12-19T01:03:21.884ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32792024-12-19T01:03:21.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32802024-12-19T01:03:21.885ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 512.241715ms iteration = 12 status = {}
32812024-12-19T01:03:21.885ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32822024-12-19T01:03:21.889ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
32832024-12-19T01:03:21.889ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32842024-12-19T01:03:21.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32852024-12-19T01:03:21.895ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 82094354-655d-415c-9763-28731eb50642, kind: Service { id: e1a83ba4-ec9f-4cc1-ae29-0ab5f6b211f9 }, name: Name("nexus-e1a83ba4-ec9f-4cc1-ae29-0ab5f6b211f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5c3ad41-155b-469b-bb3f-412814b9d0ff, kind: Service { id: 1176f008-4a9d-4835-a5aa-1a86ec3c619c }, name: Name("nexus-1176f008-4a9d-4835-a5aa-1a86ec3c619c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 188])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef89a8b8-3cc5-4637-aee2-3b98f04f51be, kind: Service { id: 1d1e5635-dd2b-4bf7-8ace-6cb3ea634995 }, name: Name("nexus-1d1e5635-dd2b-4bf7-8ace-6cb3ea634995"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 5b97cf45-6db1-45ed-9f7e-111d132f7ed4, kind: Service { id: 2a880a2e-2471-4fd8-9ad5-3e0c3fbde317 }, name: Name("external-dns-2a880a2e-2471-4fd8-9ad5-3e0c3fbde317"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d21d0095-8e84-486f-b3a4-f9dca167b9d5, kind: Service { id: 679d67b5-9925-49ac-b78d-613e816394dc }, name: Name("external-dns-679d67b5-9925-49ac-b78d-613e816394dc"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 205])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
32862024-12-19T01:03:21.895ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32872024-12-19T01:03:21.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32882024-12-19T01:03:21.896ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32892024-12-19T01:03:21.898ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
32902024-12-19T01:03:21.898ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
32912024-12-19T01:03:21.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
32922024-12-19T01:03:21.900ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
32932024-12-19T01:03:21.900ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5b97cf45-6db1-45ed-9f7e-111d132f7ed4, kind: Service { id: 2a880a2e-2471-4fd8-9ad5-3e0c3fbde317 }, name: Name("external-dns-2a880a2e-2471-4fd8-9ad5-3e0c3fbde317"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d21d0095-8e84-486f-b3a4-f9dca167b9d5, kind: Service { id: 679d67b5-9925-49ac-b78d-613e816394dc }, name: Name("external-dns-679d67b5-9925-49ac-b78d-613e816394dc"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 205])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 82094354-655d-415c-9763-28731eb50642, kind: Service { id: e1a83ba4-ec9f-4cc1-ae29-0ab5f6b211f9 }, name: Name("nexus-e1a83ba4-ec9f-4cc1-ae29-0ab5f6b211f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5c3ad41-155b-469b-bb3f-412814b9d0ff, kind: Service { id: 1176f008-4a9d-4835-a5aa-1a86ec3c619c }, name: Name("nexus-1176f008-4a9d-4835-a5aa-1a86ec3c619c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 188])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef89a8b8-3cc5-4637-aee2-3b98f04f51be, kind: Service { id: 1d1e5635-dd2b-4bf7-8ace-6cb3ea634995 }, name: Name("nexus-1d1e5635-dd2b-4bf7-8ace-6cb3ea634995"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
32942024-12-19T01:03:21.900ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
32952024-12-19T01:03:21.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32962024-12-19T01:03:21.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32972024-12-19T01:03:21.935ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
32982024-12-19T01:03:21.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32992024-12-19T01:03:21.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33002024-12-19T01:03:21.944ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
33012024-12-19T01:03:21.944ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7aa0e8c4-2c24-49e7-b465-ab15b2205c07", "content-length": "134", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} })
33022024-12-19T01:03:21.944ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
33032024-12-19T01:03:21.944ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
33042024-12-19T01:03:21.945ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
33052024-12-19T01:03:21.945ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33062024-12-19T01:03:21.945ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33072024-12-19T01:03:21.945ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33082024-12-19T01:03:21.945ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33092024-12-19T01:03:21.945ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33102024-12-19T01:03:21.945ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33112024-12-19T01:03:21.945ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33122024-12-19T01:03:21.945ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
33132024-12-19T01:03:21.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33142024-12-19T01:03:21.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33152024-12-19T01:03:21.947ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
33162024-12-19T01:03:21.948ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "47e0d38d-15d7-45e6-a43f-c66d00fc3084", "content-length": "2", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} })
33172024-12-19T01:03:21.948ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
33182024-12-19T01:03:21.948ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cff59d17-3121-4165-b478-2e8a6698842d", "content-length": "52", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} })
33192024-12-19T01:03:21.948ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
33202024-12-19T01:03:21.948ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33212024-12-19T01:03:22.014ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: de9bec7d-f8ce-44a0-879c-5e088768f91c, time_created: 2024-12-19T00:58:58.564641Z, time_modified: 2024-12-19T00:58:58.564641Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
33222024-12-19T01:03:22.014ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
33232024-12-19T01:03:22.014ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33242024-12-19T01:03:22.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33252024-12-19T01:03:22.017ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
33262024-12-19T01:03:22.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
33272024-12-19T01:03:22.019ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33282024-12-19T01:03:22.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
33292024-12-19T01:03:22.054ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
33302024-12-19T01:03:22.061ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "146a46d0-8663-4d43-bf42-55877e4b6ca8", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} })
33312024-12-19T01:03:22.061ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
33322024-12-19T01:03:22.061ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33332024-12-19T01:03:22.062ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef788574-1abc-43a2-b90e-3c3a98303398", "content-length": "682", "date": "Thu, 19 Dec 2024 01:03:22 GMT"} })
33342024-12-19T01:03:22.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33352024-12-19T01:03:22.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33362024-12-19T01:03:22.062ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "505a5f8e-f23c-47ca-a849-200f9aac5a49", "date": "Thu, 19 Dec 2024 01:03:21 GMT"} })
33372024-12-19T01:03:22.064ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
33382024-12-19T01:03:22.064ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 691.690042ms
33392024-12-19T01:03:22.064ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 691.707163ms iteration = 2 status = {}
33402024-12-19T01:03:22.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33412024-12-19T01:03:22.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33422024-12-19T01:03:22.069ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33432024-12-19T01:03:22.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33442024-12-19T01:03:22.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33452024-12-19T01:03:22.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33462024-12-19T01:03:22.078ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 705.722312ms iteration = 11 status = {}
33472024-12-19T01:03:22.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2d747eb8-3693-4e28-b62a-98d02f50979b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33482024-12-19T01:03:22.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2d747eb8-3693-4e28-b62a-98d02f50979b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33492024-12-19T01:03:22.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2d747eb8-3693-4e28-b62a-98d02f50979b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33502024-12-19T01:03:22.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 1cee057c-af56-411b-bff3-229eaea77db1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
33512024-12-19T01:03:22.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 1cee057c-af56-411b-bff3-229eaea77db1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
33522024-12-19T01:03:22.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 1cee057c-af56-411b-bff3-229eaea77db1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
33532024-12-19T01:03:23.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9f048f20-fd89-4352-9d70-251b7355f2d5 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33542024-12-19T01:03:23.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9f048f20-fd89-4352-9d70-251b7355f2d5 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33552024-12-19T01:03:23.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9f048f20-fd89-4352-9d70-251b7355f2d5 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33562024-12-19T01:03:23.921ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:36448
33572024-12-19T01:03:23.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36448 req_id = c1d00995-56b4-429c-98c5-889e6df4f332 roles = RoleSet { roles: {} } uri = /metrics/producers
33582024-12-19T01:03:23.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36448 req_id = c1d00995-56b4-429c-98c5-889e6df4f332 resource = Database result = Ok(()) uri = /metrics/producers
33592024-12-19T01:03:24.078ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = de9bec7d-f8ce-44a0-879c-5e088768f91c
33602024-12-19T01:03:24.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156633 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:36448 req_id = c1d00995-56b4-429c-98c5-889e6df4f332 response_code = 201 uri = /metrics/producers
33612024-12-19T01:03:24.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 58f87b4f-fe66-44a3-a276-e53d870d8f9e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33622024-12-19T01:03:24.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 58f87b4f-fe66-44a3-a276-e53d870d8f9e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33632024-12-19T01:03:24.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 58f87b4f-fe66-44a3-a276-e53d870d8f9e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33642024-12-19T01:03:25.555ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:63358
33652024-12-19T01:03:25.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63358 req_id = 7c4818bb-9360-43ab-aa34-cdf08e8e8806 roles = RoleSet { roles: {} } uri = /metrics/producers
33662024-12-19T01:03:25.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63358 req_id = 7c4818bb-9360-43ab-aa34-cdf08e8e8806 resource = Database result = Ok(()) uri = /metrics/producers
33672024-12-19T01:03:25.555ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:41897
33682024-12-19T01:03:25.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41897 req_id = 37c7f536-398b-44e4-8aa8-278f113bcb78 roles = RoleSet { roles: {} } uri = /metrics/producers
33692024-12-19T01:03:25.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41897 req_id = 37c7f536-398b-44e4-8aa8-278f113bcb78 resource = Database result = Ok(()) uri = /metrics/producers
33702024-12-19T01:03:25.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ef6cdff4-7d6e-4c38-9d7d-e592fe9673e9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33712024-12-19T01:03:25.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ef6cdff4-7d6e-4c38-9d7d-e592fe9673e9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33722024-12-19T01:03:25.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ef6cdff4-7d6e-4c38-9d7d-e592fe9673e9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33732024-12-19T01:03:25.613ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 9544d6fb-0646-44f2-8d7c-f02b0fe1f856
33742024-12-19T01:03:25.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57929 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41897 req_id = 37c7f536-398b-44e4-8aa8-278f113bcb78 response_code = 201 uri = /metrics/producers
33752024-12-19T01:03:25.625ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = a59c27fd-a846-41a8-8577-0c2618144732
33762024-12-19T01:03:25.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69942 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63358 req_id = 7c4818bb-9360-43ab-aa34-cdf08e8e8806 response_code = 201 uri = /metrics/producers
33772024-12-19T01:03:25.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1306 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 2811b3db-e7cf-4b33-88d4-5140f00bade7 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
33782024-12-19T01:03:25.959ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:34363
33792024-12-19T01:03:25.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34363 req_id = 6f82961e-736f-42be-b8ad-4e104a6f5853 roles = RoleSet { roles: {} } uri = /metrics/producers
33802024-12-19T01:03:25.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34363 req_id = 6f82961e-736f-42be-b8ad-4e104a6f5853 resource = Database result = Ok(()) uri = /metrics/producers
33812024-12-19T01:03:25.984ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 51ab14f8-f146-4958-aacf-1a2334aec785
33822024-12-19T01:03:25.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25091 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34363 req_id = 6f82961e-736f-42be-b8ad-4e104a6f5853 response_code = 201 uri = /metrics/producers
33832024-12-19T01:03:26.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 67e2caba-daa5-4972-96ff-9163cdd8f099 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33842024-12-19T01:03:26.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 67e2caba-daa5-4972-96ff-9163cdd8f099 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33852024-12-19T01:03:26.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 67e2caba-daa5-4972-96ff-9163cdd8f099 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33862024-12-19T01:03:26.675ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:44371
33872024-12-19T01:03:26.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44371 req_id = 3709c8bc-0c3f-48c4-ba0c-33e83a44c549 roles = RoleSet { roles: {} } uri = /metrics/producers
33882024-12-19T01:03:26.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44371 req_id = 3709c8bc-0c3f-48c4-ba0c-33e83a44c549 resource = Database result = Ok(()) uri = /metrics/producers
33892024-12-19T01:03:26.716ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 9f4eb089-639f-444f-a6bb-061685ba22f0
33902024-12-19T01:03:26.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41229 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44371 req_id = 3709c8bc-0c3f-48c4-ba0c-33e83a44c549 response_code = 201 uri = /metrics/producers
33912024-12-19T01:03:27.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7795b3f1-1ab5-4a34-ab6c-96d4c7a3d920 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33922024-12-19T01:03:27.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7795b3f1-1ab5-4a34-ab6c-96d4c7a3d920 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33932024-12-19T01:03:27.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7795b3f1-1ab5-4a34-ab6c-96d4c7a3d920 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33942024-12-19T01:03:28.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 13d43e5a-a728-4ec5-93f7-e412aa3eb440 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33952024-12-19T01:03:28.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 13d43e5a-a728-4ec5-93f7-e412aa3eb440 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33962024-12-19T01:03:28.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2639 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 13d43e5a-a728-4ec5-93f7-e412aa3eb440 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33972024-12-19T01:03:29.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8ef10213-8e3b-4726-8af6-9ddc1bef52e8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33982024-12-19T01:03:29.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8ef10213-8e3b-4726-8af6-9ddc1bef52e8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
33992024-12-19T01:03:29.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8ef10213-8e3b-4726-8af6-9ddc1bef52e8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34002024-12-19T01:03:30.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d507990d-3ea1-489c-9c8a-cf65ac36b8fb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34012024-12-19T01:03:30.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d507990d-3ea1-489c-9c8a-cf65ac36b8fb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34022024-12-19T01:03:30.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d507990d-3ea1-489c-9c8a-cf65ac36b8fb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34032024-12-19T01:03:31.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
34042024-12-19T01:03:31.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
34052024-12-19T01:03:31.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34062024-12-19T01:03:31.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34072024-12-19T01:03:31.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34082024-12-19T01:03:31.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34092024-12-19T01:03:31.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34102024-12-19T01:03:31.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34112024-12-19T01:03:31.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34122024-12-19T01:03:31.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34132024-12-19T01:03:31.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34142024-12-19T01:03:31.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34152024-12-19T01:03:31.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34162024-12-19T01:03:31.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34172024-12-19T01:03:31.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34182024-12-19T01:03:31.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
34192024-12-19T01:03:31.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34202024-12-19T01:03:31.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34212024-12-19T01:03:31.404ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
34222024-12-19T01:03:31.404ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.533328ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
34232024-12-19T01:03:31.413ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.989273ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34242024-12-19T01:03:31.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3b343628-e223-4806-8939-2c72fb184822 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34252024-12-19T01:03:31.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3b343628-e223-4806-8939-2c72fb184822 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34262024-12-19T01:03:31.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3b343628-e223-4806-8939-2c72fb184822 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34272024-12-19T01:03:32.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ef9c470a-5bdc-44ab-9756-05a2f5cfcbf2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34282024-12-19T01:03:32.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ef9c470a-5bdc-44ab-9756-05a2f5cfcbf2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34292024-12-19T01:03:32.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ef9c470a-5bdc-44ab-9756-05a2f5cfcbf2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34302024-12-19T01:03:33.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f1ad0beb-e56e-4e6f-92bf-68c40db28481 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34312024-12-19T01:03:33.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f1ad0beb-e56e-4e6f-92bf-68c40db28481 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34322024-12-19T01:03:33.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f1ad0beb-e56e-4e6f-92bf-68c40db28481 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34332024-12-19T01:03:34.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = aba994c7-8299-4264-9599-c3c6ef13cfa4 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34342024-12-19T01:03:34.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = aba994c7-8299-4264-9599-c3c6ef13cfa4 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34352024-12-19T01:03:34.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = aba994c7-8299-4264-9599-c3c6ef13cfa4 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34362024-12-19T01:03:35.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1590 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 8fa55e45-c8eb-48b8-9830-3465dacbda87 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
34372024-12-19T01:03:35.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5592903b-cdf6-4e17-bb73-ece44fecf984 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34382024-12-19T01:03:35.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5592903b-cdf6-4e17-bb73-ece44fecf984 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34392024-12-19T01:03:35.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5592903b-cdf6-4e17-bb73-ece44fecf984 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34402024-12-19T01:03:36.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e1717e76-1ec7-4e97-9fae-96a387504bbe roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34412024-12-19T01:03:36.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e1717e76-1ec7-4e97-9fae-96a387504bbe resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34422024-12-19T01:03:36.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e1717e76-1ec7-4e97-9fae-96a387504bbe response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34432024-12-19T01:03:37.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d1eeb246-b6e6-465a-a251-8f9c2fcf4269 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34442024-12-19T01:03:37.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d1eeb246-b6e6-465a-a251-8f9c2fcf4269 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34452024-12-19T01:03:37.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d1eeb246-b6e6-465a-a251-8f9c2fcf4269 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34462024-12-19T01:03:38.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c3114635-d856-435e-9ffe-0904b2d548dd roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34472024-12-19T01:03:38.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c3114635-d856-435e-9ffe-0904b2d548dd resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34482024-12-19T01:03:38.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c3114635-d856-435e-9ffe-0904b2d548dd response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34492024-12-19T01:03:39.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f21a77e5-fc6d-48b3-9d3c-a6d52d431945 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34502024-12-19T01:03:39.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f21a77e5-fc6d-48b3-9d3c-a6d52d431945 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34512024-12-19T01:03:39.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f21a77e5-fc6d-48b3-9d3c-a6d52d431945 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34522024-12-19T01:03:40.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8aa29a70-3d3b-43e4-a413-3b385f6c2b98 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34532024-12-19T01:03:40.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8aa29a70-3d3b-43e4-a413-3b385f6c2b98 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34542024-12-19T01:03:40.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8aa29a70-3d3b-43e4-a413-3b385f6c2b98 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34552024-12-19T01:03:41.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
34562024-12-19T01:03:41.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
34572024-12-19T01:03:41.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34582024-12-19T01:03:41.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34592024-12-19T01:03:41.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34602024-12-19T01:03:41.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34612024-12-19T01:03:41.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34622024-12-19T01:03:41.376ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34632024-12-19T01:03:41.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34642024-12-19T01:03:41.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.358519ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34652024-12-19T01:03:41.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34662024-12-19T01:03:41.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34672024-12-19T01:03:41.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34682024-12-19T01:03:41.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34692024-12-19T01:03:41.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34702024-12-19T01:03:41.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34712024-12-19T01:03:41.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
34722024-12-19T01:03:41.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34732024-12-19T01:03:41.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34742024-12-19T01:03:41.395ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
34752024-12-19T01:03:41.395ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.592473ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
34762024-12-19T01:03:41.418ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:34153
34772024-12-19T01:03:41.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34153 req_id = 5b90ad5a-743f-42a4-8c0e-a252da5ab041 roles = RoleSet { roles: {} } uri = /metrics/producers
34782024-12-19T01:03:41.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34153 req_id = 5b90ad5a-743f-42a4-8c0e-a252da5ab041 resource = Database result = Ok(()) uri = /metrics/producers
34792024-12-19T01:03:41.468ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = ac09f416-2290-4c96-b514-dc021f54a2f5
34802024-12-19T01:03:41.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50483 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34153 req_id = 5b90ad5a-743f-42a4-8c0e-a252da5ab041 response_code = 201 uri = /metrics/producers
34812024-12-19T01:03:41.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 73692283-4653-4822-a069-adb9f2ca6ff9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34822024-12-19T01:03:41.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 73692283-4653-4822-a069-adb9f2ca6ff9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34832024-12-19T01:03:41.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 73692283-4653-4822-a069-adb9f2ca6ff9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34842024-12-19T01:03:42.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fa8e6245-fe31-4096-a0ff-56c972e33354 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34852024-12-19T01:03:42.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fa8e6245-fe31-4096-a0ff-56c972e33354 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34862024-12-19T01:03:42.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fa8e6245-fe31-4096-a0ff-56c972e33354 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34872024-12-19T01:03:43.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 94386c2a-2988-4661-98bb-fd11934463ee roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34882024-12-19T01:03:43.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 94386c2a-2988-4661-98bb-fd11934463ee resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34892024-12-19T01:03:43.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 94386c2a-2988-4661-98bb-fd11934463ee response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34902024-12-19T01:03:44.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f11e46f8-eb1b-439d-a2a3-1e53f3b8f556 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34912024-12-19T01:03:44.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f11e46f8-eb1b-439d-a2a3-1e53f3b8f556 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34922024-12-19T01:03:44.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f11e46f8-eb1b-439d-a2a3-1e53f3b8f556 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34932024-12-19T01:03:45.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1317 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = aaf0cc1d-41cc-40b5-bd2a-e2e18488c22f response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
34942024-12-19T01:03:46.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 64c74d49-29c9-453c-9d6b-d5a4c81bffa2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34952024-12-19T01:03:46.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 64c74d49-29c9-453c-9d6b-d5a4c81bffa2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34962024-12-19T01:03:46.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 64c74d49-29c9-453c-9d6b-d5a4c81bffa2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34972024-12-19T01:03:47.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8d838daa-b932-43a5-924f-dfae4cbec24a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34982024-12-19T01:03:47.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8d838daa-b932-43a5-924f-dfae4cbec24a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
34992024-12-19T01:03:47.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8d838daa-b932-43a5-924f-dfae4cbec24a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
35002024-12-19T01:03:48.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0d0f6df2-11c5-4c0b-87c4-0d0816ec2989 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
35012024-12-19T01:03:48.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0d0f6df2-11c5-4c0b-87c4-0d0816ec2989 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
35022024-12-19T01:03:48.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0d0f6df2-11c5-4c0b-87c4-0d0816ec2989 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
35032024-12-19T01:03:49.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e0eded32-6986-45d7-b060-0dfb228e9fbb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
35042024-12-19T01:03:49.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e0eded32-6986-45d7-b060-0dfb228e9fbb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
35052024-12-19T01:03:49.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e0eded32-6986-45d7-b060-0dfb228e9fbb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
35062024-12-19T01:03:50.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bc4e11cf-0cda-40c9-8757-8bb637fa051e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
35072024-12-19T01:03:50.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bc4e11cf-0cda-40c9-8757-8bb637fa051e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
35082024-12-19T01:03:50.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bc4e11cf-0cda-40c9-8757-8bb637fa051e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
35092024-12-19T01:03:51.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a005fa14-3da9-4c96-b5cb-d0966dd72c57 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
35102024-12-19T01:03:51.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a005fa14-3da9-4c96-b5cb-d0966dd72c57 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
35112024-12-19T01:03:51.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a005fa14-3da9-4c96-b5cb-d0966dd72c57 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
35122024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
35132024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
35142024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
35152024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
35162024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35172024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35182024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
35192024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35202024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35212024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
35222024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35232024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35242024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
35252024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35262024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
35272024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
35282024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35292024-12-19T01:03:51.373ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35302024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
35312024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35322024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35332024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
35342024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35352024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
35362024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35372024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
35382024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35392024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
35402024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35412024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
35422024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35432024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
35442024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35452024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
35462024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35472024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35482024-12-19T01:03:51.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35492024-12-19T01:03:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35502024-12-19T01:03:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35512024-12-19T01:03:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35522024-12-19T01:03:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35532024-12-19T01:03:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35542024-12-19T01:03:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35552024-12-19T01:03:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35562024-12-19T01:03:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35572024-12-19T01:03:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35582024-12-19T01:03:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35592024-12-19T01:03:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35602024-12-19T01:03:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35612024-12-19T01:03:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35622024-12-19T01:03:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35632024-12-19T01:03:51.376ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35642024-12-19T01:03:51.376ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35652024-12-19T01:03:51.376ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.810458ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35662024-12-19T01:03:51.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35672024-12-19T01:03:51.378ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1120, tv_nsec: 222782100 } })
35682024-12-19T01:03:51.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35692024-12-19T01:03:51.378ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35702024-12-19T01:03:51.378ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
35712024-12-19T01:03:51.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35722024-12-19T01:03:51.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35732024-12-19T01:03:51.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35742024-12-19T01:03:51.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35752024-12-19T01:03:51.380ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.583169ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
35762024-12-19T01:03:51.381ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35772024-12-19T01:03:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35782024-12-19T01:03:51.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35792024-12-19T01:03:51.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35802024-12-19T01:03:51.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35812024-12-19T01:03:51.384ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35822024-12-19T01:03:51.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35832024-12-19T01:03:51.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35842024-12-19T01:03:51.387ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35852024-12-19T01:03:51.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35862024-12-19T01:03:51.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35872024-12-19T01:03:51.395ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35882024-12-19T01:03:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35892024-12-19T01:03:51.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35902024-12-19T01:03:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35912024-12-19T01:03:51.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35922024-12-19T01:03:51.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35932024-12-19T01:03:51.403ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1120, tv_nsec: 247665518 } })
35942024-12-19T01:03:51.403ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
35952024-12-19T01:03:51.405ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1120, tv_nsec: 250092511 } })
35962024-12-19T01:03:51.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
35972024-12-19T01:03:51.408ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35982024-12-19T01:03:51.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35992024-12-19T01:03:51.425ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36002024-12-19T01:03:51.425ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36012024-12-19T01:03:51.425ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36022024-12-19T01:03:51.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36032024-12-19T01:03:51.435ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36042024-12-19T01:03:51.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36052024-12-19T01:03:51.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36062024-12-19T01:03:51.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36072024-12-19T01:03:51.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36082024-12-19T01:03:51.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36092024-12-19T01:03:51.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36102024-12-19T01:03:51.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36112024-12-19T01:03:51.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36122024-12-19T01:03:51.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36132024-12-19T01:03:51.447ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36142024-12-19T01:03:51.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
36152024-12-19T01:03:51.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36162024-12-19T01:03:51.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36172024-12-19T01:03:51.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36182024-12-19T01:03:51.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36192024-12-19T01:03:51.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
36202024-12-19T01:03:51.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36212024-12-19T01:03:51.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36222024-12-19T01:03:51.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36232024-12-19T01:03:51.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36242024-12-19T01:03:51.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36252024-12-19T01:03:51.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36262024-12-19T01:03:51.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36272024-12-19T01:03:51.454ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.256704ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
36282024-12-19T01:03:51.456ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 83.191529ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
36292024-12-19T01:03:51.469ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36302024-12-19T01:03:51.469ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
36312024-12-19T01:03:51.469ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36322024-12-19T01:03:51.469ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc590cac-c4e2-4f63-b619-21c79b47ec25", "content-length": "26", "date": "Thu, 19 Dec 2024 01:03:51 GMT"} })
36332024-12-19T01:03:51.469ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36342024-12-19T01:03:51.470ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
36352024-12-19T01:03:51.470ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.575692ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
36362024-12-19T01:03:51.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36372024-12-19T01:03:51.471ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36382024-12-19T01:03:51.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36392024-12-19T01:03:51.472ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36402024-12-19T01:03:51.475ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36412024-12-19T01:03:51.475ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36422024-12-19T01:03:51.475ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36432024-12-19T01:03:51.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36442024-12-19T01:03:51.480ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.507356ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36452024-12-19T01:03:51.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36462024-12-19T01:03:51.486ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36472024-12-19T01:03:51.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36482024-12-19T01:03:51.489ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
36492024-12-19T01:03:51.489ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36502024-12-19T01:03:51.489ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76852bc2-cd1c-46ab-b23b-76fbb8e37c55", "content-length": "26", "date": "Thu, 19 Dec 2024 01:03:51 GMT"} })
36512024-12-19T01:03:51.489ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36522024-12-19T01:03:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
36532024-12-19T01:03:51.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36542024-12-19T01:03:51.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36552024-12-19T01:03:51.491ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
36562024-12-19T01:03:51.492ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.661572ms iteration = 12 status = 0
36572024-12-19T01:03:51.498ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
36582024-12-19T01:03:51.499ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36592024-12-19T01:03:51.499ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "15a23441-4081-4cb1-9a96-26df1fd46462", "content-length": "26", "date": "Thu, 19 Dec 2024 01:03:51 GMT"} })
36602024-12-19T01:03:51.499ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36612024-12-19T01:03:51.501ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36622024-12-19T01:03:51.502ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 128.615906ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36632024-12-19T01:03:51.510ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36642024-12-19T01:03:51.510ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 137.103351ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36652024-12-19T01:03:51.511ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36662024-12-19T01:03:51.511ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36672024-12-19T01:03:51.511ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 138.081275ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36682024-12-19T01:03:51.517ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36692024-12-19T01:03:51.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36702024-12-19T01:03:51.519ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36712024-12-19T01:03:51.523ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36722024-12-19T01:03:51.523ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36732024-12-19T01:03:51.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36742024-12-19T01:03:51.538ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 165.040611ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
36752024-12-19T01:03:51.552ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36762024-12-19T01:03:51.554ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36772024-12-19T01:03:51.554ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36782024-12-19T01:03:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36792024-12-19T01:03:51.602ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 228.628635ms iteration = 15 status = {"physical_disks_added":0}
36802024-12-19T01:03:51.643ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 269.54218ms iteration = 12 status = {}
36812024-12-19T01:03:51.669ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36822024-12-19T01:03:51.669ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36832024-12-19T01:03:51.669ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2953d262-6932-4dcf-b017-1e7afcb7a03e", "content-length": "372", "date": "Thu, 19 Dec 2024 01:03:51 GMT"} })
36842024-12-19T01:03:51.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36852024-12-19T01:03:51.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36862024-12-19T01:03:51.688ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36872024-12-19T01:03:51.688ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "88df09fe-9efd-4db9-a76e-f4405026e08d", "content-length": "1", "date": "Thu, 19 Dec 2024 01:03:51 GMT"} })
36882024-12-19T01:03:51.690ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36892024-12-19T01:03:51.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36902024-12-19T01:03:51.692ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 318.787969ms iteration = 12 status = null
36912024-12-19T01:03:51.693ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36922024-12-19T01:03:51.693ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "36617326-e007-4a15-9e53-4508655906d1", "content-length": "691", "date": "Thu, 19 Dec 2024 01:03:51 GMT"} })
36932024-12-19T01:03:51.693ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
36942024-12-19T01:03:51.693ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
36952024-12-19T01:03:51.693ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
36962024-12-19T01:03:51.695ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 321.396934ms iteration = 12 status = {}
36972024-12-19T01:03:51.720ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
36982024-12-19T01:03:51.720ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36992024-12-19T01:03:51.720ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b09fec95-8530-4abb-936b-603c52516939", "date": "Thu, 19 Dec 2024 01:03:51 GMT"} })
37002024-12-19T01:03:51.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37012024-12-19T01:03:51.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37022024-12-19T01:03:51.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37032024-12-19T01:03:51.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37042024-12-19T01:03:51.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37052024-12-19T01:03:51.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37062024-12-19T01:03:51.728ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37072024-12-19T01:03:51.728ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37082024-12-19T01:03:51.728ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ce1d7184-8674-47e5-bc7b-9e095ef76f56", "date": "Thu, 19 Dec 2024 01:03:51 GMT"} })
37092024-12-19T01:03:51.730ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 356.998487ms iteration = 13 status = {}
37102024-12-19T01:03:51.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37112024-12-19T01:03:51.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37122024-12-19T01:03:51.734ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
37132024-12-19T01:03:51.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37142024-12-19T01:03:51.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37152024-12-19T01:03:51.743ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
37162024-12-19T01:03:51.743ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf80f760-1a73-450e-9595-f6f345b2f78a", "content-length": "134", "date": "Thu, 19 Dec 2024 01:03:51 GMT"} })
37172024-12-19T01:03:51.743ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37182024-12-19T01:03:51.743ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
37192024-12-19T01:03:51.743ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37202024-12-19T01:03:51.743ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37212024-12-19T01:03:51.743ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37222024-12-19T01:03:51.743ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37232024-12-19T01:03:51.743ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37242024-12-19T01:03:51.743ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37252024-12-19T01:03:51.743ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37262024-12-19T01:03:51.743ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37272024-12-19T01:03:51.744ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
37282024-12-19T01:03:51.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37292024-12-19T01:03:51.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37302024-12-19T01:03:51.746ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
37312024-12-19T01:03:51.746ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "31707047-89cb-4fe8-af9a-87ef01964192", "content-length": "2", "date": "Thu, 19 Dec 2024 01:03:51 GMT"} })
37322024-12-19T01:03:51.746ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
37332024-12-19T01:03:51.746ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9c5cb92-bd80-40b0-92ef-4e15f9ccf5b0", "content-length": "52", "date": "Thu, 19 Dec 2024 01:03:51 GMT"} })
37342024-12-19T01:03:51.746ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
37352024-12-19T01:03:51.746ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37362024-12-19T01:03:51.920ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ae3286ff-02d2-48b3-b06d-717ba5c94105", "date": "Thu, 19 Dec 2024 01:03:51 GMT"} })
37372024-12-19T01:03:51.920ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
37382024-12-19T01:03:51.920ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37392024-12-19T01:03:51.920ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c3514b5-3cd3-4f76-99bc-4f559dbfdcd8", "content-length": "682", "date": "Thu, 19 Dec 2024 01:03:51 GMT"} })
37402024-12-19T01:03:51.920ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37412024-12-19T01:03:51.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37422024-12-19T01:03:51.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37432024-12-19T01:03:51.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37442024-12-19T01:03:51.928ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37452024-12-19T01:03:51.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37462024-12-19T01:03:51.931ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37472024-12-19T01:03:51.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37482024-12-19T01:03:51.937ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 564.296732ms iteration = 12 status = {}
37492024-12-19T01:03:52.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 91e94fe9-cad5-4c56-9975-4d2fa4908973 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37502024-12-19T01:03:52.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 91e94fe9-cad5-4c56-9975-4d2fa4908973 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37512024-12-19T01:03:52.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 91e94fe9-cad5-4c56-9975-4d2fa4908973 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37522024-12-19T01:03:52.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = cd976985-d9c8-4748-8bf0-5635b0ede9f7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
37532024-12-19T01:03:52.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = cd976985-d9c8-4748-8bf0-5635b0ede9f7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
37542024-12-19T01:03:52.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = cd976985-d9c8-4748-8bf0-5635b0ede9f7 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
37552024-12-19T01:03:53.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d85df108-df3c-4a72-86d5-226e6564a2a3 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37562024-12-19T01:03:53.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d85df108-df3c-4a72-86d5-226e6564a2a3 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37572024-12-19T01:03:53.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d85df108-df3c-4a72-86d5-226e6564a2a3 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37582024-12-19T01:03:54.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 06e5fb46-7c6a-474d-b07a-d6017111e188 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37592024-12-19T01:03:54.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 06e5fb46-7c6a-474d-b07a-d6017111e188 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37602024-12-19T01:03:54.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 06e5fb46-7c6a-474d-b07a-d6017111e188 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37612024-12-19T01:03:55.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dd407227-9afd-49cf-b911-1c9967ea1bba roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37622024-12-19T01:03:55.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dd407227-9afd-49cf-b911-1c9967ea1bba resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37632024-12-19T01:03:55.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dd407227-9afd-49cf-b911-1c9967ea1bba response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37642024-12-19T01:03:55.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1464 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 09f36c97-7580-464a-9336-18af20c6af5f response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
37652024-12-19T01:03:56.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 28dbc5d3-8c1b-4c92-9845-e72a4c1baaec roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37662024-12-19T01:03:56.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 28dbc5d3-8c1b-4c92-9845-e72a4c1baaec resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37672024-12-19T01:03:56.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 28dbc5d3-8c1b-4c92-9845-e72a4c1baaec response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37682024-12-19T01:03:57.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1df13c9f-673b-4ba5-91ae-de588c052632 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37692024-12-19T01:03:57.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1df13c9f-673b-4ba5-91ae-de588c052632 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37702024-12-19T01:03:57.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1df13c9f-673b-4ba5-91ae-de588c052632 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37712024-12-19T01:03:58.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cc9d5030-115b-4e60-98ef-4df580fc1c66 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37722024-12-19T01:03:58.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cc9d5030-115b-4e60-98ef-4df580fc1c66 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37732024-12-19T01:03:58.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cc9d5030-115b-4e60-98ef-4df580fc1c66 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37742024-12-19T01:03:59.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 48c1cddd-3113-44ee-aadd-3ef7a889edea roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37752024-12-19T01:03:59.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 48c1cddd-3113-44ee-aadd-3ef7a889edea resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37762024-12-19T01:03:59.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 48c1cddd-3113-44ee-aadd-3ef7a889edea response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37772024-12-19T01:04:00.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f7134dad-0054-46d2-a89d-c0eda262f985 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37782024-12-19T01:04:00.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f7134dad-0054-46d2-a89d-c0eda262f985 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37792024-12-19T01:04:00.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f7134dad-0054-46d2-a89d-c0eda262f985 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37802024-12-19T01:04:01.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c24852f6-201c-468d-bcba-fc39a3bc8bb3 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37812024-12-19T01:04:01.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c24852f6-201c-468d-bcba-fc39a3bc8bb3 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37822024-12-19T01:04:01.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c24852f6-201c-468d-bcba-fc39a3bc8bb3 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
37832024-12-19T01:04:01.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
37842024-12-19T01:04:01.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
37852024-12-19T01:04:01.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37862024-12-19T01:04:01.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37872024-12-19T01:04:01.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37882024-12-19T01:04:01.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37892024-12-19T01:04:01.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37902024-12-19T01:04:01.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37912024-12-19T01:04:01.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37922024-12-19T01:04:01.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37932024-12-19T01:04:01.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37942024-12-19T01:04:01.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37952024-12-19T01:04:01.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37962024-12-19T01:04:01.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
37972024-12-19T01:04:01.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37982024-12-19T01:04:01.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37992024-12-19T01:04:01.396ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
38002024-12-19T01:04:01.396ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.729523ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
38012024-12-19T01:04:01.402ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38022024-12-19T01:04:01.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38032024-12-19T01:04:01.404ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.487747ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38042024-12-19T01:04:02.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3292233a-b103-42bd-b4ae-e2611db063e4 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38052024-12-19T01:04:02.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3292233a-b103-42bd-b4ae-e2611db063e4 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38062024-12-19T01:04:02.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3292233a-b103-42bd-b4ae-e2611db063e4 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38072024-12-19T01:04:03.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ba071405-8e1f-4444-a5fe-1c381cc24387 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38082024-12-19T01:04:03.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ba071405-8e1f-4444-a5fe-1c381cc24387 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38092024-12-19T01:04:03.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ba071405-8e1f-4444-a5fe-1c381cc24387 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38102024-12-19T01:04:03.825ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
38112024-12-19T01:04:03.825ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
38122024-12-19T01:04:03.856ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
38132024-12-19T01:04:03.856ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:42042
38142024-12-19T01:04:03.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42042 req_id = 799bfab5-84d2-4344-85b6-6a1d53aa9434 roles = RoleSet { roles: {} } uri = /metrics/producers
38152024-12-19T01:04:03.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42042 req_id = 799bfab5-84d2-4344-85b6-6a1d53aa9434 resource = Database result = Ok(()) uri = /metrics/producers
38162024-12-19T01:04:03.895ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
38172024-12-19T01:04:03.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39103 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:42042 req_id = 799bfab5-84d2-4344-85b6-6a1d53aa9434 response_code = 201 uri = /metrics/producers
38182024-12-19T01:04:03.895ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "799bfab5-84d2-4344-85b6-6a1d53aa9434", "content-length": "41", "date": "Thu, 19 Dec 2024 01:04:03 GMT"} })
38192024-12-19T01:04:03.896ZDEBGnexus (producer-registration-task): registered with nexus successfully
38202024-12-19T01:04:03.896ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
38212024-12-19T01:04:04.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 21cde4c7-65a2-415e-aed1-0f5a1aa21748 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38222024-12-19T01:04:04.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 21cde4c7-65a2-415e-aed1-0f5a1aa21748 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38232024-12-19T01:04:04.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 21cde4c7-65a2-415e-aed1-0f5a1aa21748 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38242024-12-19T01:04:05.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1fc0962e-d38f-4c38-95c9-66c85b02e893 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38252024-12-19T01:04:05.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1fc0962e-d38f-4c38-95c9-66c85b02e893 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38262024-12-19T01:04:05.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1fc0962e-d38f-4c38-95c9-66c85b02e893 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38272024-12-19T01:04:05.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1414 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 8ab196b6-aa8e-4cfc-94e4-6fe1b624e955 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
38282024-12-19T01:04:06.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b9a7adcd-9ffb-471b-8bfe-c03c83bfb8ae roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38292024-12-19T01:04:06.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b9a7adcd-9ffb-471b-8bfe-c03c83bfb8ae resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38302024-12-19T01:04:06.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b9a7adcd-9ffb-471b-8bfe-c03c83bfb8ae response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38312024-12-19T01:04:07.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 35890fb9-f31e-4c2b-bdde-085451d01dc8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38322024-12-19T01:04:07.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 35890fb9-f31e-4c2b-bdde-085451d01dc8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38332024-12-19T01:04:07.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 35890fb9-f31e-4c2b-bdde-085451d01dc8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38342024-12-19T01:04:08.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1456152c-bb0d-49fa-8835-f58ff8367579 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38352024-12-19T01:04:08.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1456152c-bb0d-49fa-8835-f58ff8367579 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38362024-12-19T01:04:08.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1456152c-bb0d-49fa-8835-f58ff8367579 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38372024-12-19T01:04:09.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1e32ea16-bd6d-4aaa-919e-a1a46413e883 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38382024-12-19T01:04:09.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1e32ea16-bd6d-4aaa-919e-a1a46413e883 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38392024-12-19T01:04:09.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1e32ea16-bd6d-4aaa-919e-a1a46413e883 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38402024-12-19T01:04:10.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d3bf0394-e0c5-4eb9-8a76-5bb6f3d27d1e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38412024-12-19T01:04:10.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d3bf0394-e0c5-4eb9-8a76-5bb6f3d27d1e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38422024-12-19T01:04:10.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d3bf0394-e0c5-4eb9-8a76-5bb6f3d27d1e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38432024-12-19T01:04:11.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
38442024-12-19T01:04:11.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
38452024-12-19T01:04:11.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38462024-12-19T01:04:11.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38472024-12-19T01:04:11.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38482024-12-19T01:04:11.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38492024-12-19T01:04:11.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38502024-12-19T01:04:11.376ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38512024-12-19T01:04:11.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38522024-12-19T01:04:11.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.196837ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38532024-12-19T01:04:11.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38542024-12-19T01:04:11.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38552024-12-19T01:04:11.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38562024-12-19T01:04:11.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38572024-12-19T01:04:11.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38582024-12-19T01:04:11.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38592024-12-19T01:04:11.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
38602024-12-19T01:04:11.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38612024-12-19T01:04:11.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38622024-12-19T01:04:11.393ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
38632024-12-19T01:04:11.393ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.469498ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
38642024-12-19T01:04:11.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f9fabc12-4d7d-4d91-9543-103e76fc05cb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38652024-12-19T01:04:11.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f9fabc12-4d7d-4d91-9543-103e76fc05cb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38662024-12-19T01:04:11.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f9fabc12-4d7d-4d91-9543-103e76fc05cb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38672024-12-19T01:04:12.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 46ecb1bc-7c2e-4304-916b-f764b7afbf14 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38682024-12-19T01:04:12.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 46ecb1bc-7c2e-4304-916b-f764b7afbf14 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38692024-12-19T01:04:12.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 46ecb1bc-7c2e-4304-916b-f764b7afbf14 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38702024-12-19T01:04:13.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5d39aa00-e2c8-41b7-a241-bb280a8de6bc roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38712024-12-19T01:04:13.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5d39aa00-e2c8-41b7-a241-bb280a8de6bc resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38722024-12-19T01:04:13.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5d39aa00-e2c8-41b7-a241-bb280a8de6bc response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38732024-12-19T01:04:14.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e3cabfe7-274d-4222-94ba-baf8320a7895 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38742024-12-19T01:04:14.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e3cabfe7-274d-4222-94ba-baf8320a7895 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38752024-12-19T01:04:14.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e3cabfe7-274d-4222-94ba-baf8320a7895 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38762024-12-19T01:04:15.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ab7c7be9-c005-4f58-b7ae-5fe80fd77d43 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38772024-12-19T01:04:15.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ab7c7be9-c005-4f58-b7ae-5fe80fd77d43 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38782024-12-19T01:04:15.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ab7c7be9-c005-4f58-b7ae-5fe80fd77d43 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38792024-12-19T01:04:15.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1375 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 24febd9a-cff7-4908-b490-72b6e86ee499 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
38802024-12-19T01:04:16.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c358089e-0db6-43b3-9a88-d7cf1a49ecab roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38812024-12-19T01:04:16.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c358089e-0db6-43b3-9a88-d7cf1a49ecab resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38822024-12-19T01:04:16.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c358089e-0db6-43b3-9a88-d7cf1a49ecab response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38832024-12-19T01:04:17.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5413fe53-22ff-4809-82b4-9a177e9d7397 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38842024-12-19T01:04:17.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5413fe53-22ff-4809-82b4-9a177e9d7397 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38852024-12-19T01:04:17.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5413fe53-22ff-4809-82b4-9a177e9d7397 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38862024-12-19T01:04:18.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f49fafe-d4cc-4162-8b3f-59c93fffa0f6 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38872024-12-19T01:04:18.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f49fafe-d4cc-4162-8b3f-59c93fffa0f6 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38882024-12-19T01:04:18.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2753 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f49fafe-d4cc-4162-8b3f-59c93fffa0f6 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38892024-12-19T01:04:19.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2dfa7989-9288-45d8-9050-040118ad2282 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38902024-12-19T01:04:19.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2dfa7989-9288-45d8-9050-040118ad2282 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38912024-12-19T01:04:19.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2dfa7989-9288-45d8-9050-040118ad2282 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38922024-12-19T01:04:20.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 22bd0384-12c4-490d-8009-dc3637c87003 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38932024-12-19T01:04:20.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 22bd0384-12c4-490d-8009-dc3637c87003 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38942024-12-19T01:04:20.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 22bd0384-12c4-490d-8009-dc3637c87003 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
38952024-12-19T01:04:21.372ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
38962024-12-19T01:04:21.372ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38972024-12-19T01:04:21.372ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
38982024-12-19T01:04:21.372ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
38992024-12-19T01:04:21.372ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
39002024-12-19T01:04:21.372ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39012024-12-19T01:04:21.372ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
39022024-12-19T01:04:21.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39032024-12-19T01:04:21.372ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
39042024-12-19T01:04:21.372ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39052024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
39062024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39072024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39082024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
39092024-12-19T01:04:21.373ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a
39102024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
39112024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.71\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a"}
39122024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
39132024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
39142024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
39152024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
39162024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
39172024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39182024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39192024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39202024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39212024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
39222024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39232024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
39242024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
39252024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
39262024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
39272024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39282024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
39292024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39302024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39312024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
39322024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39332024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
39342024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
39352024-12-19T01:04:21.373ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39362024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
39372024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39382024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39392024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39402024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
39412024-12-19T01:04:21.373ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 00:54:21.373176239 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39422024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39432024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
39442024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39452024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
39462024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39472024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
39482024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39492024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
39502024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39512024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
39522024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
39532024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39542024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39552024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
39562024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39572024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
39582024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39592024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39602024-12-19T01:04:21.373ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a880a2e-2471-4fd8-9ad5-3e0c3fbde317.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1150, tv_nsec: 217856500 } })
39612024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39622024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39632024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39642024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39652024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
39662024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39672024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39682024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39692024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39702024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39712024-12-19T01:04:21.373ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0018a454-75c0-41b1-be69-9476391f01e1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("050cdbd7-4ebc-471c-b4dc-ec1b3741f763.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1150, tv_nsec: 218001142 } })
39722024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39732024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39742024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
39752024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
39762024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39772024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39782024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39792024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
39802024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39812024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39822024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
39832024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39842024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39852024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39862024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39872024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39882024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39892024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
39902024-12-19T01:04:21.373ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 977.643\u{b5}s iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
39912024-12-19T01:04:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39922024-12-19T01:04:21.374ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39932024-12-19T01:04:21.374ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
39942024-12-19T01:04:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39952024-12-19T01:04:21.374ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.324068ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
39962024-12-19T01:04:21.374ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39972024-12-19T01:04:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39982024-12-19T01:04:21.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39992024-12-19T01:04:21.376ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40002024-12-19T01:04:21.376ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1150, tv_nsec: 220541147 } })
40012024-12-19T01:04:21.376ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40022024-12-19T01:04:21.376ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
40032024-12-19T01:04:21.376ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40042024-12-19T01:04:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40052024-12-19T01:04:21.377ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.363719ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40062024-12-19T01:04:21.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40072024-12-19T01:04:21.379ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40082024-12-19T01:04:21.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40092024-12-19T01:04:21.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40102024-12-19T01:04:21.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40112024-12-19T01:04:21.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40122024-12-19T01:04:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40132024-12-19T01:04:21.380ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40142024-12-19T01:04:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40152024-12-19T01:04:21.381ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40162024-12-19T01:04:21.382ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40172024-12-19T01:04:21.382ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40182024-12-19T01:04:21.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40192024-12-19T01:04:21.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40202024-12-19T01:04:21.384ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40212024-12-19T01:04:21.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40222024-12-19T01:04:21.385ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40232024-12-19T01:04:21.385ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40242024-12-19T01:04:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40252024-12-19T01:04:21.386ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 00:54:21.373176239 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
40262024-12-19T01:04:21.387ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.784098ms iteration = 7 status = {"expiration":"2024-12-19T00:54:21.373176239Z","pruned":[]}
40272024-12-19T01:04:21.390ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.196923ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
40282024-12-19T01:04:21.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40292024-12-19T01:04:21.391ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1150, tv_nsec: 236177499 } })
40302024-12-19T01:04:21.392ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
40312024-12-19T01:04:21.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40322024-12-19T01:04:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40332024-12-19T01:04:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40342024-12-19T01:04:21.395ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40352024-12-19T01:04:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40362024-12-19T01:04:21.403ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40372024-12-19T01:04:21.403ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40382024-12-19T01:04:21.405ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1150, tv_nsec: 250258240 } })
40392024-12-19T01:04:21.406ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
40402024-12-19T01:04:21.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40412024-12-19T01:04:21.406ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40422024-12-19T01:04:21.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40432024-12-19T01:04:21.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40442024-12-19T01:04:21.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40452024-12-19T01:04:21.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40462024-12-19T01:04:21.420ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40472024-12-19T01:04:21.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40482024-12-19T01:04:21.431ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40492024-12-19T01:04:21.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40502024-12-19T01:04:21.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.337807ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
40512024-12-19T01:04:21.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40522024-12-19T01:04:21.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40532024-12-19T01:04:21.449ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40542024-12-19T01:04:21.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40552024-12-19T01:04:21.452ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40562024-12-19T01:04:21.453ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
40572024-12-19T01:04:21.453ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
40582024-12-19T01:04:21.453ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
40592024-12-19T01:04:21.453ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40602024-12-19T01:04:21.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40612024-12-19T01:04:21.453ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40622024-12-19T01:04:21.453ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40632024-12-19T01:04:21.453ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40642024-12-19T01:04:21.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40652024-12-19T01:04:21.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40662024-12-19T01:04:21.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 82.356358ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
40672024-12-19T01:04:21.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40682024-12-19T01:04:21.455ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40692024-12-19T01:04:21.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
40702024-12-19T01:04:21.460ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40712024-12-19T01:04:21.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40722024-12-19T01:04:21.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
40732024-12-19T01:04:21.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40742024-12-19T01:04:21.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40752024-12-19T01:04:21.462ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40762024-12-19T01:04:21.464ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40772024-12-19T01:04:21.465ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40782024-12-19T01:04:21.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40792024-12-19T01:04:21.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40802024-12-19T01:04:21.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40812024-12-19T01:04:21.466ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
40822024-12-19T01:04:21.466ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
40832024-12-19T01:04:21.466ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 93.291407ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
40842024-12-19T01:04:21.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40852024-12-19T01:04:21.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40862024-12-19T01:04:21.468ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40872024-12-19T01:04:21.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40882024-12-19T01:04:21.469ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40892024-12-19T01:04:21.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40902024-12-19T01:04:21.473ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40912024-12-19T01:04:21.473ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40922024-12-19T01:04:21.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
40932024-12-19T01:04:21.473ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40942024-12-19T01:04:21.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40952024-12-19T01:04:21.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
40962024-12-19T01:04:21.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 117.970882ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40972024-12-19T01:04:21.491ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
40982024-12-19T01:04:21.491ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
40992024-12-19T01:04:21.491ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
41002024-12-19T01:04:21.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41012024-12-19T01:04:21.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41022024-12-19T01:04:21.492ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
41032024-12-19T01:04:21.492ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 119.733686ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
41042024-12-19T01:04:21.494ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41052024-12-19T01:04:21.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41062024-12-19T01:04:21.495ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41072024-12-19T01:04:21.495ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41082024-12-19T01:04:21.497ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
41092024-12-19T01:04:21.497ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
41102024-12-19T01:04:21.497ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 124.299438ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
41112024-12-19T01:04:21.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
41122024-12-19T01:04:21.498ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41132024-12-19T01:04:21.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41142024-12-19T01:04:21.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41152024-12-19T01:04:21.499ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41162024-12-19T01:04:21.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41172024-12-19T01:04:21.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41182024-12-19T01:04:21.499ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41192024-12-19T01:04:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41202024-12-19T01:04:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41212024-12-19T01:04:21.500ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41222024-12-19T01:04:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41232024-12-19T01:04:21.503ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 130.435051ms iteration = 4 status = {"nsuccess":5}
41242024-12-19T01:04:21.503ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41252024-12-19T01:04:21.504ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41262024-12-19T01:04:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41272024-12-19T01:04:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41282024-12-19T01:04:21.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41292024-12-19T01:04:21.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41302024-12-19T01:04:21.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41312024-12-19T01:04:21.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41322024-12-19T01:04:21.509ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41332024-12-19T01:04:21.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41342024-12-19T01:04:21.511ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 138.187017ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41352024-12-19T01:04:21.511ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41362024-12-19T01:04:21.512ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41372024-12-19T01:04:21.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41382024-12-19T01:04:21.512ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 139.18548ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
41392024-12-19T01:04:21.513ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
41402024-12-19T01:04:21.513ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41412024-12-19T01:04:21.513ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b49fc3a7-b49d-49e9-b5fa-f37735a8e969", "content-length": "26", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} })
41422024-12-19T01:04:21.513ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41432024-12-19T01:04:21.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
41442024-12-19T01:04:21.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41452024-12-19T01:04:21.515ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41462024-12-19T01:04:21.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41472024-12-19T01:04:21.518ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41482024-12-19T01:04:21.518ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41492024-12-19T01:04:21.518ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41502024-12-19T01:04:21.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41512024-12-19T01:04:21.518ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 145.06234ms iteration = 13 status = 0
41522024-12-19T01:04:21.522ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41532024-12-19T01:04:21.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41542024-12-19T01:04:21.524ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
41552024-12-19T01:04:21.527ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41562024-12-19T01:04:21.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41572024-12-19T01:04:21.534ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41582024-12-19T01:04:21.537ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41592024-12-19T01:04:21.537ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41602024-12-19T01:04:21.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41612024-12-19T01:04:21.541ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41622024-12-19T01:04:21.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41632024-12-19T01:04:21.545ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41642024-12-19T01:04:21.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41652024-12-19T01:04:21.550ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T00:58:19.687181Z, time_modified: 2024-12-19T00:58:19.687181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }) }
41662024-12-19T01:04:21.550ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 177.608592ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]}},"default_endpoint":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41672024-12-19T01:04:21.555ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41682024-12-19T01:04:21.555ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 182.240125ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41692024-12-19T01:04:21.556ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
41702024-12-19T01:04:21.556ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 0 version = 2
41712024-12-19T01:04:21.556ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41722024-12-19T01:04:21.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41732024-12-19T01:04:21.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41742024-12-19T01:04:21.562ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41752024-12-19T01:04:21.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41762024-12-19T01:04:21.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41772024-12-19T01:04:21.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41782024-12-19T01:04:21.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41792024-12-19T01:04:21.565ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 1 version = 2
41802024-12-19T01:04:21.565ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
41812024-12-19T01:04:21.565ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 00:59:02.707744 UTC dns_group = external generation = 2
41822024-12-19T01:04:21.565ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 192.758398ms iteration = 8 status = {"generation":2}
41832024-12-19T01:04:21.572ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 199.113723ms iteration = 16 status = {"physical_disks_added":0}
41842024-12-19T01:04:21.575ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41852024-12-19T01:04:21.575ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41862024-12-19T01:04:21.575ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 202.395018ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41872024-12-19T01:04:21.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 209.388154ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
41882024-12-19T01:04:21.583ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
41892024-12-19T01:04:21.584ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
41902024-12-19T01:04:21.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41912024-12-19T01:04:21.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41922024-12-19T01:04:21.586ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41932024-12-19T01:04:21.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41942024-12-19T01:04:21.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41952024-12-19T01:04:21.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41962024-12-19T01:04:21.596ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
41972024-12-19T01:04:21.596ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41982024-12-19T01:04:21.596ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 00:59:01.994004 UTC dns_group = internal generation = 1
41992024-12-19T01:04:21.596ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 223.709638ms iteration = 8 status = {"generation":1}
42002024-12-19T01:04:21.608ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
42012024-12-19T01:04:21.622ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
42022024-12-19T01:04:21.622ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42032024-12-19T01:04:21.622ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5cdbc5c-b932-4b36-afac-683c0a446b56", "content-length": "26", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} })
42042024-12-19T01:04:21.622ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42052024-12-19T01:04:21.624ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
42062024-12-19T01:04:21.627ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
42072024-12-19T01:04:21.627ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 254.08398ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
42082024-12-19T01:04:21.706ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 333.63672ms iteration = 13 status = {}
42092024-12-19T01:04:21.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42102024-12-19T01:04:21.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42112024-12-19T01:04:21.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42122024-12-19T01:04:21.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42132024-12-19T01:04:21.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42142024-12-19T01:04:21.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42152024-12-19T01:04:21.743ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
42162024-12-19T01:04:21.744ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5a46a0c4-d432-4e1d-8f1b-1a3de14e13d8", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42172024-12-19T01:04:21.744ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42182024-12-19T01:04:21.745ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3841fc2f-36b9-4865-87ce-d1ccb4cd100a", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42192024-12-19T01:04:21.745ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42202024-12-19T01:04:21.745ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
42212024-12-19T01:04:21.745ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42222024-12-19T01:04:21.745ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aea44d18-44fd-4e6a-8f45-dda9bbb97662", "content-length": "26", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} })
42232024-12-19T01:04:21.745ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42242024-12-19T01:04:21.747ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42252024-12-19T01:04:21.747ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 374.478844ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
42262024-12-19T01:04:21.747ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42272024-12-19T01:04:21.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7c74d641-660c-4d5c-b210-09e56bf584ca roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
42282024-12-19T01:04:21.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7c74d641-660c-4d5c-b210-09e56bf584ca resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
42292024-12-19T01:04:21.811ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
42302024-12-19T01:04:21.813ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
42312024-12-19T01:04:21.813ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42322024-12-19T01:04:21.813ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "34aa2ca6-b209-4b68-b808-8d3c25819551", "content-length": "372", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} })
42332024-12-19T01:04:21.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42342024-12-19T01:04:21.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42352024-12-19T01:04:21.814ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42362024-12-19T01:04:21.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7c74d641-660c-4d5c-b210-09e56bf584ca response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
42372024-12-19T01:04:21.820ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42382024-12-19T01:04:21.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42392024-12-19T01:04:21.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42402024-12-19T01:04:21.835ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
42412024-12-19T01:04:21.835ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "306082ac-86b4-4612-8b81-695463fa8868", "content-length": "1", "date": "Thu, 19 Dec 2024 01:04:20 GMT"} })
42422024-12-19T01:04:21.838ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42432024-12-19T01:04:21.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42442024-12-19T01:04:21.840ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 466.976011ms iteration = 13 status = null
42452024-12-19T01:04:21.868ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
42462024-12-19T01:04:21.868ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
42472024-12-19T01:04:21.868ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d1045be7-ca75-421e-9865-816ef13d6be4", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} })
42482024-12-19T01:04:21.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42492024-12-19T01:04:21.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42502024-12-19T01:04:21.871ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42512024-12-19T01:04:21.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42522024-12-19T01:04:21.871ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
42532024-12-19T01:04:21.872ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "689b37f3-f7ff-42fe-a4a6-2421cce34842", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42542024-12-19T01:04:21.872ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42552024-12-19T01:04:21.873ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "66d8d0bc-d43e-40d5-8dc3-0f561e837d3a", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42562024-12-19T01:04:21.873ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42572024-12-19T01:04:21.874ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e43952ce-db7f-49eb-9773-f6843ee3d055", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42582024-12-19T01:04:21.874ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42592024-12-19T01:04:21.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42602024-12-19T01:04:21.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42612024-12-19T01:04:21.876ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42622024-12-19T01:04:21.876ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 503.569978ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42632024-12-19T01:04:21.878ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42642024-12-19T01:04:21.878ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42652024-12-19T01:04:21.879ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "537e7846-d210-4209-b146-acb95ed3ecbd", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} })
42662024-12-19T01:04:21.880ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 507.819675ms iteration = 14 status = {}
42672024-12-19T01:04:21.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42682024-12-19T01:04:21.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42692024-12-19T01:04:21.981ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42702024-12-19T01:04:21.983ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
42712024-12-19T01:04:21.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42722024-12-19T01:04:21.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42732024-12-19T01:04:21.993ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
42742024-12-19T01:04:21.994ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bef87db1-3263-47c6-af5a-c1ce811e7d27", "content-length": "134", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} })
42752024-12-19T01:04:21.994ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
42762024-12-19T01:04:21.994ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
42772024-12-19T01:04:21.994ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42782024-12-19T01:04:21.994ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42792024-12-19T01:04:21.994ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42802024-12-19T01:04:21.994ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42812024-12-19T01:04:21.994ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42822024-12-19T01:04:21.994ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42832024-12-19T01:04:21.994ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42842024-12-19T01:04:21.994ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42852024-12-19T01:04:21.994ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
42862024-12-19T01:04:21.994ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42872024-12-19T01:04:21.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42882024-12-19T01:04:21.997ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42892024-12-19T01:04:21.997ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "eeb0404a-793d-4e7b-9de0-39fb9a8ff3af", "content-length": "2", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} })
42902024-12-19T01:04:21.997ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42912024-12-19T01:04:21.997ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfd5ac09-3522-45cc-af0a-06578f12ac0c", "content-length": "52", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} })
42922024-12-19T01:04:21.997ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
42932024-12-19T01:04:21.997ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42942024-12-19T01:04:22.016ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a561388f-f75f-4eda-931b-890e430454b2", "content-length": "691", "date": "Thu, 19 Dec 2024 01:04:21 GMT"} })
42952024-12-19T01:04:22.016ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
42962024-12-19T01:04:22.016ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
42972024-12-19T01:04:22.016ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
42982024-12-19T01:04:22.018ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 645.344383ms iteration = 13 status = {}
42992024-12-19T01:04:22.110ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "97fdfe00-c885-4b1d-8a7e-c46814c0ab1d", "date": "Thu, 19 Dec 2024 01:04:22 GMT"} })
43002024-12-19T01:04:22.110ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
43012024-12-19T01:04:22.110ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43022024-12-19T01:04:22.110ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "584a3c13-d965-43ad-a894-a64da17c26f6", "content-length": "682", "date": "Thu, 19 Dec 2024 01:04:22 GMT"} })
43032024-12-19T01:04:22.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43042024-12-19T01:04:22.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43052024-12-19T01:04:22.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43062024-12-19T01:04:22.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43072024-12-19T01:04:22.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43082024-12-19T01:04:22.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43092024-12-19T01:04:22.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43102024-12-19T01:04:22.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43112024-12-19T01:04:22.127ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 754.720907ms iteration = 13 status = {}
43122024-12-19T01:04:22.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = a1d3175f-94c9-4dba-883f-fe5899a4fa41 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
43132024-12-19T01:04:22.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = a1d3175f-94c9-4dba-883f-fe5899a4fa41 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
43142024-12-19T01:04:22.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = a1d3175f-94c9-4dba-883f-fe5899a4fa41 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
43152024-12-19T01:04:22.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1bff5889-dbb6-4d15-a79c-d86615fd7dee roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43162024-12-19T01:04:22.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1bff5889-dbb6-4d15-a79c-d86615fd7dee resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43172024-12-19T01:04:22.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1bff5889-dbb6-4d15-a79c-d86615fd7dee response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43182024-12-19T01:04:23.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 62ce2d68-9b8e-47a3-a04b-6b7e0dd55eea roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43192024-12-19T01:04:23.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 62ce2d68-9b8e-47a3-a04b-6b7e0dd55eea resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43202024-12-19T01:04:23.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 62ce2d68-9b8e-47a3-a04b-6b7e0dd55eea response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43212024-12-19T01:04:24.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9cbaddc3-5b1c-4435-9984-fc0ca2aca9c3 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43222024-12-19T01:04:24.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9cbaddc3-5b1c-4435-9984-fc0ca2aca9c3 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43232024-12-19T01:04:24.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9cbaddc3-5b1c-4435-9984-fc0ca2aca9c3 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43242024-12-19T01:04:25.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1351 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 7dd2f0bb-ce5a-4a23-ba50-e19ccbdb8f99 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
43252024-12-19T01:04:25.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e95202ed-3554-4cea-851a-f9595b871efe roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43262024-12-19T01:04:25.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e95202ed-3554-4cea-851a-f9595b871efe resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43272024-12-19T01:04:25.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e95202ed-3554-4cea-851a-f9595b871efe response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43282024-12-19T01:04:26.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b3077674-c058-483f-bf00-9e33a97c82b7 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43292024-12-19T01:04:26.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b3077674-c058-483f-bf00-9e33a97c82b7 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43302024-12-19T01:04:26.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b3077674-c058-483f-bf00-9e33a97c82b7 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43312024-12-19T01:04:27.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9cb764cb-1abe-4ae4-98a2-fcf10d7da2db roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43322024-12-19T01:04:27.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9cb764cb-1abe-4ae4-98a2-fcf10d7da2db resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43332024-12-19T01:04:27.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9cb764cb-1abe-4ae4-98a2-fcf10d7da2db response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43342024-12-19T01:04:28.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 476e60be-f7fd-42df-9e52-cb4fefc7f2db roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43352024-12-19T01:04:28.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 476e60be-f7fd-42df-9e52-cb4fefc7f2db resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43362024-12-19T01:04:28.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 476e60be-f7fd-42df-9e52-cb4fefc7f2db response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43372024-12-19T01:04:29.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1c5cd527-c109-4dcc-88a3-2c803b563c88 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43382024-12-19T01:04:29.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1c5cd527-c109-4dcc-88a3-2c803b563c88 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43392024-12-19T01:04:29.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1c5cd527-c109-4dcc-88a3-2c803b563c88 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43402024-12-19T01:04:31.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4920cb84-8056-4e2d-903a-d7ccd72cc563 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43412024-12-19T01:04:31.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4920cb84-8056-4e2d-903a-d7ccd72cc563 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43422024-12-19T01:04:31.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4920cb84-8056-4e2d-903a-d7ccd72cc563 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43432024-12-19T01:04:31.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
43442024-12-19T01:04:31.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
43452024-12-19T01:04:31.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43462024-12-19T01:04:31.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43472024-12-19T01:04:31.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43482024-12-19T01:04:31.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43492024-12-19T01:04:31.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43502024-12-19T01:04:31.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43512024-12-19T01:04:31.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43522024-12-19T01:04:31.376ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.67133ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43532024-12-19T01:04:31.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43542024-12-19T01:04:31.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43552024-12-19T01:04:31.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43562024-12-19T01:04:31.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43572024-12-19T01:04:31.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43582024-12-19T01:04:31.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43592024-12-19T01:04:31.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
43602024-12-19T01:04:31.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43612024-12-19T01:04:31.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43622024-12-19T01:04:31.396ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
43632024-12-19T01:04:31.396ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.356827ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
43642024-12-19T01:04:32.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4e1e7824-2988-4766-b23a-3e2d1fe26abf roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43652024-12-19T01:04:32.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4e1e7824-2988-4766-b23a-3e2d1fe26abf resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43662024-12-19T01:04:32.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4e1e7824-2988-4766-b23a-3e2d1fe26abf response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43672024-12-19T01:04:33.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 93b86938-8c04-4ec1-9c56-92012ffa091f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43682024-12-19T01:04:33.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 93b86938-8c04-4ec1-9c56-92012ffa091f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43692024-12-19T01:04:33.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 93b86938-8c04-4ec1-9c56-92012ffa091f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43702024-12-19T01:04:34.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 783160ef-ee64-4971-9e8f-a8450b3980d9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43712024-12-19T01:04:34.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 783160ef-ee64-4971-9e8f-a8450b3980d9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43722024-12-19T01:04:34.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 783160ef-ee64-4971-9e8f-a8450b3980d9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43732024-12-19T01:04:35.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 490b71ed-c4a8-47a9-8881-02b7a1d08576 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43742024-12-19T01:04:35.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 490b71ed-c4a8-47a9-8881-02b7a1d08576 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43752024-12-19T01:04:35.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 490b71ed-c4a8-47a9-8881-02b7a1d08576 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43762024-12-19T01:04:35.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1528 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = e64c6da9-f98a-4799-8d40-5af07c7319ce response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
43772024-12-19T01:04:36.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f76161c6-8252-4f18-a9dc-198aebfcc0ea roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43782024-12-19T01:04:36.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f76161c6-8252-4f18-a9dc-198aebfcc0ea resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43792024-12-19T01:04:36.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f76161c6-8252-4f18-a9dc-198aebfcc0ea response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43802024-12-19T01:04:37.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8336dee0-0a1a-4803-a016-1c6f06b0ac65 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43812024-12-19T01:04:37.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8336dee0-0a1a-4803-a016-1c6f06b0ac65 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43822024-12-19T01:04:37.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8336dee0-0a1a-4803-a016-1c6f06b0ac65 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43832024-12-19T01:04:38.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cff9ece6-41bb-4f4b-9ae3-09577d01f52c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43842024-12-19T01:04:38.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cff9ece6-41bb-4f4b-9ae3-09577d01f52c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43852024-12-19T01:04:38.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cff9ece6-41bb-4f4b-9ae3-09577d01f52c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43862024-12-19T01:04:39.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b74982b7-14c9-4a09-b925-8c4c9de933ab roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43872024-12-19T01:04:39.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b74982b7-14c9-4a09-b925-8c4c9de933ab resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43882024-12-19T01:04:39.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b74982b7-14c9-4a09-b925-8c4c9de933ab response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43892024-12-19T01:04:40.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b5ebdaf8-91de-48ce-95ac-6a834de433f2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43902024-12-19T01:04:40.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b5ebdaf8-91de-48ce-95ac-6a834de433f2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43912024-12-19T01:04:40.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b5ebdaf8-91de-48ce-95ac-6a834de433f2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43922024-12-19T01:04:41.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e87a84b1-1366-4929-9e55-cbeecae081e8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43932024-12-19T01:04:41.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e87a84b1-1366-4929-9e55-cbeecae081e8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43942024-12-19T01:04:41.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e87a84b1-1366-4929-9e55-cbeecae081e8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
43952024-12-19T01:04:41.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
43962024-12-19T01:04:41.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
43972024-12-19T01:04:41.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43982024-12-19T01:04:41.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43992024-12-19T01:04:41.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44002024-12-19T01:04:41.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44012024-12-19T01:04:41.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44022024-12-19T01:04:41.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44032024-12-19T01:04:41.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44042024-12-19T01:04:41.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.068685ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44052024-12-19T01:04:41.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44062024-12-19T01:04:41.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44072024-12-19T01:04:41.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44082024-12-19T01:04:41.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44092024-12-19T01:04:41.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44102024-12-19T01:04:41.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44112024-12-19T01:04:41.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
44122024-12-19T01:04:41.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44132024-12-19T01:04:41.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44142024-12-19T01:04:41.391ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
44152024-12-19T01:04:41.391ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.975764ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
44162024-12-19T01:04:42.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f4f9977-166d-4250-b8fd-f28f6e98dc97 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44172024-12-19T01:04:42.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f4f9977-166d-4250-b8fd-f28f6e98dc97 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44182024-12-19T01:04:42.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f4f9977-166d-4250-b8fd-f28f6e98dc97 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44192024-12-19T01:04:43.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 730f91fd-117d-479d-abf7-b8138c8a6c09 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44202024-12-19T01:04:43.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 730f91fd-117d-479d-abf7-b8138c8a6c09 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44212024-12-19T01:04:43.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 730f91fd-117d-479d-abf7-b8138c8a6c09 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44222024-12-19T01:04:44.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 469fc236-54f1-4c5c-9296-2b9d4655931f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44232024-12-19T01:04:44.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 469fc236-54f1-4c5c-9296-2b9d4655931f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44242024-12-19T01:04:44.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 469fc236-54f1-4c5c-9296-2b9d4655931f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44252024-12-19T01:04:45.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 855b7009-45fd-4cca-9b9d-ab2136b5f699 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44262024-12-19T01:04:45.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 855b7009-45fd-4cca-9b9d-ab2136b5f699 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44272024-12-19T01:04:45.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 855b7009-45fd-4cca-9b9d-ab2136b5f699 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44282024-12-19T01:04:45.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1284 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 579c4341-c711-4729-951f-ed9a16b18766 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
44292024-12-19T01:04:46.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 54477c44-b347-412b-b335-2f6a2e12af03 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44302024-12-19T01:04:46.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 54477c44-b347-412b-b335-2f6a2e12af03 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44312024-12-19T01:04:46.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 54477c44-b347-412b-b335-2f6a2e12af03 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44322024-12-19T01:04:47.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 973733e6-3a1a-433d-9053-b297a78ea8a3 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44332024-12-19T01:04:47.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 973733e6-3a1a-433d-9053-b297a78ea8a3 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44342024-12-19T01:04:47.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 973733e6-3a1a-433d-9053-b297a78ea8a3 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44352024-12-19T01:04:48.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fb7a4a94-0e28-4337-a471-182c756eb19c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44362024-12-19T01:04:48.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fb7a4a94-0e28-4337-a471-182c756eb19c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44372024-12-19T01:04:48.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fb7a4a94-0e28-4337-a471-182c756eb19c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44382024-12-19T01:04:49.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 56f7e6e4-6fc8-410e-acd0-f7ef02f0f208 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44392024-12-19T01:04:49.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 56f7e6e4-6fc8-410e-acd0-f7ef02f0f208 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44402024-12-19T01:04:49.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 56f7e6e4-6fc8-410e-acd0-f7ef02f0f208 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44412024-12-19T01:04:50.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 363d12f1-f45f-4727-bb26-b49c017abba8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44422024-12-19T01:04:50.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 363d12f1-f45f-4727-bb26-b49c017abba8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44432024-12-19T01:04:50.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 363d12f1-f45f-4727-bb26-b49c017abba8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
44442024-12-19T01:04:50.754ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:45377
44452024-12-19T01:04:50.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = f67c0a28-f9ac-437c-9cea-e589b5b8fa39 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
44462024-12-19T01:04:50.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = f67c0a28-f9ac-437c-9cea-e589b5b8fa39 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
44472024-12-19T01:04:50.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = f67c0a28-f9ac-437c-9cea-e589b5b8fa39 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
44482024-12-19T01:04:50.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 22bd1626-844a-4cf8-8753-b2e3f51adc73 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
44492024-12-19T01:04:50.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 22bd1626-844a-4cf8-8753-b2e3f51adc73 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
44502024-12-19T01:04:50.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 22bd1626-844a-4cf8-8753-b2e3f51adc73 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
44512024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
44522024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44532024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
44542024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44552024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
44562024-12-19T01:04:51.373ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
44572024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
44582024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44592024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
44602024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44612024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44622024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
44632024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
44642024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44652024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44662024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
44672024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44682024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44692024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
44702024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44712024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
44722024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
44732024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
44742024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44752024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
44762024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44772024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
44782024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
44792024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44802024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
44812024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
44822024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44832024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
44842024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44852024-12-19T01:04:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44862024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44872024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44882024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44892024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44902024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44912024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44922024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44932024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44942024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44952024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44962024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44972024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44982024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44992024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
45002024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45012024-12-19T01:04:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45022024-12-19T01:04:51.376ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45032024-12-19T01:04:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45042024-12-19T01:04:51.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45052024-12-19T01:04:51.377ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45062024-12-19T01:04:51.378ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.332459ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
45072024-12-19T01:04:51.378ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45082024-12-19T01:04:51.378ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1180, tv_nsec: 222999929 } })
45092024-12-19T01:04:51.379ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
45102024-12-19T01:04:51.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45112024-12-19T01:04:51.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45122024-12-19T01:04:51.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45132024-12-19T01:04:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45142024-12-19T01:04:51.381ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45152024-12-19T01:04:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45162024-12-19T01:04:51.382ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45172024-12-19T01:04:51.382ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45182024-12-19T01:04:51.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45192024-12-19T01:04:51.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45202024-12-19T01:04:51.383ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1180, tv_nsec: 227330017 } })
45212024-12-19T01:04:51.383ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
45222024-12-19T01:04:51.383ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45232024-12-19T01:04:51.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45242024-12-19T01:04:51.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45252024-12-19T01:04:51.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45262024-12-19T01:04:51.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45272024-12-19T01:04:51.387ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45282024-12-19T01:04:51.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45292024-12-19T01:04:51.390ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45302024-12-19T01:04:51.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 17.877613ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45312024-12-19T01:04:51.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45322024-12-19T01:04:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45332024-12-19T01:04:51.393ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1180, tv_nsec: 237606537 } })
45342024-12-19T01:04:51.394ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
45352024-12-19T01:04:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45362024-12-19T01:04:51.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45372024-12-19T01:04:51.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45382024-12-19T01:04:51.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45392024-12-19T01:04:51.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45402024-12-19T01:04:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45412024-12-19T01:04:51.405ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45422024-12-19T01:04:51.405ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45432024-12-19T01:04:51.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45442024-12-19T01:04:51.408ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45452024-12-19T01:04:51.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45462024-12-19T01:04:51.416ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45472024-12-19T01:04:51.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45482024-12-19T01:04:51.416ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45492024-12-19T01:04:51.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45502024-12-19T01:04:51.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45512024-12-19T01:04:51.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
45522024-12-19T01:04:51.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45532024-12-19T01:04:51.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45542024-12-19T01:04:51.427ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45552024-12-19T01:04:51.428ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.631272ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
45562024-12-19T01:04:51.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45572024-12-19T01:04:51.432ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45582024-12-19T01:04:51.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45592024-12-19T01:04:51.433ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45602024-12-19T01:04:51.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45612024-12-19T01:04:51.434ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 60.786425ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45622024-12-19T01:04:51.435ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
45632024-12-19T01:04:51.435ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.600216ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
45642024-12-19T01:04:51.437ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45652024-12-19T01:04:51.437ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45662024-12-19T01:04:51.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45672024-12-19T01:04:51.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45682024-12-19T01:04:51.440ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45692024-12-19T01:04:51.440ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45702024-12-19T01:04:51.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45712024-12-19T01:04:51.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45722024-12-19T01:04:51.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 73bae512-3fb2-413c-ba16-adeb85e89250 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
45732024-12-19T01:04:51.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 73bae512-3fb2-413c-ba16-adeb85e89250 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
45742024-12-19T01:04:51.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45752024-12-19T01:04:51.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45762024-12-19T01:04:51.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 73bae512-3fb2-413c-ba16-adeb85e89250 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
45772024-12-19T01:04:51.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45782024-12-19T01:04:51.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45792024-12-19T01:04:51.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.209854ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
45802024-12-19T01:04:51.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45812024-12-19T01:04:51.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45822024-12-19T01:04:51.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.473211ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
45832024-12-19T01:04:51.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45842024-12-19T01:04:51.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
45852024-12-19T01:04:51.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45862024-12-19T01:04:51.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45872024-12-19T01:04:51.455ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 81.573378ms iteration = 14 status = 0
45882024-12-19T01:04:51.457ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45892024-12-19T01:04:51.457ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45902024-12-19T01:04:51.457ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ba8d2cb-323d-4445-8066-7926c8bc0d13", "content-length": "26", "date": "Thu, 19 Dec 2024 01:04:51 GMT"} })
45912024-12-19T01:04:51.457ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45922024-12-19T01:04:51.458ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45932024-12-19T01:04:51.458ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 84.896142ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45942024-12-19T01:04:51.459ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45952024-12-19T01:04:51.460ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
45962024-12-19T01:04:51.460ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45972024-12-19T01:04:51.461ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 87.532848ms iteration = 17 status = {"physical_disks_added":0}
45982024-12-19T01:04:51.461ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c50b0ff8-42fa-4d06-a774-bb11cae7053c", "content-length": "26", "date": "Thu, 19 Dec 2024 01:04:51 GMT"} })
45992024-12-19T01:04:51.461ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46002024-12-19T01:04:51.462ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
46012024-12-19T01:04:51.464ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46022024-12-19T01:04:51.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46032024-12-19T01:04:51.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 93.980946ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
46042024-12-19T01:04:51.472ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46052024-12-19T01:04:51.472ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46062024-12-19T01:04:51.472ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 98.67082ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46072024-12-19T01:04:51.475ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
46082024-12-19T01:04:51.475ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46092024-12-19T01:04:51.475ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "931925c9-dd7b-4c28-8791-8849e3d49cb9", "content-length": "26", "date": "Thu, 19 Dec 2024 01:04:51 GMT"} })
46102024-12-19T01:04:51.475ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46112024-12-19T01:04:51.477ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46122024-12-19T01:04:51.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46132024-12-19T01:04:51.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46142024-12-19T01:04:51.561ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46152024-12-19T01:04:51.561ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf0d8379-e15e-4560-9a89-b1b9a6314817", "content-length": "1", "date": "Thu, 19 Dec 2024 01:04:51 GMT"} })
46162024-12-19T01:04:51.563ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46172024-12-19T01:04:51.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46182024-12-19T01:04:51.589ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 215.905562ms iteration = 14 status = {}
46192024-12-19T01:04:51.597ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46202024-12-19T01:04:51.597ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46212024-12-19T01:04:51.598ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0a63aeb-0626-42bb-8795-9bf1f529528a", "content-length": "372", "date": "Thu, 19 Dec 2024 01:04:51 GMT"} })
46222024-12-19T01:04:51.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46232024-12-19T01:04:51.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46242024-12-19T01:04:51.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46252024-12-19T01:04:51.600ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 226.708139ms iteration = 14 status = null
46262024-12-19T01:04:51.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46272024-12-19T01:04:51.603ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46282024-12-19T01:04:51.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46292024-12-19T01:04:51.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46302024-12-19T01:04:51.607ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46312024-12-19T01:04:51.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46322024-12-19T01:04:51.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46332024-12-19T01:04:51.659ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
46342024-12-19T01:04:51.659ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46352024-12-19T01:04:51.659ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3d13747f-f8d1-4c96-bdb7-f735f647ea5d", "date": "Thu, 19 Dec 2024 01:04:51 GMT"} })
46362024-12-19T01:04:51.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46372024-12-19T01:04:51.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46382024-12-19T01:04:51.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46392024-12-19T01:04:51.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46402024-12-19T01:04:51.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46412024-12-19T01:04:51.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46422024-12-19T01:04:51.669ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46432024-12-19T01:04:51.669ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46442024-12-19T01:04:51.669ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b5b43898-cd87-4568-a2e3-19f6c619faa3", "date": "Thu, 19 Dec 2024 01:04:51 GMT"} })
46452024-12-19T01:04:51.671ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 297.823254ms iteration = 15 status = {}
46462024-12-19T01:04:51.683ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46472024-12-19T01:04:51.683ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "94e68b7d-59a2-4fee-925f-3a7cb950ca66", "content-length": "691", "date": "Thu, 19 Dec 2024 01:04:51 GMT"} })
46482024-12-19T01:04:51.683ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
46492024-12-19T01:04:51.683ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
46502024-12-19T01:04:51.683ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
46512024-12-19T01:04:51.685ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 312.185039ms iteration = 14 status = {}
46522024-12-19T01:04:51.695ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46532024-12-19T01:04:51.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46542024-12-19T01:04:51.697ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
46552024-12-19T01:04:51.697ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46562024-12-19T01:04:51.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46572024-12-19T01:04:51.711ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46582024-12-19T01:04:51.711ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "783fe69a-59d1-44e8-905b-027068097695", "content-length": "134", "date": "Thu, 19 Dec 2024 01:04:51 GMT"} })
46592024-12-19T01:04:51.711ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46602024-12-19T01:04:51.711ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
46612024-12-19T01:04:51.711ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46622024-12-19T01:04:51.711ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46632024-12-19T01:04:51.711ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46642024-12-19T01:04:51.711ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46652024-12-19T01:04:51.711ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46662024-12-19T01:04:51.711ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46672024-12-19T01:04:51.712ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46682024-12-19T01:04:51.712ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46692024-12-19T01:04:51.712ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
46702024-12-19T01:04:51.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46712024-12-19T01:04:51.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46722024-12-19T01:04:51.715ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46732024-12-19T01:04:51.715ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c273eaa5-ac7a-4d0e-8138-bc569e4415c0", "content-length": "2", "date": "Thu, 19 Dec 2024 01:04:51 GMT"} })
46742024-12-19T01:04:51.715ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46752024-12-19T01:04:51.715ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "933d2a4c-608e-491a-a9e5-5f920bd345cc", "content-length": "52", "date": "Thu, 19 Dec 2024 01:04:51 GMT"} })
46762024-12-19T01:04:51.715ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
46772024-12-19T01:04:51.715ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46782024-12-19T01:04:51.811ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2314827c-13cb-4ee1-ad9c-2df5675b6155", "date": "Thu, 19 Dec 2024 01:04:51 GMT"} })
46792024-12-19T01:04:51.811ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
46802024-12-19T01:04:51.811ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46812024-12-19T01:04:51.812ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8a77141-0349-4781-8c09-30ae39947f3b", "content-length": "682", "date": "Thu, 19 Dec 2024 01:04:51 GMT"} })
46822024-12-19T01:04:51.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46832024-12-19T01:04:51.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46842024-12-19T01:04:51.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46852024-12-19T01:04:51.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46862024-12-19T01:04:51.820ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46872024-12-19T01:04:51.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46882024-12-19T01:04:51.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46892024-12-19T01:04:51.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46902024-12-19T01:04:51.829ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 456.061482ms iteration = 14 status = {}
46912024-12-19T01:04:52.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cfebc934-9dce-4723-9339-fe70cd772974 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
46922024-12-19T01:04:52.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cfebc934-9dce-4723-9339-fe70cd772974 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
46932024-12-19T01:04:52.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cfebc934-9dce-4723-9339-fe70cd772974 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
46942024-12-19T01:04:52.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 6c1eb010-7b6d-4cb8-92bd-e49a27c316bf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
46952024-12-19T01:04:52.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 6c1eb010-7b6d-4cb8-92bd-e49a27c316bf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
46962024-12-19T01:04:52.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3253 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 6c1eb010-7b6d-4cb8-92bd-e49a27c316bf response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
46972024-12-19T01:04:53.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 03482e78-a47f-4b19-8f26-3ef19e5dff0a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
46982024-12-19T01:04:53.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 03482e78-a47f-4b19-8f26-3ef19e5dff0a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
46992024-12-19T01:04:53.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 03482e78-a47f-4b19-8f26-3ef19e5dff0a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47002024-12-19T01:04:54.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 04539e6c-e955-4653-a96e-94a07429ce5d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47012024-12-19T01:04:54.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 04539e6c-e955-4653-a96e-94a07429ce5d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47022024-12-19T01:04:54.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 04539e6c-e955-4653-a96e-94a07429ce5d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47032024-12-19T01:04:55.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0492def1-89cc-4fdc-b3d0-5c5631360594 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47042024-12-19T01:04:55.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0492def1-89cc-4fdc-b3d0-5c5631360594 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47052024-12-19T01:04:55.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0492def1-89cc-4fdc-b3d0-5c5631360594 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47062024-12-19T01:04:55.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1429 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 9120f2f0-3b88-4aa2-b826-b4ba72319321 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
47072024-12-19T01:04:56.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d5515ad7-d6e9-406d-a1e3-953c7c59230e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47082024-12-19T01:04:56.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d5515ad7-d6e9-406d-a1e3-953c7c59230e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47092024-12-19T01:04:56.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1685 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d5515ad7-d6e9-406d-a1e3-953c7c59230e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47102024-12-19T01:04:57.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5f6bc543-298e-4eca-bf14-f1520daff21c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47112024-12-19T01:04:57.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5f6bc543-298e-4eca-bf14-f1520daff21c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47122024-12-19T01:04:57.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5f6bc543-298e-4eca-bf14-f1520daff21c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47132024-12-19T01:04:58.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0f0d48b4-0568-4d05-b9c6-4780aeb4d14b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47142024-12-19T01:04:58.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0f0d48b4-0568-4d05-b9c6-4780aeb4d14b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47152024-12-19T01:04:58.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0f0d48b4-0568-4d05-b9c6-4780aeb4d14b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47162024-12-19T01:04:59.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3224e90b-3fc1-4c6e-b679-7ab7ac9e24e4 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47172024-12-19T01:04:59.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3224e90b-3fc1-4c6e-b679-7ab7ac9e24e4 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47182024-12-19T01:04:59.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3224e90b-3fc1-4c6e-b679-7ab7ac9e24e4 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47192024-12-19T01:05:00.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = efd18e19-603a-4d65-8fc9-9da257bfd1e7 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47202024-12-19T01:05:00.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = efd18e19-603a-4d65-8fc9-9da257bfd1e7 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47212024-12-19T01:05:00.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = efd18e19-603a-4d65-8fc9-9da257bfd1e7 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47222024-12-19T01:05:01.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
47232024-12-19T01:05:01.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
47242024-12-19T01:05:01.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47252024-12-19T01:05:01.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47262024-12-19T01:05:01.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47272024-12-19T01:05:01.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47282024-12-19T01:05:01.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47292024-12-19T01:05:01.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47302024-12-19T01:05:01.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47312024-12-19T01:05:01.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.351629ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47322024-12-19T01:05:01.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47332024-12-19T01:05:01.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47342024-12-19T01:05:01.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47352024-12-19T01:05:01.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47362024-12-19T01:05:01.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47372024-12-19T01:05:01.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47382024-12-19T01:05:01.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
47392024-12-19T01:05:01.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47402024-12-19T01:05:01.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47412024-12-19T01:05:01.391ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
47422024-12-19T01:05:01.391ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.37757ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
47432024-12-19T01:05:01.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a0a9cb39-2c89-4086-8736-c4adf870da9f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47442024-12-19T01:05:01.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a0a9cb39-2c89-4086-8736-c4adf870da9f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47452024-12-19T01:05:01.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a0a9cb39-2c89-4086-8736-c4adf870da9f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47462024-12-19T01:05:02.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5c3bbc44-beb9-4c88-b768-7396eaabfd8c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47472024-12-19T01:05:02.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5c3bbc44-beb9-4c88-b768-7396eaabfd8c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47482024-12-19T01:05:02.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5c3bbc44-beb9-4c88-b768-7396eaabfd8c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47492024-12-19T01:05:03.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a94e353b-f446-451a-aae7-c7ac173272ce roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47502024-12-19T01:05:03.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a94e353b-f446-451a-aae7-c7ac173272ce resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47512024-12-19T01:05:03.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a94e353b-f446-451a-aae7-c7ac173272ce response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47522024-12-19T01:05:04.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 289aa763-6893-47c0-91e0-5ac8b68d8ac7 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47532024-12-19T01:05:04.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 289aa763-6893-47c0-91e0-5ac8b68d8ac7 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47542024-12-19T01:05:04.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 289aa763-6893-47c0-91e0-5ac8b68d8ac7 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47552024-12-19T01:05:05.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 55c3bbd4-191a-4bbc-87c7-24c9b2e66260 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47562024-12-19T01:05:05.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 55c3bbd4-191a-4bbc-87c7-24c9b2e66260 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47572024-12-19T01:05:05.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 55c3bbd4-191a-4bbc-87c7-24c9b2e66260 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47582024-12-19T01:05:05.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1357 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 8084fa54-49d2-4fc1-aad5-ce4eebd2625f response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
47592024-12-19T01:05:06.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2d61873b-d125-4772-92ee-74756405da6a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47602024-12-19T01:05:06.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2d61873b-d125-4772-92ee-74756405da6a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47612024-12-19T01:05:06.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2d61873b-d125-4772-92ee-74756405da6a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47622024-12-19T01:05:07.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 61387eb7-8af0-45ee-850d-bd0cd2014c04 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47632024-12-19T01:05:07.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 61387eb7-8af0-45ee-850d-bd0cd2014c04 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47642024-12-19T01:05:07.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 61387eb7-8af0-45ee-850d-bd0cd2014c04 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47652024-12-19T01:05:08.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 176060ee-8693-4663-b13d-f7e591fa86fe roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47662024-12-19T01:05:08.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 176060ee-8693-4663-b13d-f7e591fa86fe resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47672024-12-19T01:05:08.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 176060ee-8693-4663-b13d-f7e591fa86fe response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47682024-12-19T01:05:09.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 07c41002-fbd8-43e6-abd7-262c701e0c52 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47692024-12-19T01:05:09.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 07c41002-fbd8-43e6-abd7-262c701e0c52 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47702024-12-19T01:05:09.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 07c41002-fbd8-43e6-abd7-262c701e0c52 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47712024-12-19T01:05:10.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7039abda-1cb7-4a5c-b5eb-353430895f8d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47722024-12-19T01:05:10.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7039abda-1cb7-4a5c-b5eb-353430895f8d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47732024-12-19T01:05:10.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7039abda-1cb7-4a5c-b5eb-353430895f8d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47742024-12-19T01:05:11.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
47752024-12-19T01:05:11.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47762024-12-19T01:05:11.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
47772024-12-19T01:05:11.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47782024-12-19T01:05:11.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47792024-12-19T01:05:11.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47802024-12-19T01:05:11.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47812024-12-19T01:05:11.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47822024-12-19T01:05:11.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47832024-12-19T01:05:11.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47842024-12-19T01:05:11.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47852024-12-19T01:05:11.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47862024-12-19T01:05:11.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47872024-12-19T01:05:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47882024-12-19T01:05:11.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47892024-12-19T01:05:11.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
47902024-12-19T01:05:11.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47912024-12-19T01:05:11.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47922024-12-19T01:05:11.398ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
47932024-12-19T01:05:11.398ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.153961ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
47942024-12-19T01:05:11.410ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.56676ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47952024-12-19T01:05:11.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f6982f11-c1b2-4f19-8f41-aa1fe2acdeef roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47962024-12-19T01:05:11.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f6982f11-c1b2-4f19-8f41-aa1fe2acdeef resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47972024-12-19T01:05:11.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f6982f11-c1b2-4f19-8f41-aa1fe2acdeef response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47982024-12-19T01:05:12.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9a412c43-c584-4a7c-a323-474080d62318 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
47992024-12-19T01:05:12.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9a412c43-c584-4a7c-a323-474080d62318 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48002024-12-19T01:05:12.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9a412c43-c584-4a7c-a323-474080d62318 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48012024-12-19T01:05:13.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cd04cb9e-ed62-44c2-a2a8-0ad2c2be43ef roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48022024-12-19T01:05:13.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cd04cb9e-ed62-44c2-a2a8-0ad2c2be43ef resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48032024-12-19T01:05:13.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cd04cb9e-ed62-44c2-a2a8-0ad2c2be43ef response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48042024-12-19T01:05:14.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f0343138-6df0-468b-b268-a199d2d68dc2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48052024-12-19T01:05:14.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f0343138-6df0-468b-b268-a199d2d68dc2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48062024-12-19T01:05:14.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f0343138-6df0-468b-b268-a199d2d68dc2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48072024-12-19T01:05:15.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1471 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = d755fd45-f05a-43ac-91ba-8fc99607d54e response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
48082024-12-19T01:05:15.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d4c879cd-d2c3-47d0-bad4-61a14f6292e2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48092024-12-19T01:05:15.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d4c879cd-d2c3-47d0-bad4-61a14f6292e2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48102024-12-19T01:05:15.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d4c879cd-d2c3-47d0-bad4-61a14f6292e2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48112024-12-19T01:05:16.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f4c490de-4a9b-4db0-8d7b-9e2868216e02 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48122024-12-19T01:05:16.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f4c490de-4a9b-4db0-8d7b-9e2868216e02 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48132024-12-19T01:05:16.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f4c490de-4a9b-4db0-8d7b-9e2868216e02 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48142024-12-19T01:05:18.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2e106e04-152d-4111-bb85-b3d25ebe03bd roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48152024-12-19T01:05:18.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2e106e04-152d-4111-bb85-b3d25ebe03bd resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48162024-12-19T01:05:18.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2e106e04-152d-4111-bb85-b3d25ebe03bd response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48172024-12-19T01:05:19.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f189a8e5-1ecd-49b4-8e23-a86dc5bbe896 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48182024-12-19T01:05:19.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f189a8e5-1ecd-49b4-8e23-a86dc5bbe896 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48192024-12-19T01:05:19.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f189a8e5-1ecd-49b4-8e23-a86dc5bbe896 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48202024-12-19T01:05:20.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 99b9b2de-842f-4437-b0d0-d8543d126560 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48212024-12-19T01:05:20.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 99b9b2de-842f-4437-b0d0-d8543d126560 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48222024-12-19T01:05:20.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 99b9b2de-842f-4437-b0d0-d8543d126560 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48232024-12-19T01:05:21.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4d05f202-37e6-47e2-a327-8bf1b7bd384f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48242024-12-19T01:05:21.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4d05f202-37e6-47e2-a327-8bf1b7bd384f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48252024-12-19T01:05:21.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4d05f202-37e6-47e2-a327-8bf1b7bd384f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
48262024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
48272024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
48282024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48292024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
48302024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
48312024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
48322024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48332024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48342024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
48352024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48362024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
48372024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
48382024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48392024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
48402024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48412024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
48422024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
48432024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
48442024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
48452024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
48462024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48472024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48482024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48492024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
48502024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
48512024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48522024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
48532024-12-19T01:05:21.373ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 00:55:21.373411402 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
48542024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
48552024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
48562024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48572024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
48582024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
48592024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48602024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
48612024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48622024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
48632024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
48642024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
48652024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48662024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
48672024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
48682024-12-19T01:05:21.373ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
48692024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48702024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48712024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
48722024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48732024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
48742024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
48752024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
48762024-12-19T01:05:21.373ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48772024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48782024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
48792024-12-19T01:05:21.373ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a
48802024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.66\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a"}
48812024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
48822024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48832024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
48842024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48852024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48862024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
48872024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48882024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48892024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48902024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48912024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48922024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48932024-12-19T01:05:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
48942024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
48952024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
48962024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48972024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48982024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48992024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49002024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49012024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49022024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49032024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49042024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49052024-12-19T01:05:21.374ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a880a2e-2471-4fd8-9ad5-3e0c3fbde317.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1210, tv_nsec: 218084388 } })
49062024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
49072024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49082024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49092024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49102024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49112024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49122024-12-19T01:05:21.374ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0018a454-75c0-41b1-be69-9476391f01e1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("050cdbd7-4ebc-471c-b4dc-ec1b3741f763.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1210, tv_nsec: 218193659 } })
49132024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49142024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
49152024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.065954ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
49162024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
49172024-12-19T01:05:21.374ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.411669ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
49182024-12-19T01:05:21.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49192024-12-19T01:05:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49202024-12-19T01:05:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.187544ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49212024-12-19T01:05:21.377ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49222024-12-19T01:05:21.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49232024-12-19T01:05:21.378ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49242024-12-19T01:05:21.379ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 6.142343ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
49252024-12-19T01:05:21.380ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 00:55:21.373411402 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
49262024-12-19T01:05:21.380ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.63394ms iteration = 8 status = {"expiration":"2024-12-19T00:55:21.373411402Z","pruned":[]}
49272024-12-19T01:05:21.380ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1210, tv_nsec: 224872780 } })
49282024-12-19T01:05:21.381ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
49292024-12-19T01:05:21.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49302024-12-19T01:05:21.381ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49312024-12-19T01:05:21.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49322024-12-19T01:05:21.383ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1210, tv_nsec: 227665868 } })
49332024-12-19T01:05:21.383ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49342024-12-19T01:05:21.384ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
49352024-12-19T01:05:21.385ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49362024-12-19T01:05:21.385ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49372024-12-19T01:05:21.385ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49382024-12-19T01:05:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49392024-12-19T01:05:21.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
49402024-12-19T01:05:21.387ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49412024-12-19T01:05:21.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49422024-12-19T01:05:21.388ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49432024-12-19T01:05:21.388ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49442024-12-19T01:05:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49452024-12-19T01:05:21.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49462024-12-19T01:05:21.389ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49472024-12-19T01:05:21.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49482024-12-19T01:05:21.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49492024-12-19T01:05:21.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49502024-12-19T01:05:21.392ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49512024-12-19T01:05:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49522024-12-19T01:05:21.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49532024-12-19T01:05:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49542024-12-19T01:05:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49552024-12-19T01:05:21.395ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49562024-12-19T01:05:21.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49572024-12-19T01:05:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49582024-12-19T01:05:21.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49592024-12-19T01:05:21.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49602024-12-19T01:05:21.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49612024-12-19T01:05:21.404ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49622024-12-19T01:05:21.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49632024-12-19T01:05:21.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49642024-12-19T01:05:21.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49652024-12-19T01:05:21.409ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49662024-12-19T01:05:21.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49672024-12-19T01:05:21.410ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49682024-12-19T01:05:21.410ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49692024-12-19T01:05:21.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49702024-12-19T01:05:21.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49712024-12-19T01:05:21.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49722024-12-19T01:05:21.425ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49732024-12-19T01:05:21.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49742024-12-19T01:05:21.426ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1210, tv_nsec: 270067314 } })
49752024-12-19T01:05:21.426ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
49762024-12-19T01:05:21.429ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
49772024-12-19T01:05:21.429ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
49782024-12-19T01:05:21.429ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
49792024-12-19T01:05:21.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49802024-12-19T01:05:21.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49812024-12-19T01:05:21.429ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49822024-12-19T01:05:21.429ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.107562ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49832024-12-19T01:05:21.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49842024-12-19T01:05:21.431ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49852024-12-19T01:05:21.432ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49862024-12-19T01:05:21.432ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.810699ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
49872024-12-19T01:05:21.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49882024-12-19T01:05:21.433ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49892024-12-19T01:05:21.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49902024-12-19T01:05:21.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49912024-12-19T01:05:21.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
49922024-12-19T01:05:21.436ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49932024-12-19T01:05:21.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49942024-12-19T01:05:21.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49952024-12-19T01:05:21.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49962024-12-19T01:05:21.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49972024-12-19T01:05:21.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49982024-12-19T01:05:21.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49992024-12-19T01:05:21.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.48074ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
50002024-12-19T01:05:21.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50012024-12-19T01:05:21.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50022024-12-19T01:05:21.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50032024-12-19T01:05:21.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50042024-12-19T01:05:21.444ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50052024-12-19T01:05:21.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50062024-12-19T01:05:21.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
50072024-12-19T01:05:21.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50082024-12-19T01:05:21.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50092024-12-19T01:05:21.451ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50102024-12-19T01:05:21.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50112024-12-19T01:05:21.457ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
50122024-12-19T01:05:21.457ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
50132024-12-19T01:05:21.457ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.90012ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
50142024-12-19T01:05:21.462ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50152024-12-19T01:05:21.462ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50162024-12-19T01:05:21.462ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50172024-12-19T01:05:21.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50182024-12-19T01:05:21.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50192024-12-19T01:05:21.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50202024-12-19T01:05:21.466ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50212024-12-19T01:05:21.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50222024-12-19T01:05:21.468ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
50232024-12-19T01:05:21.468ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
50242024-12-19T01:05:21.468ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 94.579084ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
50252024-12-19T01:05:21.473ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
50262024-12-19T01:05:21.473ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
50272024-12-19T01:05:21.473ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
50282024-12-19T01:05:21.473ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50292024-12-19T01:05:21.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50302024-12-19T01:05:21.474ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.976942ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50312024-12-19T01:05:21.483ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50322024-12-19T01:05:21.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50332024-12-19T01:05:21.502ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50342024-12-19T01:05:21.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50352024-12-19T01:05:21.539ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50362024-12-19T01:05:21.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50372024-12-19T01:05:21.557ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
50382024-12-19T01:05:21.574ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50392024-12-19T01:05:21.574ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50402024-12-19T01:05:21.574ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3eea5fb-ec90-413b-9e3a-efac5d35abb0", "content-length": "26", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} })
50412024-12-19T01:05:21.574ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50422024-12-19T01:05:21.585ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50432024-12-19T01:05:21.666ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
50442024-12-19T01:05:21.692ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50452024-12-19T01:05:21.692ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50462024-12-19T01:05:21.693ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3668159-0eab-4d46-8ea8-f1afd49d8304", "content-length": "26", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} })
50472024-12-19T01:05:21.693ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50482024-12-19T01:05:21.695ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50492024-12-19T01:05:21.717ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50502024-12-19T01:05:21.717ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50512024-12-19T01:05:21.718ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e5c4215-e167-475f-8bcb-7f4973b53db5", "content-length": "372", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} })
50522024-12-19T01:05:21.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50532024-12-19T01:05:21.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50542024-12-19T01:05:21.724ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50552024-12-19T01:05:21.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50562024-12-19T01:05:21.726ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50572024-12-19T01:05:21.729ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50582024-12-19T01:05:21.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50592024-12-19T01:05:21.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50602024-12-19T01:05:21.738ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
50612024-12-19T01:05:21.738ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 364.918615ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
50622024-12-19T01:05:21.742ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
50632024-12-19T01:05:21.742ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50642024-12-19T01:05:21.742ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5700f553-9994-4f33-b177-87bd721c7c2c", "content-length": "26", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} })
50652024-12-19T01:05:21.742ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50662024-12-19T01:05:21.745ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
50672024-12-19T01:05:21.761ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
50682024-12-19T01:05:21.761ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d99e8bb2-805d-4235-bb59-f771aa4c1d80", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50692024-12-19T01:05:21.761ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50702024-12-19T01:05:21.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 390.457242ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50712024-12-19T01:05:21.763ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3de52dfe-3941-4c79-b9e7-62ed3d5c7ec9", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50722024-12-19T01:05:21.763ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50732024-12-19T01:05:21.765ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50742024-12-19T01:05:21.765ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 391.633027ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
50752024-12-19T01:05:21.768ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50762024-12-19T01:05:21.768ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
50772024-12-19T01:05:21.768ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
50782024-12-19T01:05:21.768ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50792024-12-19T01:05:21.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50802024-12-19T01:05:21.769ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50812024-12-19T01:05:21.769ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2947446f-9564-4987-ae41-737aa66af7a8", "content-length": "1", "date": "Thu, 19 Dec 2024 01:05:20 GMT"} })
50822024-12-19T01:05:21.771ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50832024-12-19T01:05:21.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50842024-12-19T01:05:21.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50852024-12-19T01:05:21.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50862024-12-19T01:05:21.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50872024-12-19T01:05:21.773ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50882024-12-19T01:05:21.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50892024-12-19T01:05:21.773ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 400.565719ms iteration = 15 status = null
50902024-12-19T01:05:21.775ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50912024-12-19T01:05:21.775ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50922024-12-19T01:05:21.775ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50932024-12-19T01:05:21.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50942024-12-19T01:05:21.777ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50952024-12-19T01:05:21.777ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 403.730792ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50962024-12-19T01:05:21.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50972024-12-19T01:05:21.778ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50982024-12-19T01:05:21.779ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50992024-12-19T01:05:21.781ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51002024-12-19T01:05:21.781ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51012024-12-19T01:05:21.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51022024-12-19T01:05:21.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
51032024-12-19T01:05:21.783ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51042024-12-19T01:05:21.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51052024-12-19T01:05:21.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51062024-12-19T01:05:21.784ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T00:58:19.687181Z, time_modified: 2024-12-19T00:58:19.687181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }) }
51072024-12-19T01:05:21.784ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 410.95909ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]}},"default_endpoint":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
51082024-12-19T01:05:21.786ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 412.915187ms iteration = 15 status = 0
51092024-12-19T01:05:21.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51102024-12-19T01:05:21.787ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51112024-12-19T01:05:21.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51122024-12-19T01:05:21.793ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
51132024-12-19T01:05:21.807ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
51142024-12-19T01:05:21.807ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51152024-12-19T01:05:21.807ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d49cf695-8294-40bc-88dd-62237350dcc0", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} })
51162024-12-19T01:05:21.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51172024-12-19T01:05:21.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51182024-12-19T01:05:21.811ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51192024-12-19T01:05:21.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51202024-12-19T01:05:21.823ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
51212024-12-19T01:05:21.823ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 449.656706ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
51222024-12-19T01:05:21.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51232024-12-19T01:05:21.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 452.123259ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
51242024-12-19T01:05:21.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51252024-12-19T01:05:21.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51262024-12-19T01:05:21.831ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51272024-12-19T01:05:21.831ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51282024-12-19T01:05:21.831ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "491024b1-db00-4ade-a966-42c3cb865326", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} })
51292024-12-19T01:05:21.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51302024-12-19T01:05:21.831ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51312024-12-19T01:05:21.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51322024-12-19T01:05:21.832ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
51332024-12-19T01:05:21.832ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 0 version = 2
51342024-12-19T01:05:21.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51352024-12-19T01:05:21.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51362024-12-19T01:05:21.833ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51372024-12-19T01:05:21.833ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51382024-12-19T01:05:21.833ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 459.874455ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51392024-12-19T01:05:21.834ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51402024-12-19T01:05:21.834ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 461.02903ms iteration = 16 status = {}
51412024-12-19T01:05:21.835ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
51422024-12-19T01:05:21.835ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
51432024-12-19T01:05:21.835ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 00:59:01.994004 UTC dns_group = internal generation = 1
51442024-12-19T01:05:21.835ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 461.72692ms iteration = 9 status = {"generation":1}
51452024-12-19T01:05:21.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51462024-12-19T01:05:21.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51472024-12-19T01:05:21.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51482024-12-19T01:05:21.841ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 1 version = 2
51492024-12-19T01:05:21.841ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
51502024-12-19T01:05:21.841ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 00:59:02.707744 UTC dns_group = external generation = 2
51512024-12-19T01:05:21.841ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 468.36392ms iteration = 9 status = {"generation":2}
51522024-12-19T01:05:21.854ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 480.90137ms iteration = 15 status = {}
51532024-12-19T01:05:21.862ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 489.209772ms iteration = 18 status = {"physical_disks_added":0}
51542024-12-19T01:05:21.877ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
51552024-12-19T01:05:21.878ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9ee31844-5491-450d-8258-00d6d0956f1b", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
51562024-12-19T01:05:21.878ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
51572024-12-19T01:05:21.880ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d01dd6dc-61fb-4d99-b182-deb5c0c2d7ba", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
51582024-12-19T01:05:21.880ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
51592024-12-19T01:05:21.882ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bd05bbe3-b32a-45f0-a9e6-4cbc2575a5d9", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
51602024-12-19T01:05:21.882ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
51612024-12-19T01:05:21.884ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
51622024-12-19T01:05:21.884ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 510.746015ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
51632024-12-19T01:05:21.922ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51642024-12-19T01:05:21.923ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ef6aaa9-bf5f-4144-aecb-92c5ab95f291", "content-length": "691", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} })
51652024-12-19T01:05:21.923ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
51662024-12-19T01:05:21.923ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
51672024-12-19T01:05:21.923ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
51682024-12-19T01:05:21.925ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 551.334406ms iteration = 15 status = {}
51692024-12-19T01:05:21.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51702024-12-19T01:05:21.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51712024-12-19T01:05:21.938ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
51722024-12-19T01:05:21.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51732024-12-19T01:05:21.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51742024-12-19T01:05:21.948ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51752024-12-19T01:05:21.948ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4d10643-42a8-4922-af17-b4e3ff930de0", "content-length": "134", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} })
51762024-12-19T01:05:21.948ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
51772024-12-19T01:05:21.948ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
51782024-12-19T01:05:21.949ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
51792024-12-19T01:05:21.949ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51802024-12-19T01:05:21.949ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51812024-12-19T01:05:21.949ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51822024-12-19T01:05:21.949ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51832024-12-19T01:05:21.949ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51842024-12-19T01:05:21.949ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51852024-12-19T01:05:21.949ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51862024-12-19T01:05:21.949ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
51872024-12-19T01:05:21.949ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51882024-12-19T01:05:21.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51892024-12-19T01:05:21.951ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51902024-12-19T01:05:21.951ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5903e55-b18e-4ce7-abca-c16b6bd6af71", "content-length": "2", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} })
51912024-12-19T01:05:21.951ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51922024-12-19T01:05:21.952ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f08887f8-5815-4469-93ec-63df67b319d8", "content-length": "52", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} })
51932024-12-19T01:05:21.952ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
51942024-12-19T01:05:21.952ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51952024-12-19T01:05:22.049ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bea6bfef-2af8-4faa-8308-638522ad6dae", "date": "Thu, 19 Dec 2024 01:05:21 GMT"} })
51962024-12-19T01:05:22.049ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
51972024-12-19T01:05:22.049ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51982024-12-19T01:05:22.050ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0107f55-40af-4228-abf9-392a5a351cd1", "content-length": "682", "date": "Thu, 19 Dec 2024 01:05:22 GMT"} })
51992024-12-19T01:05:22.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52002024-12-19T01:05:22.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52012024-12-19T01:05:22.053ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52022024-12-19T01:05:22.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52032024-12-19T01:05:22.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52042024-12-19T01:05:22.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52052024-12-19T01:05:22.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52062024-12-19T01:05:22.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52072024-12-19T01:05:22.066ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 693.219983ms iteration = 15 status = {}
52082024-12-19T01:05:22.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 974dc2ec-5649-4eca-b457-a353d959c57a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52092024-12-19T01:05:22.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 974dc2ec-5649-4eca-b457-a353d959c57a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52102024-12-19T01:05:22.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 974dc2ec-5649-4eca-b457-a353d959c57a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52112024-12-19T01:05:22.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = ed4ffbec-6c1a-4ae7-a66c-ee6c062da165 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
52122024-12-19T01:05:22.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = ed4ffbec-6c1a-4ae7-a66c-ee6c062da165 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
52132024-12-19T01:05:22.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = ed4ffbec-6c1a-4ae7-a66c-ee6c062da165 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
52142024-12-19T01:05:23.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9d75cc1e-9d14-43d7-8173-2e79e30e078f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52152024-12-19T01:05:23.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9d75cc1e-9d14-43d7-8173-2e79e30e078f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52162024-12-19T01:05:23.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1977 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9d75cc1e-9d14-43d7-8173-2e79e30e078f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52172024-12-19T01:05:24.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 74710fad-7b0a-426c-9ada-ac3daf9b19af roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52182024-12-19T01:05:24.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 74710fad-7b0a-426c-9ada-ac3daf9b19af resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52192024-12-19T01:05:24.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2751 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 74710fad-7b0a-426c-9ada-ac3daf9b19af response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52202024-12-19T01:05:25.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1fca218a-f133-4c6e-99bf-59039f0e8124 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52212024-12-19T01:05:25.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1fca218a-f133-4c6e-99bf-59039f0e8124 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52222024-12-19T01:05:25.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1fca218a-f133-4c6e-99bf-59039f0e8124 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52232024-12-19T01:05:25.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1307 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = b7d6a6d4-78f8-4994-95ce-3bbf1509644c response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
52242024-12-19T01:05:26.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a6bde1be-5246-4110-b4d8-7b7855c29c63 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52252024-12-19T01:05:26.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a6bde1be-5246-4110-b4d8-7b7855c29c63 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52262024-12-19T01:05:26.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a6bde1be-5246-4110-b4d8-7b7855c29c63 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52272024-12-19T01:05:27.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0f94c11f-9d7d-4818-abef-d117c5ec5b23 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52282024-12-19T01:05:27.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0f94c11f-9d7d-4818-abef-d117c5ec5b23 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52292024-12-19T01:05:27.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0f94c11f-9d7d-4818-abef-d117c5ec5b23 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52302024-12-19T01:05:28.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fdb220a3-89c6-453f-980b-45c76a1f6888 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52312024-12-19T01:05:28.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fdb220a3-89c6-453f-980b-45c76a1f6888 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52322024-12-19T01:05:28.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fdb220a3-89c6-453f-980b-45c76a1f6888 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52332024-12-19T01:05:29.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c33bb0ed-7a7d-4913-bc96-d59b855626d1 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52342024-12-19T01:05:29.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c33bb0ed-7a7d-4913-bc96-d59b855626d1 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52352024-12-19T01:05:29.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c33bb0ed-7a7d-4913-bc96-d59b855626d1 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52362024-12-19T01:05:30.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4faa1932-1ccd-4624-b92c-a1aa28098ceb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52372024-12-19T01:05:30.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4faa1932-1ccd-4624-b92c-a1aa28098ceb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52382024-12-19T01:05:30.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4faa1932-1ccd-4624-b92c-a1aa28098ceb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52392024-12-19T01:05:31.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e52113a5-c669-4cf6-becf-55dc78f361cb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52402024-12-19T01:05:31.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e52113a5-c669-4cf6-becf-55dc78f361cb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52412024-12-19T01:05:31.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1906 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e52113a5-c669-4cf6-becf-55dc78f361cb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52422024-12-19T01:05:31.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
52432024-12-19T01:05:31.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
52442024-12-19T01:05:31.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52452024-12-19T01:05:31.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52462024-12-19T01:05:31.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52472024-12-19T01:05:31.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52482024-12-19T01:05:31.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52492024-12-19T01:05:31.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52502024-12-19T01:05:31.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52512024-12-19T01:05:31.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.65464ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52522024-12-19T01:05:31.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52532024-12-19T01:05:31.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52542024-12-19T01:05:31.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52552024-12-19T01:05:31.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52562024-12-19T01:05:31.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52572024-12-19T01:05:31.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52582024-12-19T01:05:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
52592024-12-19T01:05:31.416ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52602024-12-19T01:05:31.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52612024-12-19T01:05:31.427ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
52622024-12-19T01:05:31.427ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.902362ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
52632024-12-19T01:05:32.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 531a507a-b35c-44ec-9068-76ba1692bfa3 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52642024-12-19T01:05:32.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 531a507a-b35c-44ec-9068-76ba1692bfa3 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52652024-12-19T01:05:32.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 531a507a-b35c-44ec-9068-76ba1692bfa3 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52662024-12-19T01:05:33.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4a04b0c0-d25b-4032-bd18-6ced8b1907fb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52672024-12-19T01:05:33.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4a04b0c0-d25b-4032-bd18-6ced8b1907fb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52682024-12-19T01:05:33.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4a04b0c0-d25b-4032-bd18-6ced8b1907fb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52692024-12-19T01:05:34.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dfe7f7e9-cd50-4dcd-a3f3-eaaa9a27855f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52702024-12-19T01:05:34.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dfe7f7e9-cd50-4dcd-a3f3-eaaa9a27855f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52712024-12-19T01:05:34.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dfe7f7e9-cd50-4dcd-a3f3-eaaa9a27855f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52722024-12-19T01:05:35.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 04d6e18a-13ef-4965-abc7-7ea2694863a8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52732024-12-19T01:05:35.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 04d6e18a-13ef-4965-abc7-7ea2694863a8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52742024-12-19T01:05:35.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 04d6e18a-13ef-4965-abc7-7ea2694863a8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52752024-12-19T01:05:35.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1318 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 2839eb97-76bc-4b3b-9e48-28aa418ceb1e response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
52762024-12-19T01:05:36.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 57774dba-4211-4811-abe5-1c0f95fdcad2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52772024-12-19T01:05:36.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 57774dba-4211-4811-abe5-1c0f95fdcad2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52782024-12-19T01:05:36.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 57774dba-4211-4811-abe5-1c0f95fdcad2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52792024-12-19T01:05:37.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cb1b5e28-c8bd-43a1-bd79-d16707fc6683 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52802024-12-19T01:05:37.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cb1b5e28-c8bd-43a1-bd79-d16707fc6683 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52812024-12-19T01:05:37.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cb1b5e28-c8bd-43a1-bd79-d16707fc6683 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52822024-12-19T01:05:38.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b0ba1662-0e24-43ac-9f8f-6eb53e24b956 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52832024-12-19T01:05:38.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b0ba1662-0e24-43ac-9f8f-6eb53e24b956 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52842024-12-19T01:05:38.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b0ba1662-0e24-43ac-9f8f-6eb53e24b956 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52852024-12-19T01:05:39.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4a9031f8-24cc-43bc-9ca0-e538cb8130e7 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52862024-12-19T01:05:39.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4a9031f8-24cc-43bc-9ca0-e538cb8130e7 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52872024-12-19T01:05:39.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4a9031f8-24cc-43bc-9ca0-e538cb8130e7 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52882024-12-19T01:05:40.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7f778a9b-b667-417c-9583-ec4feb0cfef7 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52892024-12-19T01:05:40.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7f778a9b-b667-417c-9583-ec4feb0cfef7 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52902024-12-19T01:05:40.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7f778a9b-b667-417c-9583-ec4feb0cfef7 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
52912024-12-19T01:05:41.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
52922024-12-19T01:05:41.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
52932024-12-19T01:05:41.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52942024-12-19T01:05:41.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52952024-12-19T01:05:41.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52962024-12-19T01:05:41.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52972024-12-19T01:05:41.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52982024-12-19T01:05:41.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52992024-12-19T01:05:41.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53002024-12-19T01:05:41.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53012024-12-19T01:05:41.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53022024-12-19T01:05:41.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53032024-12-19T01:05:41.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53042024-12-19T01:05:41.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
53052024-12-19T01:05:41.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53062024-12-19T01:05:41.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53072024-12-19T01:05:41.401ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
53082024-12-19T01:05:41.401ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.041271ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
53092024-12-19T01:05:41.405ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53102024-12-19T01:05:41.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53112024-12-19T01:05:41.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.382736ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53122024-12-19T01:05:41.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fed6ceec-9a2b-4ea2-a097-c11fab1ad83c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53132024-12-19T01:05:41.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fed6ceec-9a2b-4ea2-a097-c11fab1ad83c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53142024-12-19T01:05:41.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fed6ceec-9a2b-4ea2-a097-c11fab1ad83c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53152024-12-19T01:05:42.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8b7b8036-b27a-4406-9549-47cfe4bb10f9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53162024-12-19T01:05:42.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8b7b8036-b27a-4406-9549-47cfe4bb10f9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53172024-12-19T01:05:42.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8b7b8036-b27a-4406-9549-47cfe4bb10f9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53182024-12-19T01:05:43.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f57d11bc-57d6-4c47-8697-c8feeac24b15 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53192024-12-19T01:05:43.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f57d11bc-57d6-4c47-8697-c8feeac24b15 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53202024-12-19T01:05:43.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f57d11bc-57d6-4c47-8697-c8feeac24b15 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53212024-12-19T01:05:44.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2b967bc5-588b-4cc5-8a84-a3cfca1c32cc roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53222024-12-19T01:05:44.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2b967bc5-588b-4cc5-8a84-a3cfca1c32cc resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53232024-12-19T01:05:44.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2b967bc5-588b-4cc5-8a84-a3cfca1c32cc response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53242024-12-19T01:05:45.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c42b86bd-1560-462a-892b-98ce80e88a0b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53252024-12-19T01:05:45.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c42b86bd-1560-462a-892b-98ce80e88a0b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53262024-12-19T01:05:45.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c42b86bd-1560-462a-892b-98ce80e88a0b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53272024-12-19T01:05:45.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1457 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = ef2b6df9-add5-46ec-86c1-48973f384989 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
53282024-12-19T01:05:46.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0cc58804-dc16-4c93-8465-f7826a80e88c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53292024-12-19T01:05:46.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0cc58804-dc16-4c93-8465-f7826a80e88c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53302024-12-19T01:05:46.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1599 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0cc58804-dc16-4c93-8465-f7826a80e88c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53312024-12-19T01:05:47.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c51ffdf5-fd27-49c2-a4ed-a5f55e65502b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53322024-12-19T01:05:47.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c51ffdf5-fd27-49c2-a4ed-a5f55e65502b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53332024-12-19T01:05:47.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c51ffdf5-fd27-49c2-a4ed-a5f55e65502b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53342024-12-19T01:05:48.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 10db3f4f-39d7-492e-85cf-3fe7990d208d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53352024-12-19T01:05:48.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 10db3f4f-39d7-492e-85cf-3fe7990d208d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53362024-12-19T01:05:48.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 10db3f4f-39d7-492e-85cf-3fe7990d208d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53372024-12-19T01:05:49.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ed87e867-ac7a-4b17-bfab-1df1f9438f51 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53382024-12-19T01:05:49.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ed87e867-ac7a-4b17-bfab-1df1f9438f51 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53392024-12-19T01:05:49.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ed87e867-ac7a-4b17-bfab-1df1f9438f51 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53402024-12-19T01:05:50.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d01475e9-fa05-44d4-ae2a-856117b905cd roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53412024-12-19T01:05:50.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d01475e9-fa05-44d4-ae2a-856117b905cd resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53422024-12-19T01:05:50.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d01475e9-fa05-44d4-ae2a-856117b905cd response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
53432024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
53442024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
53452024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53462024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53472024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53482024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
53492024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53502024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
53512024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
53522024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53532024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
53542024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
53552024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
53562024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53572024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53582024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53592024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
53602024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53612024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
53622024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53632024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
53642024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
53652024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53662024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53672024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
53682024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53692024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
53702024-12-19T01:05:51.373ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53712024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
53722024-12-19T01:05:51.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53732024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53742024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
53752024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53762024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
53772024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53782024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53792024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53802024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53812024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53822024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53832024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53842024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53852024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53862024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53872024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53882024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53892024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53902024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53912024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53922024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53932024-12-19T01:05:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53942024-12-19T01:05:51.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53952024-12-19T01:05:51.377ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1240, tv_nsec: 221085587 } })
53962024-12-19T01:05:51.377ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53972024-12-19T01:05:51.377ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53982024-12-19T01:05:51.377ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53992024-12-19T01:05:51.377ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.479178ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54002024-12-19T01:05:51.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54012024-12-19T01:05:51.377ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
54022024-12-19T01:05:51.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54032024-12-19T01:05:51.377ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54042024-12-19T01:05:51.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54052024-12-19T01:05:51.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54062024-12-19T01:05:51.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54072024-12-19T01:05:51.381ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1240, tv_nsec: 225380985 } })
54082024-12-19T01:05:51.381ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54092024-12-19T01:05:51.381ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
54102024-12-19T01:05:51.383ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54112024-12-19T01:05:51.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54122024-12-19T01:05:51.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54132024-12-19T01:05:51.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54142024-12-19T01:05:51.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54152024-12-19T01:05:51.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54162024-12-19T01:05:51.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54172024-12-19T01:05:51.385ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54182024-12-19T01:05:51.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54192024-12-19T01:05:51.386ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54202024-12-19T01:05:51.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54212024-12-19T01:05:51.387ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54222024-12-19T01:05:51.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54232024-12-19T01:05:51.388ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54242024-12-19T01:05:51.388ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54252024-12-19T01:05:51.388ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54262024-12-19T01:05:51.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54272024-12-19T01:05:51.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54282024-12-19T01:05:51.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54292024-12-19T01:05:51.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54302024-12-19T01:05:51.389ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54312024-12-19T01:05:51.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54322024-12-19T01:05:51.392ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54332024-12-19T01:05:51.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54342024-12-19T01:05:51.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54352024-12-19T01:05:51.393ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1240, tv_nsec: 237611251 } })
54362024-12-19T01:05:51.394ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
54372024-12-19T01:05:51.394ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54382024-12-19T01:05:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54392024-12-19T01:05:51.403ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54402024-12-19T01:05:51.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54412024-12-19T01:05:51.406ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54422024-12-19T01:05:51.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54432024-12-19T01:05:51.431ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54442024-12-19T01:05:51.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54452024-12-19T01:05:51.432ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.18928ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
54462024-12-19T01:05:51.435ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.250641ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
54472024-12-19T01:05:51.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54482024-12-19T01:05:51.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54492024-12-19T01:05:51.440ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54502024-12-19T01:05:51.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54512024-12-19T01:05:51.443ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54522024-12-19T01:05:51.443ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.910949ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54532024-12-19T01:05:51.444ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54542024-12-19T01:05:51.444ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54552024-12-19T01:05:51.444ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 71.145796ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
54562024-12-19T01:05:51.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54572024-12-19T01:05:51.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54582024-12-19T01:05:51.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54592024-12-19T01:05:51.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 73.859343ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54602024-12-19T01:05:51.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54612024-12-19T01:05:51.449ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54622024-12-19T01:05:51.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54632024-12-19T01:05:51.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54642024-12-19T01:05:51.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54652024-12-19T01:05:51.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54662024-12-19T01:05:51.456ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.574951ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54672024-12-19T01:05:51.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
54682024-12-19T01:05:51.459ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54692024-12-19T01:05:51.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54702024-12-19T01:05:51.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.456156ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54712024-12-19T01:05:51.469ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
54722024-12-19T01:05:51.469ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 95.455616ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
54732024-12-19T01:05:51.469ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54742024-12-19T01:05:51.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54752024-12-19T01:05:51.470ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54762024-12-19T01:05:51.470ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54772024-12-19T01:05:51.470ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c346bbd8-0b1c-4b64-a701-e2a9c34adc44", "content-length": "26", "date": "Thu, 19 Dec 2024 01:05:51 GMT"} })
54782024-12-19T01:05:51.470ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54792024-12-19T01:05:51.472ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54802024-12-19T01:05:51.472ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54812024-12-19T01:05:51.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54822024-12-19T01:05:51.474ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54832024-12-19T01:05:51.475ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 101.979235ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
54842024-12-19T01:05:51.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
54852024-12-19T01:05:51.476ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54862024-12-19T01:05:51.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54872024-12-19T01:05:51.478ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.944374ms iteration = 16 status = 0
54882024-12-19T01:05:51.509ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54892024-12-19T01:05:51.509ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54902024-12-19T01:05:51.509ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cba1ad73-eebf-46f0-b894-9cae3e55eb4e", "content-length": "26", "date": "Thu, 19 Dec 2024 01:05:51 GMT"} })
54912024-12-19T01:05:51.509ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54922024-12-19T01:05:51.511ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54932024-12-19T01:05:51.511ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
54942024-12-19T01:05:51.511ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54952024-12-19T01:05:51.511ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d8eb963-8a5a-4a38-9f72-45bc4139001f", "content-length": "26", "date": "Thu, 19 Dec 2024 01:05:51 GMT"} })
54962024-12-19T01:05:51.512ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54972024-12-19T01:05:51.513ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
54982024-12-19T01:05:51.523ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54992024-12-19T01:05:51.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55002024-12-19T01:05:51.545ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 171.928394ms iteration = 19 status = {"physical_disks_added":0}
55012024-12-19T01:05:51.566ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55022024-12-19T01:05:51.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55032024-12-19T01:05:51.568ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55042024-12-19T01:05:51.569ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55052024-12-19T01:05:51.570ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "16a7113e-1c2b-4f0b-bf3b-2750465adcaa", "content-length": "1", "date": "Thu, 19 Dec 2024 01:05:51 GMT"} })
55062024-12-19T01:05:51.570ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55072024-12-19T01:05:51.570ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55082024-12-19T01:05:51.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55092024-12-19T01:05:51.572ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55102024-12-19T01:05:51.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55112024-12-19T01:05:51.582ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55122024-12-19T01:05:51.582ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55132024-12-19T01:05:51.583ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6c64a68-2fee-43c4-8d3a-d54b05a1f662", "content-length": "372", "date": "Thu, 19 Dec 2024 01:05:51 GMT"} })
55142024-12-19T01:05:51.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55152024-12-19T01:05:51.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55162024-12-19T01:05:51.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55172024-12-19T01:05:51.585ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 211.527632ms iteration = 16 status = null
55182024-12-19T01:05:51.587ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55192024-12-19T01:05:51.587ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55202024-12-19T01:05:51.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55212024-12-19T01:05:51.591ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 217.821228ms iteration = 16 status = {}
55222024-12-19T01:05:51.631ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
55232024-12-19T01:05:51.632ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55242024-12-19T01:05:51.632ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "521643bb-1d53-46fc-8ced-ba40f23f5a66", "date": "Thu, 19 Dec 2024 01:05:51 GMT"} })
55252024-12-19T01:05:51.632ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55262024-12-19T01:05:51.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55272024-12-19T01:05:51.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55282024-12-19T01:05:51.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55292024-12-19T01:05:51.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55302024-12-19T01:05:51.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55312024-12-19T01:05:51.641ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55322024-12-19T01:05:51.641ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55332024-12-19T01:05:51.642ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "550525a2-2192-4dda-a9f5-8ca49630d9a9", "date": "Thu, 19 Dec 2024 01:05:51 GMT"} })
55342024-12-19T01:05:51.644ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 270.428662ms iteration = 17 status = {}
55352024-12-19T01:05:51.717ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55362024-12-19T01:05:51.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55372024-12-19T01:05:51.720ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
55382024-12-19T01:05:51.720ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55392024-12-19T01:05:51.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55402024-12-19T01:05:51.723ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55412024-12-19T01:05:51.733ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55422024-12-19T01:05:51.734ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4125624-88ce-48f0-bf21-59df4aabd9cd", "content-length": "134", "date": "Thu, 19 Dec 2024 01:05:51 GMT"} })
55432024-12-19T01:05:51.734ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55442024-12-19T01:05:51.734ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
55452024-12-19T01:05:51.734ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55462024-12-19T01:05:51.734ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55472024-12-19T01:05:51.734ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55482024-12-19T01:05:51.734ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55492024-12-19T01:05:51.734ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55502024-12-19T01:05:51.734ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55512024-12-19T01:05:51.734ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55522024-12-19T01:05:51.734ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55532024-12-19T01:05:51.734ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
55542024-12-19T01:05:51.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55552024-12-19T01:05:51.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55562024-12-19T01:05:51.737ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55572024-12-19T01:05:51.737ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "915bfb86-c7d9-44d1-acac-0c9c6757c929", "content-length": "2", "date": "Thu, 19 Dec 2024 01:05:51 GMT"} })
55582024-12-19T01:05:51.737ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55592024-12-19T01:05:51.737ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4994905-6fcb-4179-a4a9-f63f0b8bbaa3", "content-length": "52", "date": "Thu, 19 Dec 2024 01:05:51 GMT"} })
55602024-12-19T01:05:51.737ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
55612024-12-19T01:05:51.737ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55622024-12-19T01:05:51.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c536293f-6f88-48fa-b468-9c101ce6c68f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
55632024-12-19T01:05:51.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c536293f-6f88-48fa-b468-9c101ce6c68f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
55642024-12-19T01:05:51.792ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f879e2af-546e-4053-a7be-b10da738b4ef", "content-length": "691", "date": "Thu, 19 Dec 2024 01:05:51 GMT"} })
55652024-12-19T01:05:51.792ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
55662024-12-19T01:05:51.792ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
55672024-12-19T01:05:51.792ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
55682024-12-19T01:05:51.794ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 420.656832ms iteration = 16 status = {}
55692024-12-19T01:05:51.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c536293f-6f88-48fa-b468-9c101ce6c68f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
55702024-12-19T01:05:51.891ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "518069de-ffff-422f-bd31-56b09b3f2039", "date": "Thu, 19 Dec 2024 01:05:51 GMT"} })
55712024-12-19T01:05:51.891ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
55722024-12-19T01:05:51.891ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55732024-12-19T01:05:51.891ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c667f25-c8ae-403f-bf87-144f2a981e28", "content-length": "682", "date": "Thu, 19 Dec 2024 01:05:51 GMT"} })
55742024-12-19T01:05:51.891ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55752024-12-19T01:05:51.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55762024-12-19T01:05:51.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55772024-12-19T01:05:51.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55782024-12-19T01:05:51.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55792024-12-19T01:05:51.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55802024-12-19T01:05:51.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55812024-12-19T01:05:51.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55822024-12-19T01:05:51.907ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 534.105172ms iteration = 16 status = {}
55832024-12-19T01:05:52.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 9ce4f777-48a6-417e-b090-406e285977af roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
55842024-12-19T01:05:52.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 9ce4f777-48a6-417e-b090-406e285977af resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
55852024-12-19T01:05:52.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 9ce4f777-48a6-417e-b090-406e285977af response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
55862024-12-19T01:05:52.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d2d8f223-b44f-42e0-b531-7dffb08db217 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
55872024-12-19T01:05:52.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d2d8f223-b44f-42e0-b531-7dffb08db217 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
55882024-12-19T01:05:52.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d2d8f223-b44f-42e0-b531-7dffb08db217 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
55892024-12-19T01:05:53.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ebbce3e2-9b4d-492a-a6d7-14f9d899bb04 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
55902024-12-19T01:05:53.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ebbce3e2-9b4d-492a-a6d7-14f9d899bb04 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
55912024-12-19T01:05:53.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ebbce3e2-9b4d-492a-a6d7-14f9d899bb04 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
55922024-12-19T01:05:54.117ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:48090
55932024-12-19T01:05:54.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48090 req_id = a774c94c-e04f-4d60-88a8-82689d5f7d0f roles = RoleSet { roles: {} } uri = /metrics/producers
55942024-12-19T01:05:54.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48090 req_id = a774c94c-e04f-4d60-88a8-82689d5f7d0f resource = Database result = Ok(()) uri = /metrics/producers
55952024-12-19T01:05:54.157ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = de9bec7d-f8ce-44a0-879c-5e088768f91c
55962024-12-19T01:05:54.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40140 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48090 req_id = a774c94c-e04f-4d60-88a8-82689d5f7d0f response_code = 201 uri = /metrics/producers
55972024-12-19T01:05:54.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = aeced012-8fe7-4e59-b728-03b20273da20 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
55982024-12-19T01:05:54.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = aeced012-8fe7-4e59-b728-03b20273da20 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
55992024-12-19T01:05:54.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = aeced012-8fe7-4e59-b728-03b20273da20 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56002024-12-19T01:05:55.649ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:52491
56012024-12-19T01:05:55.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52491 req_id = ae50d7e6-bb81-41ec-950a-6d286bfa488f roles = RoleSet { roles: {} } uri = /metrics/producers
56022024-12-19T01:05:55.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52491 req_id = ae50d7e6-bb81-41ec-950a-6d286bfa488f resource = Database result = Ok(()) uri = /metrics/producers
56032024-12-19T01:05:55.658ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:43385
56042024-12-19T01:05:55.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43385 req_id = ec377eb8-35fe-4b64-8db6-02e920a9161e roles = RoleSet { roles: {} } uri = /metrics/producers
56052024-12-19T01:05:55.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43385 req_id = ec377eb8-35fe-4b64-8db6-02e920a9161e resource = Database result = Ok(()) uri = /metrics/producers
56062024-12-19T01:05:55.688ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 9544d6fb-0646-44f2-8d7c-f02b0fe1f856
56072024-12-19T01:05:55.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38659 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52491 req_id = ae50d7e6-bb81-41ec-950a-6d286bfa488f response_code = 201 uri = /metrics/producers
56082024-12-19T01:05:55.695ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = a59c27fd-a846-41a8-8577-0c2618144732
56092024-12-19T01:05:55.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37303 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43385 req_id = ec377eb8-35fe-4b64-8db6-02e920a9161e response_code = 201 uri = /metrics/producers
56102024-12-19T01:05:55.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1347 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = e9a329e8-8394-4531-aa2b-49d3c7cf790c response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
56112024-12-19T01:05:55.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5c1e1f50-d5df-4289-aeee-5fcbce5dd1ee roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56122024-12-19T01:05:55.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5c1e1f50-d5df-4289-aeee-5fcbce5dd1ee resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56132024-12-19T01:05:55.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5c1e1f50-d5df-4289-aeee-5fcbce5dd1ee response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56142024-12-19T01:05:56.020ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:37338
56152024-12-19T01:05:56.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37338 req_id = 002f42d1-e7ed-4c1a-bafe-2d3e115dff26 roles = RoleSet { roles: {} } uri = /metrics/producers
56162024-12-19T01:05:56.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37338 req_id = 002f42d1-e7ed-4c1a-bafe-2d3e115dff26 resource = Database result = Ok(()) uri = /metrics/producers
56172024-12-19T01:05:56.032ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 51ab14f8-f146-4958-aacf-1a2334aec785
56182024-12-19T01:05:56.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11653 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:37338 req_id = 002f42d1-e7ed-4c1a-bafe-2d3e115dff26 response_code = 201 uri = /metrics/producers
56192024-12-19T01:05:56.751ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:42471
56202024-12-19T01:05:56.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42471 req_id = 060277d7-eb89-48d0-8965-052372c9e78d roles = RoleSet { roles: {} } uri = /metrics/producers
56212024-12-19T01:05:56.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42471 req_id = 060277d7-eb89-48d0-8965-052372c9e78d resource = Database result = Ok(()) uri = /metrics/producers
56222024-12-19T01:05:56.794ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 9f4eb089-639f-444f-a6bb-061685ba22f0
56232024-12-19T01:05:56.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42633 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42471 req_id = 060277d7-eb89-48d0-8965-052372c9e78d response_code = 201 uri = /metrics/producers
56242024-12-19T01:05:56.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 484ea254-a790-4a9c-acae-d9eefa2167ab roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56252024-12-19T01:05:56.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 484ea254-a790-4a9c-acae-d9eefa2167ab resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56262024-12-19T01:05:56.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 484ea254-a790-4a9c-acae-d9eefa2167ab response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56272024-12-19T01:05:57.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 51746226-8aed-4445-bb1d-5610b5df85b3 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56282024-12-19T01:05:57.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 51746226-8aed-4445-bb1d-5610b5df85b3 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56292024-12-19T01:05:57.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 51746226-8aed-4445-bb1d-5610b5df85b3 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56302024-12-19T01:05:58.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bc342d73-f5aa-4403-b4d4-76e788fc548c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56312024-12-19T01:05:58.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bc342d73-f5aa-4403-b4d4-76e788fc548c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56322024-12-19T01:05:58.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bc342d73-f5aa-4403-b4d4-76e788fc548c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56332024-12-19T01:05:59.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 35ff9ec5-3dc7-42e7-b08e-4e395dd3634a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56342024-12-19T01:05:59.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 35ff9ec5-3dc7-42e7-b08e-4e395dd3634a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56352024-12-19T01:05:59.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 35ff9ec5-3dc7-42e7-b08e-4e395dd3634a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56362024-12-19T01:06:00.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b9af9f0e-da32-4bf0-bcd3-64a4c0bf324a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56372024-12-19T01:06:00.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b9af9f0e-da32-4bf0-bcd3-64a4c0bf324a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56382024-12-19T01:06:01.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b9af9f0e-da32-4bf0-bcd3-64a4c0bf324a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56392024-12-19T01:06:01.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
56402024-12-19T01:06:01.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
56412024-12-19T01:06:01.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56422024-12-19T01:06:01.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56432024-12-19T01:06:01.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56442024-12-19T01:06:01.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56452024-12-19T01:06:01.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56462024-12-19T01:06:01.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56472024-12-19T01:06:01.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56482024-12-19T01:06:01.376ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.327195ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56492024-12-19T01:06:01.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56502024-12-19T01:06:01.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56512024-12-19T01:06:01.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56522024-12-19T01:06:01.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56532024-12-19T01:06:01.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56542024-12-19T01:06:01.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56552024-12-19T01:06:01.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
56562024-12-19T01:06:01.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56572024-12-19T01:06:01.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56582024-12-19T01:06:01.396ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
56592024-12-19T01:06:01.396ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.431448ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
56602024-12-19T01:06:02.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d6dc53f2-4de9-4a27-8ae2-e4bde35b6755 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56612024-12-19T01:06:02.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d6dc53f2-4de9-4a27-8ae2-e4bde35b6755 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56622024-12-19T01:06:02.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d6dc53f2-4de9-4a27-8ae2-e4bde35b6755 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56632024-12-19T01:06:03.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2df8df4e-8610-4532-be9b-038b53388963 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56642024-12-19T01:06:03.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2df8df4e-8610-4532-be9b-038b53388963 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56652024-12-19T01:06:03.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2df8df4e-8610-4532-be9b-038b53388963 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56662024-12-19T01:06:04.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c37cfe8a-25a4-43f0-a023-ae7db5ecec0c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56672024-12-19T01:06:04.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c37cfe8a-25a4-43f0-a023-ae7db5ecec0c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56682024-12-19T01:06:04.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c37cfe8a-25a4-43f0-a023-ae7db5ecec0c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56692024-12-19T01:06:05.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ab5cba1f-0568-4db1-9fe4-4a76b3c250bd roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56702024-12-19T01:06:05.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ab5cba1f-0568-4db1-9fe4-4a76b3c250bd resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56712024-12-19T01:06:05.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ab5cba1f-0568-4db1-9fe4-4a76b3c250bd response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56722024-12-19T01:06:05.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1411 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = aa8988ba-0021-4800-b12a-de0efc5352a6 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
56732024-12-19T01:06:06.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cdc5489f-d0c5-4e70-b126-19bb64dd869b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56742024-12-19T01:06:06.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cdc5489f-d0c5-4e70-b126-19bb64dd869b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56752024-12-19T01:06:06.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cdc5489f-d0c5-4e70-b126-19bb64dd869b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56762024-12-19T01:06:07.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f34afbdd-3a6f-41ca-a43c-1e5739b06415 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56772024-12-19T01:06:07.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f34afbdd-3a6f-41ca-a43c-1e5739b06415 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56782024-12-19T01:06:07.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f34afbdd-3a6f-41ca-a43c-1e5739b06415 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56792024-12-19T01:06:08.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 95c8e9db-3c42-4a91-be5e-ee73b278fb84 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56802024-12-19T01:06:08.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 95c8e9db-3c42-4a91-be5e-ee73b278fb84 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56812024-12-19T01:06:08.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 95c8e9db-3c42-4a91-be5e-ee73b278fb84 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56822024-12-19T01:06:09.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d7e2ee83-fc92-43de-93f6-5772cb19e067 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56832024-12-19T01:06:09.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d7e2ee83-fc92-43de-93f6-5772cb19e067 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56842024-12-19T01:06:09.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d7e2ee83-fc92-43de-93f6-5772cb19e067 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56852024-12-19T01:06:10.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = df9a8900-8283-4737-95ff-4ff135444509 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56862024-12-19T01:06:10.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = df9a8900-8283-4737-95ff-4ff135444509 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56872024-12-19T01:06:10.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = df9a8900-8283-4737-95ff-4ff135444509 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56882024-12-19T01:06:11.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d4ec6732-79bc-44ba-8b1c-90751bbc0bf1 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56892024-12-19T01:06:11.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d4ec6732-79bc-44ba-8b1c-90751bbc0bf1 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56902024-12-19T01:06:11.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d4ec6732-79bc-44ba-8b1c-90751bbc0bf1 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
56912024-12-19T01:06:11.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
56922024-12-19T01:06:11.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
56932024-12-19T01:06:11.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56942024-12-19T01:06:11.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56952024-12-19T01:06:11.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56962024-12-19T01:06:11.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56972024-12-19T01:06:11.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56982024-12-19T01:06:11.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56992024-12-19T01:06:11.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57002024-12-19T01:06:11.376ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.568579ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57012024-12-19T01:06:11.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57022024-12-19T01:06:11.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57032024-12-19T01:06:11.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57042024-12-19T01:06:11.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57052024-12-19T01:06:11.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57062024-12-19T01:06:11.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57072024-12-19T01:06:11.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
57082024-12-19T01:06:11.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57092024-12-19T01:06:11.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57102024-12-19T01:06:11.396ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
57112024-12-19T01:06:11.396ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.322127ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
57122024-12-19T01:06:11.506ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:43513
57132024-12-19T01:06:11.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43513 req_id = f744d912-41c8-4247-8848-a973aeb4976b roles = RoleSet { roles: {} } uri = /metrics/producers
57142024-12-19T01:06:11.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43513 req_id = f744d912-41c8-4247-8848-a973aeb4976b resource = Database result = Ok(()) uri = /metrics/producers
57152024-12-19T01:06:11.550ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = ac09f416-2290-4c96-b514-dc021f54a2f5
57162024-12-19T01:06:11.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44028 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43513 req_id = f744d912-41c8-4247-8848-a973aeb4976b response_code = 201 uri = /metrics/producers
57172024-12-19T01:06:12.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e1c943e6-690f-483d-88ee-60520c7fd349 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57182024-12-19T01:06:12.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e1c943e6-690f-483d-88ee-60520c7fd349 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57192024-12-19T01:06:12.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e1c943e6-690f-483d-88ee-60520c7fd349 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57202024-12-19T01:06:13.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 49ec854b-6bef-43cc-9012-2b81500b50be roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57212024-12-19T01:06:13.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 49ec854b-6bef-43cc-9012-2b81500b50be resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57222024-12-19T01:06:13.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 49ec854b-6bef-43cc-9012-2b81500b50be response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57232024-12-19T01:06:14.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5b28e077-b960-441d-9224-c8c5e72d6686 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57242024-12-19T01:06:14.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5b28e077-b960-441d-9224-c8c5e72d6686 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57252024-12-19T01:06:14.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5b28e077-b960-441d-9224-c8c5e72d6686 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57262024-12-19T01:06:15.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = adc51959-f451-4c1e-9068-f88ae9eb9d3f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57272024-12-19T01:06:15.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = adc51959-f451-4c1e-9068-f88ae9eb9d3f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57282024-12-19T01:06:15.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = adc51959-f451-4c1e-9068-f88ae9eb9d3f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57292024-12-19T01:06:15.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1324 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = bd7a27f6-c90e-4a85-9fe5-901fa62001f8 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
57302024-12-19T01:06:16.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 504b2768-3e39-482f-9a9c-8257393f54a5 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57312024-12-19T01:06:16.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 504b2768-3e39-482f-9a9c-8257393f54a5 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57322024-12-19T01:06:16.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 504b2768-3e39-482f-9a9c-8257393f54a5 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57332024-12-19T01:06:17.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b0b27878-55e7-4704-8ccc-8af46bc39d6d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57342024-12-19T01:06:17.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b0b27878-55e7-4704-8ccc-8af46bc39d6d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57352024-12-19T01:06:17.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b0b27878-55e7-4704-8ccc-8af46bc39d6d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57362024-12-19T01:06:18.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e0d7fedf-e87c-4f63-9bd7-05aa3c6b50ca roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57372024-12-19T01:06:18.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e0d7fedf-e87c-4f63-9bd7-05aa3c6b50ca resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57382024-12-19T01:06:18.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e0d7fedf-e87c-4f63-9bd7-05aa3c6b50ca response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57392024-12-19T01:06:19.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d79788ed-3d3a-4ccd-9c06-651149a47c67 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57402024-12-19T01:06:19.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d79788ed-3d3a-4ccd-9c06-651149a47c67 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57412024-12-19T01:06:19.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d79788ed-3d3a-4ccd-9c06-651149a47c67 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57422024-12-19T01:06:20.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 33cd0ccb-5510-48c3-acaf-4cd815a235eb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57432024-12-19T01:06:20.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 33cd0ccb-5510-48c3-acaf-4cd815a235eb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57442024-12-19T01:06:20.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 33cd0ccb-5510-48c3-acaf-4cd815a235eb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
57452024-12-19T01:06:20.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 370228fe-51e4-4507-a7d3-b9dfdb0657b4 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
57462024-12-19T01:06:20.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 370228fe-51e4-4507-a7d3-b9dfdb0657b4 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
57472024-12-19T01:06:20.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 370228fe-51e4-4507-a7d3-b9dfdb0657b4 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
57482024-12-19T01:06:20.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = d117d3c7-1230-4f25-b5e0-cd6a42f5b559 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
57492024-12-19T01:06:20.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = d117d3c7-1230-4f25-b5e0-cd6a42f5b559 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
57502024-12-19T01:06:20.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = d117d3c7-1230-4f25-b5e0-cd6a42f5b559 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
57512024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
57522024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
57532024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57542024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
57552024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57562024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
57572024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
57582024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57592024-12-19T01:06:21.373ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
57602024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
57612024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57622024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
57632024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
57642024-12-19T01:06:21.373ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57652024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57662024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
57672024-12-19T01:06:21.373ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 00:56:21.373110737 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
57682024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
57692024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
57702024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
57712024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57722024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57732024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
57742024-12-19T01:06:21.373ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a
57752024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.03\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a"}
57762024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
57772024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
57782024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
57792024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57802024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57812024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
57822024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
57832024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57842024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57852024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57862024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
57872024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
57882024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57892024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
57902024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
57912024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
57922024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57932024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
57942024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57952024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
57962024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57972024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
57982024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57992024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
58002024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58012024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
58022024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
58032024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58042024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
58052024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58062024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
58072024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58082024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
58092024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
58102024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
58112024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
58122024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58132024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58142024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58152024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58162024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58172024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
58182024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
58192024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58202024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58212024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58222024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58232024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58242024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58252024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58262024-12-19T01:06:21.373ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a880a2e-2471-4fd8-9ad5-3e0c3fbde317.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1270, tv_nsec: 218084514 } })
58272024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
58282024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58292024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58302024-12-19T01:06:21.373ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0018a454-75c0-41b1-be69-9476391f01e1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("050cdbd7-4ebc-471c-b4dc-ec1b3741f763.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1270, tv_nsec: 218119904 } })
58312024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58322024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58332024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58342024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58352024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58362024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58372024-12-19T01:06:21.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58382024-12-19T01:06:21.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58392024-12-19T01:06:21.374ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
58402024-12-19T01:06:21.374ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 940.733\u{b5}s iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
58412024-12-19T01:06:21.374ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
58422024-12-19T01:06:21.374ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.202277ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
58432024-12-19T01:06:21.375ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58442024-12-19T01:06:21.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58452024-12-19T01:06:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58462024-12-19T01:06:21.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58472024-12-19T01:06:21.377ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.785782ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58482024-12-19T01:06:21.379ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58492024-12-19T01:06:21.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58502024-12-19T01:06:21.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58512024-12-19T01:06:21.379ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58522024-12-19T01:06:21.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58532024-12-19T01:06:21.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58542024-12-19T01:06:21.381ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 00:56:21.373110737 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
58552024-12-19T01:06:21.381ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.373943ms iteration = 9 status = {"expiration":"2024-12-19T00:56:21.373110737Z","pruned":[]}
58562024-12-19T01:06:21.382ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1270, tv_nsec: 226277385 } })
58572024-12-19T01:06:21.382ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
58582024-12-19T01:06:21.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58592024-12-19T01:06:21.382ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58602024-12-19T01:06:21.382ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58612024-12-19T01:06:21.384ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58622024-12-19T01:06:21.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
58632024-12-19T01:06:21.386ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58642024-12-19T01:06:21.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58652024-12-19T01:06:21.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58662024-12-19T01:06:21.387ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58672024-12-19T01:06:21.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58682024-12-19T01:06:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58692024-12-19T01:06:21.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58702024-12-19T01:06:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58712024-12-19T01:06:21.388ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58722024-12-19T01:06:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58732024-12-19T01:06:21.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58742024-12-19T01:06:21.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58752024-12-19T01:06:21.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58762024-12-19T01:06:21.393ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.343546ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
58772024-12-19T01:06:21.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58782024-12-19T01:06:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58792024-12-19T01:06:21.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58802024-12-19T01:06:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58812024-12-19T01:06:21.399ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58822024-12-19T01:06:21.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58832024-12-19T01:06:21.403ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1270, tv_nsec: 247582684 } })
58842024-12-19T01:06:21.403ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
58852024-12-19T01:06:21.404ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58862024-12-19T01:06:21.406ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58872024-12-19T01:06:21.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58882024-12-19T01:06:21.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58892024-12-19T01:06:21.422ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58902024-12-19T01:06:21.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58912024-12-19T01:06:21.423ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58922024-12-19T01:06:21.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58932024-12-19T01:06:21.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58942024-12-19T01:06:21.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58952024-12-19T01:06:21.437ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1270, tv_nsec: 281611536 } })
58962024-12-19T01:06:21.437ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
58972024-12-19T01:06:21.439ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58982024-12-19T01:06:21.440ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
58992024-12-19T01:06:21.440ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
59002024-12-19T01:06:21.440ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 67.052021ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
59012024-12-19T01:06:21.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f44812b-63b1-4574-b5e8-cf1490b9ecb4 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
59022024-12-19T01:06:21.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f44812b-63b1-4574-b5e8-cf1490b9ecb4 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
59032024-12-19T01:06:21.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59042024-12-19T01:06:21.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.830295ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
59052024-12-19T01:06:21.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59062024-12-19T01:06:21.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59072024-12-19T01:06:21.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59082024-12-19T01:06:21.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59092024-12-19T01:06:21.448ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59102024-12-19T01:06:21.448ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59112024-12-19T01:06:21.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59122024-12-19T01:06:21.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59132024-12-19T01:06:21.449ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59142024-12-19T01:06:21.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 76.875244ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
59152024-12-19T01:06:21.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f44812b-63b1-4574-b5e8-cf1490b9ecb4 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
59162024-12-19T01:06:21.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59172024-12-19T01:06:21.452ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 79.51312ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59182024-12-19T01:06:21.453ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59192024-12-19T01:06:21.454ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59202024-12-19T01:06:21.454ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59212024-12-19T01:06:21.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59222024-12-19T01:06:21.473ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59232024-12-19T01:06:21.476ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59242024-12-19T01:06:21.476ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59252024-12-19T01:06:21.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59262024-12-19T01:06:21.480ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
59272024-12-19T01:06:21.480ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
59282024-12-19T01:06:21.480ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
59292024-12-19T01:06:21.480ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59302024-12-19T01:06:21.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59312024-12-19T01:06:21.481ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59322024-12-19T01:06:21.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59332024-12-19T01:06:21.482ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59342024-12-19T01:06:21.482ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59352024-12-19T01:06:21.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59362024-12-19T01:06:21.485ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59372024-12-19T01:06:21.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59382024-12-19T01:06:21.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59392024-12-19T01:06:21.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59402024-12-19T01:06:21.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59412024-12-19T01:06:21.486ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59422024-12-19T01:06:21.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59432024-12-19T01:06:21.487ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59442024-12-19T01:06:21.487ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 114.342663ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59452024-12-19T01:06:21.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59462024-12-19T01:06:21.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59472024-12-19T01:06:21.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59482024-12-19T01:06:21.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59492024-12-19T01:06:21.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59502024-12-19T01:06:21.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59512024-12-19T01:06:21.495ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59522024-12-19T01:06:21.496ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
59532024-12-19T01:06:21.496ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
59542024-12-19T01:06:21.496ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 123.268954ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
59552024-12-19T01:06:21.498ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59562024-12-19T01:06:21.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59572024-12-19T01:06:21.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
59582024-12-19T01:06:21.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59592024-12-19T01:06:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59602024-12-19T01:06:21.500ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
59612024-12-19T01:06:21.501ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59622024-12-19T01:06:21.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
59632024-12-19T01:06:21.507ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 134.392265ms iteration = 17 status = 0
59642024-12-19T01:06:21.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59652024-12-19T01:06:21.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
59662024-12-19T01:06:21.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59672024-12-19T01:06:21.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59682024-12-19T01:06:21.513ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
59692024-12-19T01:06:21.513ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
59702024-12-19T01:06:21.513ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
59712024-12-19T01:06:21.513ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59722024-12-19T01:06:21.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59732024-12-19T01:06:21.516ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 143.499578ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
59742024-12-19T01:06:21.518ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59752024-12-19T01:06:21.518ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
59762024-12-19T01:06:21.518ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.703429ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
59772024-12-19T01:06:21.522ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 149.683593ms iteration = 20 status = {"physical_disks_added":0}
59782024-12-19T01:06:21.529ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
59792024-12-19T01:06:21.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
59802024-12-19T01:06:21.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 159.548536ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
59812024-12-19T01:06:21.542ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59822024-12-19T01:06:21.543ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59832024-12-19T01:06:21.543ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59842024-12-19T01:06:21.543ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b3536d3-8838-4a64-80da-1698eb87cbde", "content-length": "26", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} })
59852024-12-19T01:06:21.543ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59862024-12-19T01:06:21.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 172.110957ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59872024-12-19T01:06:21.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
59882024-12-19T01:06:21.547ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59892024-12-19T01:06:21.547ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59902024-12-19T01:06:21.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59912024-12-19T01:06:21.550ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
59922024-12-19T01:06:21.550ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
59932024-12-19T01:06:21.550ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59942024-12-19T01:06:21.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59952024-12-19T01:06:21.554ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 180.688864ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59962024-12-19T01:06:21.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59972024-12-19T01:06:21.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59982024-12-19T01:06:21.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59992024-12-19T01:06:21.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60002024-12-19T01:06:21.591ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60012024-12-19T01:06:21.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60022024-12-19T01:06:21.593ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60032024-12-19T01:06:21.597ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60042024-12-19T01:06:21.597ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60052024-12-19T01:06:21.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60062024-12-19T01:06:21.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60072024-12-19T01:06:21.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60082024-12-19T01:06:21.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60092024-12-19T01:06:21.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60102024-12-19T01:06:21.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60112024-12-19T01:06:21.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60122024-12-19T01:06:21.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60132024-12-19T01:06:21.618ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
60142024-12-19T01:06:21.618ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
60152024-12-19T01:06:21.618ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 00:59:01.994004 UTC dns_group = internal generation = 1
60162024-12-19T01:06:21.618ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 245.94816ms iteration = 10 status = {"generation":1}
60172024-12-19T01:06:21.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60182024-12-19T01:06:21.619ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60192024-12-19T01:06:21.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60202024-12-19T01:06:21.622ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60212024-12-19T01:06:21.626ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60222024-12-19T01:06:21.626ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60232024-12-19T01:06:21.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60242024-12-19T01:06:21.630ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
60252024-12-19T01:06:21.630ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 0 version = 2
60262024-12-19T01:06:21.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60272024-12-19T01:06:21.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60282024-12-19T01:06:21.634ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
60292024-12-19T01:06:21.634ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60302024-12-19T01:06:21.635ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "571b0586-db6d-47d3-ab65-e682a3353b32", "content-length": "26", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} })
60312024-12-19T01:06:21.635ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60322024-12-19T01:06:21.638ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60332024-12-19T01:06:21.654ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
60342024-12-19T01:06:21.654ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60352024-12-19T01:06:21.654ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae0e4920-b2ec-453b-94cb-88d8e8f80649", "content-length": "26", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} })
60362024-12-19T01:06:21.654ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60372024-12-19T01:06:21.656ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
60382024-12-19T01:06:21.657ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
60392024-12-19T01:06:21.657ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 284.600804ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
60402024-12-19T01:06:21.676ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T00:58:19.687181Z, time_modified: 2024-12-19T00:58:19.687181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }) }
60412024-12-19T01:06:21.676ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 303.318309ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]}},"default_endpoint":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
60422024-12-19T01:06:21.711ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
60432024-12-19T01:06:21.787ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
60442024-12-19T01:06:21.787ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60452024-12-19T01:06:21.788ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
60462024-12-19T01:06:21.788ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "abce1d0a-99cb-4470-be68-652a0934a70d", "content-length": "372", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} })
60472024-12-19T01:06:21.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60482024-12-19T01:06:21.788ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "bfd4e21f-0ad9-4384-acac-6970fd1bfe8b", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60492024-12-19T01:06:21.788ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60502024-12-19T01:06:21.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60512024-12-19T01:06:21.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60522024-12-19T01:06:21.789ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c7ef37af-631f-416b-85de-2f4ce08c48f9", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60532024-12-19T01:06:21.790ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60542024-12-19T01:06:21.791ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60552024-12-19T01:06:21.791ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 418.574874ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
60562024-12-19T01:06:21.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60572024-12-19T01:06:21.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60582024-12-19T01:06:21.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60592024-12-19T01:06:21.834ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
60602024-12-19T01:06:21.834ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
60612024-12-19T01:06:21.834ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2c8577f7-3842-48a9-a518-27e2681af934", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} })
60622024-12-19T01:06:21.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60632024-12-19T01:06:21.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60642024-12-19T01:06:21.842ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60652024-12-19T01:06:21.843ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c062e42-51ca-40ac-bd24-009679bf4e4c", "content-length": "1", "date": "Thu, 19 Dec 2024 01:06:20 GMT"} })
60662024-12-19T01:06:21.845ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60672024-12-19T01:06:21.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60682024-12-19T01:06:21.878ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 505.158998ms iteration = 17 status = {}
60692024-12-19T01:06:21.891ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60702024-12-19T01:06:21.891ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c46285a-0fe7-4a3c-84a6-ea75c9281e16", "content-length": "691", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} })
60712024-12-19T01:06:21.891ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
60722024-12-19T01:06:21.891ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
60732024-12-19T01:06:21.891ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
60742024-12-19T01:06:21.893ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 1 version = 2
60752024-12-19T01:06:21.893ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
60762024-12-19T01:06:21.893ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 00:59:02.707744 UTC dns_group = external generation = 2
60772024-12-19T01:06:21.893ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 520.386115ms iteration = 10 status = {"generation":2}
60782024-12-19T01:06:21.893ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 520.473737ms iteration = 17 status = {}
60792024-12-19T01:06:21.895ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 521.879086ms iteration = 17 status = null
60802024-12-19T01:06:21.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60812024-12-19T01:06:21.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60822024-12-19T01:06:21.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60832024-12-19T01:06:21.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60842024-12-19T01:06:21.902ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60852024-12-19T01:06:21.902ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60862024-12-19T01:06:21.902ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "49623f09-167e-41c5-9133-faeb4d744b07", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} })
60872024-12-19T01:06:21.904ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 531.269774ms iteration = 18 status = {}
60882024-12-19T01:06:21.910ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
60892024-12-19T01:06:21.910ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "83ff6766-374b-4692-9d90-0f366d5e4841", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60902024-12-19T01:06:21.910ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60912024-12-19T01:06:21.913ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5001f559-9e0e-4c5f-a243-f16fc5fd3a4a", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60922024-12-19T01:06:21.913ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60932024-12-19T01:06:21.915ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "419b708f-61d2-462e-83cd-7c96e01d2bee", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60942024-12-19T01:06:21.915ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60952024-12-19T01:06:21.917ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60962024-12-19T01:06:21.917ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 544.29683ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
60972024-12-19T01:06:21.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60982024-12-19T01:06:21.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60992024-12-19T01:06:21.953ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
61002024-12-19T01:06:21.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61012024-12-19T01:06:21.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61022024-12-19T01:06:21.962ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
61032024-12-19T01:06:21.962ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a23f64d-969e-42ed-9b32-d06680944c82", "content-length": "134", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} })
61042024-12-19T01:06:21.962ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
61052024-12-19T01:06:21.962ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
61062024-12-19T01:06:21.962ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
61072024-12-19T01:06:21.962ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
61082024-12-19T01:06:21.962ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61092024-12-19T01:06:21.962ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61102024-12-19T01:06:21.962ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61112024-12-19T01:06:21.962ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61122024-12-19T01:06:21.963ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61132024-12-19T01:06:21.963ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61142024-12-19T01:06:21.963ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
61152024-12-19T01:06:21.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61162024-12-19T01:06:21.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61172024-12-19T01:06:21.965ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
61182024-12-19T01:06:21.965ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "27005e15-0203-4348-915f-2ed8cbfb44a2", "content-length": "2", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} })
61192024-12-19T01:06:21.965ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
61202024-12-19T01:06:21.965ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d661461-3c80-4783-8130-d93434297127", "content-length": "52", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} })
61212024-12-19T01:06:21.965ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
61222024-12-19T01:06:21.965ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
61232024-12-19T01:06:22.060ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4a3525ad-2cfa-487f-8a81-bf27bbe88e44", "date": "Thu, 19 Dec 2024 01:06:21 GMT"} })
61242024-12-19T01:06:22.060ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
61252024-12-19T01:06:22.060ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
61262024-12-19T01:06:22.060ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef8d6690-64dc-4be3-8829-1f447f6f7ab0", "content-length": "682", "date": "Thu, 19 Dec 2024 01:06:22 GMT"} })
61272024-12-19T01:06:22.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61282024-12-19T01:06:22.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61292024-12-19T01:06:22.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61302024-12-19T01:06:22.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61312024-12-19T01:06:22.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61322024-12-19T01:06:22.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61332024-12-19T01:06:22.070ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61342024-12-19T01:06:22.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61352024-12-19T01:06:22.077ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 704.12582ms iteration = 17 status = {}
61362024-12-19T01:06:22.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 41db6a7d-0461-4cc8-9010-c5da7aa8da5d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61372024-12-19T01:06:22.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 41db6a7d-0461-4cc8-9010-c5da7aa8da5d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61382024-12-19T01:06:22.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 41db6a7d-0461-4cc8-9010-c5da7aa8da5d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61392024-12-19T01:06:22.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 7b4cee3d-3703-4843-8537-51f1a5d16cd1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
61402024-12-19T01:06:22.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 7b4cee3d-3703-4843-8537-51f1a5d16cd1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
61412024-12-19T01:06:22.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 7b4cee3d-3703-4843-8537-51f1a5d16cd1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
61422024-12-19T01:06:23.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9aa8f411-4324-44e5-9d3b-d39e9c51d421 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61432024-12-19T01:06:23.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9aa8f411-4324-44e5-9d3b-d39e9c51d421 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61442024-12-19T01:06:23.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9aa8f411-4324-44e5-9d3b-d39e9c51d421 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61452024-12-19T01:06:24.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5bd7cca4-6e05-412c-8e64-479979bcbc49 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61462024-12-19T01:06:24.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5bd7cca4-6e05-412c-8e64-479979bcbc49 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61472024-12-19T01:06:24.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5bd7cca4-6e05-412c-8e64-479979bcbc49 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61482024-12-19T01:06:25.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8553b4d7-be20-4b76-b4c5-452a90153ce9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61492024-12-19T01:06:25.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8553b4d7-be20-4b76-b4c5-452a90153ce9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61502024-12-19T01:06:25.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8553b4d7-be20-4b76-b4c5-452a90153ce9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61512024-12-19T01:06:25.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1338 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 59b322ce-4ba2-4d86-af5d-1398d2d526de response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
61522024-12-19T01:06:26.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1d313abc-1b7c-4ce1-b8c9-7235f08427da roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61532024-12-19T01:06:26.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1d313abc-1b7c-4ce1-b8c9-7235f08427da resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61542024-12-19T01:06:26.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1d313abc-1b7c-4ce1-b8c9-7235f08427da response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61552024-12-19T01:06:27.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a108b95d-94b5-449b-b3e9-3e9aa16bfcb4 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61562024-12-19T01:06:27.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a108b95d-94b5-449b-b3e9-3e9aa16bfcb4 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61572024-12-19T01:06:27.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a108b95d-94b5-449b-b3e9-3e9aa16bfcb4 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61582024-12-19T01:06:28.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fa132ef1-d2ea-4147-803f-b33e7e92c1b3 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61592024-12-19T01:06:28.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fa132ef1-d2ea-4147-803f-b33e7e92c1b3 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61602024-12-19T01:06:28.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2447 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fa132ef1-d2ea-4147-803f-b33e7e92c1b3 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61612024-12-19T01:06:29.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7d47d340-69d1-418e-8671-4aa7476a14bc roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61622024-12-19T01:06:29.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7d47d340-69d1-418e-8671-4aa7476a14bc resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61632024-12-19T01:06:29.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7d47d340-69d1-418e-8671-4aa7476a14bc response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61642024-12-19T01:06:30.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0c8f2a67-668e-4902-97d5-4414bb93247c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61652024-12-19T01:06:30.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0c8f2a67-668e-4902-97d5-4414bb93247c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61662024-12-19T01:06:30.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0c8f2a67-668e-4902-97d5-4414bb93247c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61672024-12-19T01:06:31.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
61682024-12-19T01:06:31.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
61692024-12-19T01:06:31.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61702024-12-19T01:06:31.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61712024-12-19T01:06:31.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61722024-12-19T01:06:31.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61732024-12-19T01:06:31.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61742024-12-19T01:06:31.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61752024-12-19T01:06:31.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61762024-12-19T01:06:31.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61772024-12-19T01:06:31.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61782024-12-19T01:06:31.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61792024-12-19T01:06:31.401ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61802024-12-19T01:06:31.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61812024-12-19T01:06:31.402ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.913456ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61822024-12-19T01:06:31.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61832024-12-19T01:06:31.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
61842024-12-19T01:06:31.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61852024-12-19T01:06:31.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61862024-12-19T01:06:31.421ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
61872024-12-19T01:06:31.421ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.950685ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
61882024-12-19T01:06:31.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8a516356-cb9e-4e65-9df1-58389d73aab0 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61892024-12-19T01:06:31.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8a516356-cb9e-4e65-9df1-58389d73aab0 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61902024-12-19T01:06:31.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8a516356-cb9e-4e65-9df1-58389d73aab0 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61912024-12-19T01:06:32.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5eb4025e-3b51-4ef7-8267-f69daab17f61 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61922024-12-19T01:06:32.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5eb4025e-3b51-4ef7-8267-f69daab17f61 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61932024-12-19T01:06:32.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5eb4025e-3b51-4ef7-8267-f69daab17f61 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61942024-12-19T01:06:33.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 934b8323-8a95-45fc-a6c3-f40d2d903cc6 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61952024-12-19T01:06:33.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 934b8323-8a95-45fc-a6c3-f40d2d903cc6 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61962024-12-19T01:06:33.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 934b8323-8a95-45fc-a6c3-f40d2d903cc6 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
61972024-12-19T01:06:33.898ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
61982024-12-19T01:06:33.898ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
61992024-12-19T01:06:33.929ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
62002024-12-19T01:06:33.929ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:59397
62012024-12-19T01:06:33.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59397 req_id = 9b1cfc5f-3484-4c90-ae63-6c853718fe26 roles = RoleSet { roles: {} } uri = /metrics/producers
62022024-12-19T01:06:33.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59397 req_id = 9b1cfc5f-3484-4c90-ae63-6c853718fe26 resource = Database result = Ok(()) uri = /metrics/producers
62032024-12-19T01:06:33.964ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
62042024-12-19T01:06:33.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35413 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:59397 req_id = 9b1cfc5f-3484-4c90-ae63-6c853718fe26 response_code = 201 uri = /metrics/producers
62052024-12-19T01:06:33.965ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9b1cfc5f-3484-4c90-ae63-6c853718fe26", "content-length": "41", "date": "Thu, 19 Dec 2024 01:06:33 GMT"} })
62062024-12-19T01:06:33.967ZDEBGnexus (producer-registration-task): registered with nexus successfully
62072024-12-19T01:06:33.967ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
62082024-12-19T01:06:34.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6b2f346c-155c-4731-bb31-dbd5241ec188 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62092024-12-19T01:06:34.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6b2f346c-155c-4731-bb31-dbd5241ec188 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62102024-12-19T01:06:34.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6b2f346c-155c-4731-bb31-dbd5241ec188 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62112024-12-19T01:06:35.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 923cdc95-160b-4306-bebe-a7e6c179c653 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62122024-12-19T01:06:35.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 923cdc95-160b-4306-bebe-a7e6c179c653 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62132024-12-19T01:06:35.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 923cdc95-160b-4306-bebe-a7e6c179c653 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62142024-12-19T01:06:35.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1358 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = b226c71d-512c-4596-9974-c026d1f0d986 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
62152024-12-19T01:06:36.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1ae94bf9-66b6-4b4c-9b9b-5d35d3662e87 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62162024-12-19T01:06:36.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1ae94bf9-66b6-4b4c-9b9b-5d35d3662e87 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62172024-12-19T01:06:36.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2613 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1ae94bf9-66b6-4b4c-9b9b-5d35d3662e87 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62182024-12-19T01:06:37.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f76a8422-6f39-48dc-9f85-24d3083892d9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62192024-12-19T01:06:37.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f76a8422-6f39-48dc-9f85-24d3083892d9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62202024-12-19T01:06:37.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f76a8422-6f39-48dc-9f85-24d3083892d9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62212024-12-19T01:06:38.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 559da439-ce16-46d4-839a-745332736315 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62222024-12-19T01:06:38.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 559da439-ce16-46d4-839a-745332736315 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62232024-12-19T01:06:38.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 559da439-ce16-46d4-839a-745332736315 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62242024-12-19T01:06:39.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9b4b79a5-474c-44b6-8df0-bb62b17bae22 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62252024-12-19T01:06:39.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9b4b79a5-474c-44b6-8df0-bb62b17bae22 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62262024-12-19T01:06:39.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1762 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9b4b79a5-474c-44b6-8df0-bb62b17bae22 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62272024-12-19T01:06:40.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 796b91d5-810d-4eb6-80f2-9c5c25441151 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62282024-12-19T01:06:40.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 796b91d5-810d-4eb6-80f2-9c5c25441151 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62292024-12-19T01:06:40.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 796b91d5-810d-4eb6-80f2-9c5c25441151 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62302024-12-19T01:06:41.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
62312024-12-19T01:06:41.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
62322024-12-19T01:06:41.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62332024-12-19T01:06:41.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62342024-12-19T01:06:41.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62352024-12-19T01:06:41.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62362024-12-19T01:06:41.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62372024-12-19T01:06:41.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62382024-12-19T01:06:41.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62392024-12-19T01:06:41.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62402024-12-19T01:06:41.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62412024-12-19T01:06:41.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62422024-12-19T01:06:41.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62432024-12-19T01:06:41.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
62442024-12-19T01:06:41.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62452024-12-19T01:06:41.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62462024-12-19T01:06:41.401ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
62472024-12-19T01:06:41.401ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.880719ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
62482024-12-19T01:06:41.404ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62492024-12-19T01:06:41.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62502024-12-19T01:06:41.434ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.400851ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62512024-12-19T01:06:41.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f720b12-c576-47f5-a687-5fd4021ac3f4 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62522024-12-19T01:06:41.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f720b12-c576-47f5-a687-5fd4021ac3f4 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62532024-12-19T01:06:41.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f720b12-c576-47f5-a687-5fd4021ac3f4 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62542024-12-19T01:06:42.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f20b82d2-b018-4aa0-a1a8-4c0f63dae60a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62552024-12-19T01:06:42.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f20b82d2-b018-4aa0-a1a8-4c0f63dae60a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62562024-12-19T01:06:42.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f20b82d2-b018-4aa0-a1a8-4c0f63dae60a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62572024-12-19T01:06:43.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ae2ab811-eddf-4d00-a6c2-6557f97cf01d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62582024-12-19T01:06:43.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ae2ab811-eddf-4d00-a6c2-6557f97cf01d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62592024-12-19T01:06:43.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ae2ab811-eddf-4d00-a6c2-6557f97cf01d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62602024-12-19T01:06:44.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 78ce2549-0c21-4921-8f24-0d1155b7ce3e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62612024-12-19T01:06:44.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 78ce2549-0c21-4921-8f24-0d1155b7ce3e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62622024-12-19T01:06:44.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 78ce2549-0c21-4921-8f24-0d1155b7ce3e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62632024-12-19T01:06:45.770ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1284 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 6a5a6c28-8576-4615-85b5-a749a5775486 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
62642024-12-19T01:06:45.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 35de911a-9f98-48b7-9a70-3e8906298452 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62652024-12-19T01:06:45.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 35de911a-9f98-48b7-9a70-3e8906298452 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62662024-12-19T01:06:45.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 35de911a-9f98-48b7-9a70-3e8906298452 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62672024-12-19T01:06:47.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 386b872b-e721-49a4-9b8c-bf73d133d5aa roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62682024-12-19T01:06:47.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 386b872b-e721-49a4-9b8c-bf73d133d5aa resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62692024-12-19T01:06:47.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 386b872b-e721-49a4-9b8c-bf73d133d5aa response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62702024-12-19T01:06:48.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6de5226d-596d-41b2-93a9-ea0f1d73d6a5 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62712024-12-19T01:06:48.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6de5226d-596d-41b2-93a9-ea0f1d73d6a5 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62722024-12-19T01:06:48.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1916 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6de5226d-596d-41b2-93a9-ea0f1d73d6a5 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62732024-12-19T01:06:49.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d653242a-1d22-401b-b10f-36ffebed5793 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62742024-12-19T01:06:49.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d653242a-1d22-401b-b10f-36ffebed5793 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62752024-12-19T01:06:49.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d653242a-1d22-401b-b10f-36ffebed5793 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62762024-12-19T01:06:50.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 151467f8-4939-4437-8d12-1c4f02285777 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62772024-12-19T01:06:50.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 151467f8-4939-4437-8d12-1c4f02285777 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62782024-12-19T01:06:50.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 151467f8-4939-4437-8d12-1c4f02285777 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62792024-12-19T01:06:51.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d0c5f329-8db1-451e-aca9-86146d000c6c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62802024-12-19T01:06:51.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d0c5f329-8db1-451e-aca9-86146d000c6c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62812024-12-19T01:06:51.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d0c5f329-8db1-451e-aca9-86146d000c6c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
62822024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
62832024-12-19T01:06:51.373ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62842024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
62852024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62862024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62872024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
62882024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62892024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62902024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
62912024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
62922024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
62932024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
62942024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62952024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62962024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
62972024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62982024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
62992024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63002024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63012024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
63022024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63032024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
63042024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
63052024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63062024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
63072024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
63082024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63092024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
63102024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63112024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
63122024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63132024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
63142024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63152024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
63162024-12-19T01:06:51.373ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63172024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63182024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
63192024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63202024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63212024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63222024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
63232024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63242024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63252024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63262024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63272024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
63282024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63292024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63302024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63312024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63322024-12-19T01:06:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63332024-12-19T01:06:51.376ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1300, tv_nsec: 220637634 } })
63342024-12-19T01:06:51.376ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
63352024-12-19T01:06:51.377ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.543618ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
63362024-12-19T01:06:51.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63372024-12-19T01:06:51.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63382024-12-19T01:06:51.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63392024-12-19T01:06:51.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63402024-12-19T01:06:51.381ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1300, tv_nsec: 225646033 } })
63412024-12-19T01:06:51.381ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
63422024-12-19T01:06:51.384ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1300, tv_nsec: 228584253 } })
63432024-12-19T01:06:51.384ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
63442024-12-19T01:06:51.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.741883ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
63452024-12-19T01:06:51.433ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63462024-12-19T01:06:51.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63472024-12-19T01:06:51.435ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63482024-12-19T01:06:51.436ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63492024-12-19T01:06:51.436ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
63502024-12-19T01:06:51.436ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63512024-12-19T01:06:51.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63522024-12-19T01:06:51.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63532024-12-19T01:06:51.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.145901ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
63542024-12-19T01:06:51.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63552024-12-19T01:06:51.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63562024-12-19T01:06:51.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63572024-12-19T01:06:51.440ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63582024-12-19T01:06:51.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63592024-12-19T01:06:51.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63602024-12-19T01:06:51.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63612024-12-19T01:06:51.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63622024-12-19T01:06:51.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63632024-12-19T01:06:51.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63642024-12-19T01:06:51.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63652024-12-19T01:06:51.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63662024-12-19T01:06:51.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63672024-12-19T01:06:51.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63682024-12-19T01:06:51.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63692024-12-19T01:06:51.443ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63702024-12-19T01:06:51.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63712024-12-19T01:06:51.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63722024-12-19T01:06:51.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63732024-12-19T01:06:51.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63742024-12-19T01:06:51.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.610936ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63752024-12-19T01:06:51.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63762024-12-19T01:06:51.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63772024-12-19T01:06:51.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63782024-12-19T01:06:51.447ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63792024-12-19T01:06:51.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63802024-12-19T01:06:51.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63812024-12-19T01:06:51.448ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63822024-12-19T01:06:51.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63832024-12-19T01:06:51.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63842024-12-19T01:06:51.449ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63852024-12-19T01:06:51.449ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.101643ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63862024-12-19T01:06:51.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63872024-12-19T01:06:51.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63882024-12-19T01:06:51.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63892024-12-19T01:06:51.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63902024-12-19T01:06:51.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63912024-12-19T01:06:51.463ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
63922024-12-19T01:06:51.463ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63932024-12-19T01:06:51.463ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d3e9af5-41c2-42d0-97a9-d771f883cbaf", "content-length": "26", "date": "Thu, 19 Dec 2024 01:06:51 GMT"} })
63942024-12-19T01:06:51.463ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63952024-12-19T01:06:51.466ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
63962024-12-19T01:06:51.469ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
63972024-12-19T01:06:51.469ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63982024-12-19T01:06:51.470ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3c0d0f1-3164-4918-939e-6f5ff5850b8d", "content-length": "26", "date": "Thu, 19 Dec 2024 01:06:51 GMT"} })
63992024-12-19T01:06:51.470ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64002024-12-19T01:06:51.472ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64012024-12-19T01:06:51.474ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
64022024-12-19T01:06:51.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
64032024-12-19T01:06:51.482ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64042024-12-19T01:06:51.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64052024-12-19T01:06:51.482ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64062024-12-19T01:06:51.482ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
64072024-12-19T01:06:51.482ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64082024-12-19T01:06:51.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64092024-12-19T01:06:51.484ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 110.985677ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64102024-12-19T01:06:51.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64112024-12-19T01:06:51.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64122024-12-19T01:06:51.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64132024-12-19T01:06:51.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
64142024-12-19T01:06:51.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64152024-12-19T01:06:51.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64162024-12-19T01:06:51.496ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 122.689566ms iteration = 18 status = 0
64172024-12-19T01:06:51.497ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64182024-12-19T01:06:51.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64192024-12-19T01:06:51.499ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64202024-12-19T01:06:51.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64212024-12-19T01:06:51.500ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 126.802251ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
64222024-12-19T01:06:51.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64232024-12-19T01:06:51.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
64242024-12-19T01:06:51.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64252024-12-19T01:06:51.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64262024-12-19T01:06:51.509ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
64272024-12-19T01:06:51.509ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64282024-12-19T01:06:51.509ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "51a7804b-f282-4560-97cb-1ba5e296f3cb", "content-length": "26", "date": "Thu, 19 Dec 2024 01:06:51 GMT"} })
64292024-12-19T01:06:51.509ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64302024-12-19T01:06:51.511ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64312024-12-19T01:06:51.514ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64322024-12-19T01:06:51.514ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64332024-12-19T01:06:51.514ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 141.3754ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
64342024-12-19T01:06:51.516ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 143.109504ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
64352024-12-19T01:06:51.523ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
64362024-12-19T01:06:51.523ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 149.548621ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
64372024-12-19T01:06:51.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64382024-12-19T01:06:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64392024-12-19T01:06:51.592ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 218.564698ms iteration = 18 status = {}
64402024-12-19T01:06:51.604ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64412024-12-19T01:06:51.605ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "025981fd-0e84-4745-8912-083ad07b1f14", "content-length": "1", "date": "Thu, 19 Dec 2024 01:06:51 GMT"} })
64422024-12-19T01:06:51.607ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64432024-12-19T01:06:51.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64442024-12-19T01:06:51.613ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 239.816326ms iteration = 18 status = null
64452024-12-19T01:06:51.626ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 252.898274ms iteration = 21 status = {"physical_disks_added":0}
64462024-12-19T01:06:51.627ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64472024-12-19T01:06:51.627ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64482024-12-19T01:06:51.628ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1ac7eb1-47a0-49f2-ab09-6a76bfcf3057", "content-length": "372", "date": "Thu, 19 Dec 2024 01:06:51 GMT"} })
64492024-12-19T01:06:51.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64502024-12-19T01:06:51.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64512024-12-19T01:06:51.644ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64522024-12-19T01:06:51.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64532024-12-19T01:06:51.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64542024-12-19T01:06:51.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64552024-12-19T01:06:51.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64562024-12-19T01:06:51.683ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64572024-12-19T01:06:51.684ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64582024-12-19T01:06:51.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64592024-12-19T01:06:51.685ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
64602024-12-19T01:06:51.685ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64612024-12-19T01:06:51.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64622024-12-19T01:06:51.694ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
64632024-12-19T01:06:51.694ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64642024-12-19T01:06:51.695ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a44be53b-866d-49ad-b728-90c00da1fe3f", "date": "Thu, 19 Dec 2024 01:06:51 GMT"} })
64652024-12-19T01:06:51.695ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64662024-12-19T01:06:51.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64672024-12-19T01:06:51.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64682024-12-19T01:06:51.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64692024-12-19T01:06:51.698ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64702024-12-19T01:06:51.699ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3da7b558-ae18-4588-8536-e9372f463f5d", "content-length": "134", "date": "Thu, 19 Dec 2024 01:06:51 GMT"} })
64712024-12-19T01:06:51.699ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64722024-12-19T01:06:51.699ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
64732024-12-19T01:06:51.699ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64742024-12-19T01:06:51.699ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64752024-12-19T01:06:51.699ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64762024-12-19T01:06:51.699ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64772024-12-19T01:06:51.699ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64782024-12-19T01:06:51.699ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64792024-12-19T01:06:51.699ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64802024-12-19T01:06:51.699ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64812024-12-19T01:06:51.700ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
64822024-12-19T01:06:51.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64832024-12-19T01:06:51.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64842024-12-19T01:06:51.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64852024-12-19T01:06:51.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64862024-12-19T01:06:51.702ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64872024-12-19T01:06:51.702ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d558839b-61b3-40f2-b246-27ba61fc6fce", "content-length": "2", "date": "Thu, 19 Dec 2024 01:06:51 GMT"} })
64882024-12-19T01:06:51.702ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64892024-12-19T01:06:51.703ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1dae0c1-d6e8-4072-ae92-084954324996", "content-length": "52", "date": "Thu, 19 Dec 2024 01:06:51 GMT"} })
64902024-12-19T01:06:51.703ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
64912024-12-19T01:06:51.703ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64922024-12-19T01:06:51.704ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64932024-12-19T01:06:51.704ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64942024-12-19T01:06:51.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64952024-12-19T01:06:51.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64962024-12-19T01:06:51.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64972024-12-19T01:06:51.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64982024-12-19T01:06:51.768ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64992024-12-19T01:06:51.830ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "00cfbc74-4474-407d-9f72-fb43741c0e51", "date": "Thu, 19 Dec 2024 01:06:51 GMT"} })
65002024-12-19T01:06:51.830ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
65012024-12-19T01:06:51.830ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65022024-12-19T01:06:51.831ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed21e1c5-3ad7-4d4b-9de1-dd79a2fed7ae", "content-length": "682", "date": "Thu, 19 Dec 2024 01:06:51 GMT"} })
65032024-12-19T01:06:51.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65042024-12-19T01:06:51.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65052024-12-19T01:06:51.831ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bc947aa0-7840-41dc-b2be-d0416c42f172", "date": "Thu, 19 Dec 2024 01:06:51 GMT"} })
65062024-12-19T01:06:51.831ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "61db352c-8b44-480c-93ef-b36c77d69634", "content-length": "691", "date": "Thu, 19 Dec 2024 01:06:51 GMT"} })
65072024-12-19T01:06:51.831ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
65082024-12-19T01:06:51.831ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
65092024-12-19T01:06:51.831ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
65102024-12-19T01:06:51.834ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 460.590624ms iteration = 19 status = {}
65112024-12-19T01:06:51.834ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 460.765926ms iteration = 18 status = {}
65122024-12-19T01:06:51.836ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65132024-12-19T01:06:51.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65142024-12-19T01:06:51.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65152024-12-19T01:06:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65162024-12-19T01:06:51.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65172024-12-19T01:06:51.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65182024-12-19T01:06:51.854ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 480.92589ms iteration = 18 status = {}
65192024-12-19T01:06:52.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b69e9ccb-a5d4-4676-b100-04e4f040da57 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65202024-12-19T01:06:52.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b69e9ccb-a5d4-4676-b100-04e4f040da57 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65212024-12-19T01:06:52.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b69e9ccb-a5d4-4676-b100-04e4f040da57 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65222024-12-19T01:06:52.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = aa6b428c-ddde-48f8-bd55-d4412d73a7a8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
65232024-12-19T01:06:52.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = aa6b428c-ddde-48f8-bd55-d4412d73a7a8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
65242024-12-19T01:06:52.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = aa6b428c-ddde-48f8-bd55-d4412d73a7a8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
65252024-12-19T01:06:53.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 85113c17-fedd-47c8-980d-164d1cb44057 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65262024-12-19T01:06:53.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 85113c17-fedd-47c8-980d-164d1cb44057 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65272024-12-19T01:06:53.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 85113c17-fedd-47c8-980d-164d1cb44057 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65282024-12-19T01:06:54.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e316b7b2-8990-4f86-9ac3-1e91196e0f42 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65292024-12-19T01:06:54.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e316b7b2-8990-4f86-9ac3-1e91196e0f42 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65302024-12-19T01:06:54.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e316b7b2-8990-4f86-9ac3-1e91196e0f42 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65312024-12-19T01:06:55.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d3ebde9f-fd86-4172-b69b-7f261f7eb450 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65322024-12-19T01:06:55.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d3ebde9f-fd86-4172-b69b-7f261f7eb450 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65332024-12-19T01:06:55.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2533 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d3ebde9f-fd86-4172-b69b-7f261f7eb450 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65342024-12-19T01:06:55.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1406 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 51ae1cbf-7e0c-4813-8e2e-61b31978398b response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
65352024-12-19T01:06:56.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 225fafd5-7a5a-463d-963d-59d61e4cb3cb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65362024-12-19T01:06:56.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 225fafd5-7a5a-463d-963d-59d61e4cb3cb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65372024-12-19T01:06:56.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 225fafd5-7a5a-463d-963d-59d61e4cb3cb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65382024-12-19T01:06:57.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e1dc026e-fded-445d-b0e1-302e7700275e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65392024-12-19T01:06:57.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e1dc026e-fded-445d-b0e1-302e7700275e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65402024-12-19T01:06:57.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e1dc026e-fded-445d-b0e1-302e7700275e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65412024-12-19T01:06:58.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c5e4c8aa-a59b-448f-91fb-868e48fd4cc5 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65422024-12-19T01:06:58.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c5e4c8aa-a59b-448f-91fb-868e48fd4cc5 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65432024-12-19T01:06:58.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c5e4c8aa-a59b-448f-91fb-868e48fd4cc5 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65442024-12-19T01:06:59.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 25e9e47b-cfbe-4417-9839-53a4b557e841 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65452024-12-19T01:06:59.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 25e9e47b-cfbe-4417-9839-53a4b557e841 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65462024-12-19T01:06:59.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 25e9e47b-cfbe-4417-9839-53a4b557e841 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65472024-12-19T01:07:00.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e9b266a2-1009-4a13-878e-5f7036fd74aa roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65482024-12-19T01:07:00.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e9b266a2-1009-4a13-878e-5f7036fd74aa resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65492024-12-19T01:07:00.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e9b266a2-1009-4a13-878e-5f7036fd74aa response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65502024-12-19T01:07:01.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ef351339-eb45-49c4-8c79-eec341819cea roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65512024-12-19T01:07:01.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ef351339-eb45-49c4-8c79-eec341819cea resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65522024-12-19T01:07:01.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ef351339-eb45-49c4-8c79-eec341819cea response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65532024-12-19T01:07:01.374ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
65542024-12-19T01:07:01.374ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
65552024-12-19T01:07:01.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65562024-12-19T01:07:01.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65572024-12-19T01:07:01.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65582024-12-19T01:07:01.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65592024-12-19T01:07:01.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65602024-12-19T01:07:01.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65612024-12-19T01:07:01.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65622024-12-19T01:07:01.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65632024-12-19T01:07:01.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65642024-12-19T01:07:01.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65652024-12-19T01:07:01.404ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65662024-12-19T01:07:01.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65672024-12-19T01:07:01.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65682024-12-19T01:07:01.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
65692024-12-19T01:07:01.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65702024-12-19T01:07:01.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65712024-12-19T01:07:01.424ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
65722024-12-19T01:07:01.424ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.195752ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
65732024-12-19T01:07:01.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.600615ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65742024-12-19T01:07:02.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 792a6456-63e6-4fc2-aae1-4204d769ef56 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65752024-12-19T01:07:02.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 792a6456-63e6-4fc2-aae1-4204d769ef56 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65762024-12-19T01:07:02.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 792a6456-63e6-4fc2-aae1-4204d769ef56 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65772024-12-19T01:07:03.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f1f15b9-6f39-49d1-b9a6-0ded9c0259b2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65782024-12-19T01:07:03.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f1f15b9-6f39-49d1-b9a6-0ded9c0259b2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65792024-12-19T01:07:03.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2619 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f1f15b9-6f39-49d1-b9a6-0ded9c0259b2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65802024-12-19T01:07:04.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 93087f17-af4b-4c91-a3ab-405fe1c5a5d5 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65812024-12-19T01:07:04.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 93087f17-af4b-4c91-a3ab-405fe1c5a5d5 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65822024-12-19T01:07:04.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 93087f17-af4b-4c91-a3ab-405fe1c5a5d5 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65832024-12-19T01:07:05.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 38220324-47e0-4585-8bd7-0b5a274c227a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65842024-12-19T01:07:05.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 38220324-47e0-4585-8bd7-0b5a274c227a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65852024-12-19T01:07:05.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 38220324-47e0-4585-8bd7-0b5a274c227a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65862024-12-19T01:07:05.772ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1460 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 4c8c2ee3-f99d-4bcf-a8ac-fd9558c286bb response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
65872024-12-19T01:07:06.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d84e968e-2852-4c12-a95f-6c0c6550c758 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65882024-12-19T01:07:06.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d84e968e-2852-4c12-a95f-6c0c6550c758 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65892024-12-19T01:07:06.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d84e968e-2852-4c12-a95f-6c0c6550c758 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65902024-12-19T01:07:07.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e4febb05-66f7-4a6a-b324-d21d0abac298 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65912024-12-19T01:07:07.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e4febb05-66f7-4a6a-b324-d21d0abac298 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65922024-12-19T01:07:07.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e4febb05-66f7-4a6a-b324-d21d0abac298 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65932024-12-19T01:07:08.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b9824a50-f2ed-4949-a27f-97a75965a91a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65942024-12-19T01:07:08.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b9824a50-f2ed-4949-a27f-97a75965a91a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65952024-12-19T01:07:08.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b9824a50-f2ed-4949-a27f-97a75965a91a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65962024-12-19T01:07:09.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 72f2f0a4-4515-4832-a48d-da30273e3158 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65972024-12-19T01:07:09.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 72f2f0a4-4515-4832-a48d-da30273e3158 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65982024-12-19T01:07:09.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 72f2f0a4-4515-4832-a48d-da30273e3158 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
65992024-12-19T01:07:10.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 89b052cd-d568-4ff8-ab4c-8666d98bfa5c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66002024-12-19T01:07:10.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 89b052cd-d568-4ff8-ab4c-8666d98bfa5c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66012024-12-19T01:07:10.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 89b052cd-d568-4ff8-ab4c-8666d98bfa5c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66022024-12-19T01:07:11.374ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
66032024-12-19T01:07:11.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66042024-12-19T01:07:11.374ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
66052024-12-19T01:07:11.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66062024-12-19T01:07:11.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66072024-12-19T01:07:11.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66082024-12-19T01:07:11.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66092024-12-19T01:07:11.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66102024-12-19T01:07:11.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66112024-12-19T01:07:11.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66122024-12-19T01:07:11.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66132024-12-19T01:07:11.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66142024-12-19T01:07:11.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66152024-12-19T01:07:11.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
66162024-12-19T01:07:11.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66172024-12-19T01:07:11.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66182024-12-19T01:07:11.400ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
66192024-12-19T01:07:11.400ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.688649ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
66202024-12-19T01:07:11.409ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66212024-12-19T01:07:11.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66222024-12-19T01:07:11.410ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.425085ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66232024-12-19T01:07:11.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 24264113-b225-4a95-8162-f21e4453a41e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66242024-12-19T01:07:11.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 24264113-b225-4a95-8162-f21e4453a41e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66252024-12-19T01:07:11.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 24264113-b225-4a95-8162-f21e4453a41e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66262024-12-19T01:07:12.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6cfa6ffb-b69a-46bc-bb2d-5da0c8f1ff46 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66272024-12-19T01:07:12.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6cfa6ffb-b69a-46bc-bb2d-5da0c8f1ff46 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66282024-12-19T01:07:12.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6cfa6ffb-b69a-46bc-bb2d-5da0c8f1ff46 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66292024-12-19T01:07:13.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3197594d-abce-4ec8-8695-614356e16f1d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66302024-12-19T01:07:13.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3197594d-abce-4ec8-8695-614356e16f1d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66312024-12-19T01:07:13.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3197594d-abce-4ec8-8695-614356e16f1d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66322024-12-19T01:07:14.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6f64ca4c-53cc-4246-83c2-cdce8fe91a56 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66332024-12-19T01:07:14.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6f64ca4c-53cc-4246-83c2-cdce8fe91a56 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66342024-12-19T01:07:14.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6f64ca4c-53cc-4246-83c2-cdce8fe91a56 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66352024-12-19T01:07:15.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = db94978e-6f74-44ce-bd7e-f91995987f4d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66362024-12-19T01:07:15.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = db94978e-6f74-44ce-bd7e-f91995987f4d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66372024-12-19T01:07:15.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = db94978e-6f74-44ce-bd7e-f91995987f4d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66382024-12-19T01:07:15.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1437 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 6528a4ee-3463-4bc9-b81c-266c27ebb916 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
66392024-12-19T01:07:16.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 01f2f9ce-ef37-45f0-82ac-29adfb8c89c0 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66402024-12-19T01:07:16.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 01f2f9ce-ef37-45f0-82ac-29adfb8c89c0 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66412024-12-19T01:07:16.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 01f2f9ce-ef37-45f0-82ac-29adfb8c89c0 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66422024-12-19T01:07:17.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b132b00f-d678-416d-88d5-63767e92a9bf roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66432024-12-19T01:07:17.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b132b00f-d678-416d-88d5-63767e92a9bf resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66442024-12-19T01:07:17.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b132b00f-d678-416d-88d5-63767e92a9bf response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66452024-12-19T01:07:18.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1724cfa9-0534-4c1b-aefd-ff32d0d9bedd roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66462024-12-19T01:07:18.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1724cfa9-0534-4c1b-aefd-ff32d0d9bedd resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66472024-12-19T01:07:18.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1724cfa9-0534-4c1b-aefd-ff32d0d9bedd response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66482024-12-19T01:07:19.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6b3d9d83-5276-4b89-a21f-675c89cff370 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66492024-12-19T01:07:19.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6b3d9d83-5276-4b89-a21f-675c89cff370 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66502024-12-19T01:07:19.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6b3d9d83-5276-4b89-a21f-675c89cff370 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66512024-12-19T01:07:20.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e79b63ea-5f29-4f4e-a3ef-2796e70a112f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66522024-12-19T01:07:20.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e79b63ea-5f29-4f4e-a3ef-2796e70a112f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66532024-12-19T01:07:20.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e79b63ea-5f29-4f4e-a3ef-2796e70a112f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
66542024-12-19T01:07:20.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = e7adf65f-ffe1-468d-91d5-1c41c25392c9 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
66552024-12-19T01:07:20.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = e7adf65f-ffe1-468d-91d5-1c41c25392c9 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
66562024-12-19T01:07:20.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = e7adf65f-ffe1-468d-91d5-1c41c25392c9 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
66572024-12-19T01:07:20.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = c4e70c37-9243-4e1f-95d3-8d7f4dde9e82 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
66582024-12-19T01:07:20.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = c4e70c37-9243-4e1f-95d3-8d7f4dde9e82 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
66592024-12-19T01:07:20.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = c4e70c37-9243-4e1f-95d3-8d7f4dde9e82 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
66602024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
66612024-12-19T01:07:21.374ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 00:57:21.374546888 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
66622024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
66632024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
66642024-12-19T01:07:21.374ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a
66652024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.38\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a"}
66662024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
66672024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
66682024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
66692024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66702024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
66712024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66722024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
66732024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
66742024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
66752024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
66762024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66772024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
66782024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66792024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66802024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
66812024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66822024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
66832024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
66842024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66852024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
66862024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66872024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
66882024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
66892024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66902024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66912024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
66922024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66932024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
66942024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
66952024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
66962024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
66972024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
66982024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
66992024-12-19T01:07:21.374ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67002024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
67012024-12-19T01:07:21.374ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
67022024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67032024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67042024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67052024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
67062024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67072024-12-19T01:07:21.374ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
67082024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67092024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
67102024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67112024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
67122024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67132024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
67142024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67152024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
67162024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
67172024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
67182024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67192024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
67202024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
67212024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67222024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67232024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
67242024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
67252024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
67262024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67272024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67282024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67292024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67302024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67312024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67322024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67332024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67342024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67352024-12-19T01:07:21.375ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a880a2e-2471-4fd8-9ad5-3e0c3fbde317.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1330, tv_nsec: 218718476 } })
67362024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67372024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67382024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67392024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67402024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67412024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
67422024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67432024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67442024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67452024-12-19T01:07:21.375ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0018a454-75c0-41b1-be69-9476391f01e1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("050cdbd7-4ebc-471c-b4dc-ec1b3741f763.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1330, tv_nsec: 218791737 } })
67462024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67472024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67482024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67492024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67502024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67512024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67522024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67532024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67542024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
67552024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.176926ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
67562024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67572024-12-19T01:07:21.375ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67582024-12-19T01:07:21.376ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
67592024-12-19T01:07:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.417619ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
67602024-12-19T01:07:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67612024-12-19T01:07:21.376ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67622024-12-19T01:07:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67632024-12-19T01:07:21.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67642024-12-19T01:07:21.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67652024-12-19T01:07:21.377ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 00:57:21.374546888 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
67662024-12-19T01:07:21.377ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.087352ms iteration = 10 status = {"expiration":"2024-12-19T00:57:21.374546888Z","pruned":[]}
67672024-12-19T01:07:21.377ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.342416ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
67682024-12-19T01:07:21.378ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67692024-12-19T01:07:21.378ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.805002ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67702024-12-19T01:07:21.380ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67712024-12-19T01:07:21.380ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67722024-12-19T01:07:21.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67732024-12-19T01:07:21.384ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1330, tv_nsec: 227737579 } })
67742024-12-19T01:07:21.384ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
67752024-12-19T01:07:21.385ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67762024-12-19T01:07:21.385ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
67772024-12-19T01:07:21.385ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67782024-12-19T01:07:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67792024-12-19T01:07:21.387ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1330, tv_nsec: 230498116 } })
67802024-12-19T01:07:21.387ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
67812024-12-19T01:07:21.387ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67822024-12-19T01:07:21.388ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67832024-12-19T01:07:21.388ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67842024-12-19T01:07:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67852024-12-19T01:07:21.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67862024-12-19T01:07:21.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
67872024-12-19T01:07:21.391ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67882024-12-19T01:07:21.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67892024-12-19T01:07:21.404ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67902024-12-19T01:07:21.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67912024-12-19T01:07:21.407ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67922024-12-19T01:07:21.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67932024-12-19T01:07:21.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67942024-12-19T01:07:21.411ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67952024-12-19T01:07:21.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67962024-12-19T01:07:21.416ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67972024-12-19T01:07:21.416ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67982024-12-19T01:07:21.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67992024-12-19T01:07:21.422ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68002024-12-19T01:07:21.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68012024-12-19T01:07:21.425ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68022024-12-19T01:07:21.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68032024-12-19T01:07:21.434ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68042024-12-19T01:07:21.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68052024-12-19T01:07:21.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68062024-12-19T01:07:21.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68072024-12-19T01:07:21.443ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68082024-12-19T01:07:21.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.499948ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
68092024-12-19T01:07:21.447ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68102024-12-19T01:07:21.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
68112024-12-19T01:07:21.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68122024-12-19T01:07:21.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
68132024-12-19T01:07:21.448ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68142024-12-19T01:07:21.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68152024-12-19T01:07:21.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68162024-12-19T01:07:21.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68172024-12-19T01:07:21.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68182024-12-19T01:07:21.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.60232ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
68192024-12-19T01:07:21.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68202024-12-19T01:07:21.453ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68212024-12-19T01:07:21.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68222024-12-19T01:07:21.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68232024-12-19T01:07:21.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68242024-12-19T01:07:21.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68252024-12-19T01:07:21.455ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68262024-12-19T01:07:21.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68272024-12-19T01:07:21.457ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68282024-12-19T01:07:21.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68292024-12-19T01:07:21.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68302024-12-19T01:07:21.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68312024-12-19T01:07:21.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68322024-12-19T01:07:21.460ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68332024-12-19T01:07:21.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68342024-12-19T01:07:21.460ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68352024-12-19T01:07:21.461ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1330, tv_nsec: 304478801 } })
68362024-12-19T01:07:21.461ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
68372024-12-19T01:07:21.462ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
68382024-12-19T01:07:21.462ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
68392024-12-19T01:07:21.462ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 87.818612ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
68402024-12-19T01:07:21.463ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68412024-12-19T01:07:21.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
68422024-12-19T01:07:21.464ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68432024-12-19T01:07:21.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68442024-12-19T01:07:21.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
68452024-12-19T01:07:21.466ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68462024-12-19T01:07:21.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68472024-12-19T01:07:21.466ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68482024-12-19T01:07:21.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
68492024-12-19T01:07:21.467ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68502024-12-19T01:07:21.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68512024-12-19T01:07:21.467ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68522024-12-19T01:07:21.470ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68532024-12-19T01:07:21.470ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68542024-12-19T01:07:21.470ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.431446ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68552024-12-19T01:07:21.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68562024-12-19T01:07:21.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
68572024-12-19T01:07:21.470ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68582024-12-19T01:07:21.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68592024-12-19T01:07:21.473ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68602024-12-19T01:07:21.474ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68612024-12-19T01:07:21.474ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68622024-12-19T01:07:21.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68632024-12-19T01:07:21.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68642024-12-19T01:07:21.476ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68652024-12-19T01:07:21.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68662024-12-19T01:07:21.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
68672024-12-19T01:07:21.477ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
68682024-12-19T01:07:21.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
68692024-12-19T01:07:21.481ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68702024-12-19T01:07:21.484ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68712024-12-19T01:07:21.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68722024-12-19T01:07:21.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68732024-12-19T01:07:21.485ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 110.420449ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
68742024-12-19T01:07:21.489ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
68752024-12-19T01:07:21.489ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
68762024-12-19T01:07:21.489ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
68772024-12-19T01:07:21.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68782024-12-19T01:07:21.490ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 115.436267ms iteration = 5 status = {"nsuccess":5}
68792024-12-19T01:07:21.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68802024-12-19T01:07:21.495ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68812024-12-19T01:07:21.495ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68822024-12-19T01:07:21.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68832024-12-19T01:07:21.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68842024-12-19T01:07:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68852024-12-19T01:07:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68862024-12-19T01:07:21.500ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68872024-12-19T01:07:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68882024-12-19T01:07:21.502ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68892024-12-19T01:07:21.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68902024-12-19T01:07:21.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68912024-12-19T01:07:21.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
68922024-12-19T01:07:21.512ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
68932024-12-19T01:07:21.512ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
68942024-12-19T01:07:21.512ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
68952024-12-19T01:07:21.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68962024-12-19T01:07:21.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68972024-12-19T01:07:21.514ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68982024-12-19T01:07:21.515ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
68992024-12-19T01:07:21.515ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
69002024-12-19T01:07:21.515ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 140.459197ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
69012024-12-19T01:07:21.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69022024-12-19T01:07:21.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69032024-12-19T01:07:21.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69042024-12-19T01:07:21.519ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69052024-12-19T01:07:21.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69062024-12-19T01:07:21.521ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69072024-12-19T01:07:21.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69082024-12-19T01:07:21.522ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69092024-12-19T01:07:21.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69102024-12-19T01:07:21.524ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
69112024-12-19T01:07:21.524ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69122024-12-19T01:07:21.524ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69132024-12-19T01:07:21.524ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "13170b9f-d7a1-4b9e-bc70-b9b2dc18010c", "content-length": "26", "date": "Thu, 19 Dec 2024 01:07:21 GMT"} })
69142024-12-19T01:07:21.524ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69152024-12-19T01:07:21.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69162024-12-19T01:07:21.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
69172024-12-19T01:07:21.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69182024-12-19T01:07:21.527ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69192024-12-19T01:07:21.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69202024-12-19T01:07:21.530ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
69212024-12-19T01:07:21.530ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 155.284538ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
69222024-12-19T01:07:21.530ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 155.681814ms iteration = 19 status = 0
69232024-12-19T01:07:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
69242024-12-19T01:07:21.530ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69252024-12-19T01:07:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69262024-12-19T01:07:21.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 157.203685ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69272024-12-19T01:07:21.540ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
69282024-12-19T01:07:21.543ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
69292024-12-19T01:07:21.543ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
69302024-12-19T01:07:21.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69312024-12-19T01:07:21.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69322024-12-19T01:07:21.546ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69332024-12-19T01:07:21.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
69342024-12-19T01:07:21.550ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69352024-12-19T01:07:21.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
69362024-12-19T01:07:21.550ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
69372024-12-19T01:07:21.550ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 176.287124ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
69382024-12-19T01:07:21.551ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
69392024-12-19T01:07:21.551ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69402024-12-19T01:07:21.551ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "36aaf4fe-af8e-4d3d-b723-fccbac758097", "content-length": "26", "date": "Thu, 19 Dec 2024 01:07:21 GMT"} })
69412024-12-19T01:07:21.551ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69422024-12-19T01:07:21.552ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 177.770004ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
69432024-12-19T01:07:21.553ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69442024-12-19T01:07:21.553ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
69452024-12-19T01:07:21.553ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
69462024-12-19T01:07:21.553ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 00:59:01.994004 UTC dns_group = internal generation = 1
69472024-12-19T01:07:21.553ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 179.365955ms iteration = 11 status = {"generation":1}
69482024-12-19T01:07:21.554ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69492024-12-19T01:07:21.554ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
69502024-12-19T01:07:21.554ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 180.120806ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
69512024-12-19T01:07:21.569ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69522024-12-19T01:07:21.569ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
69532024-12-19T01:07:21.569ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 0 version = 2
69542024-12-19T01:07:21.570ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69552024-12-19T01:07:21.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69562024-12-19T01:07:21.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69572024-12-19T01:07:21.572ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
69582024-12-19T01:07:21.572ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69592024-12-19T01:07:21.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
69602024-12-19T01:07:21.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
69612024-12-19T01:07:21.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69622024-12-19T01:07:21.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69632024-12-19T01:07:21.576ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
69642024-12-19T01:07:21.577ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 1 version = 2
69652024-12-19T01:07:21.577ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
69662024-12-19T01:07:21.577ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 00:59:02.707744 UTC dns_group = external generation = 2
69672024-12-19T01:07:21.577ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 202.783443ms iteration = 11 status = {"generation":2}
69682024-12-19T01:07:21.627ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69692024-12-19T01:07:21.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69702024-12-19T01:07:21.628ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69712024-12-19T01:07:21.630ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69722024-12-19T01:07:21.630ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69732024-12-19T01:07:21.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69742024-12-19T01:07:21.632ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T00:58:19.687181Z, time_modified: 2024-12-19T00:58:19.687181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }) }
69752024-12-19T01:07:21.632ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 257.590737ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]}},"default_endpoint":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
69762024-12-19T01:07:21.638ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 263.473007ms iteration = 22 status = {"physical_disks_added":0}
69772024-12-19T01:07:21.655ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
69782024-12-19T01:07:21.655ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 280.479689ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
69792024-12-19T01:07:21.721ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
69802024-12-19T01:07:21.725ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
69812024-12-19T01:07:21.725ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "24b0e625-312d-428c-a74a-fc6c117aba37", "content-length": "1", "date": "Thu, 19 Dec 2024 01:07:20 GMT"} })
69822024-12-19T01:07:21.727ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69832024-12-19T01:07:21.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69842024-12-19T01:07:21.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 69e0ab3c-e286-4640-8358-40f62a1c2ba1 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
69852024-12-19T01:07:21.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 69e0ab3c-e286-4640-8358-40f62a1c2ba1 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
69862024-12-19T01:07:21.771ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
69872024-12-19T01:07:21.771ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69882024-12-19T01:07:21.771ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e71190c4-5fd4-4cfb-97f4-7b7af14dc16b", "content-length": "372", "date": "Thu, 19 Dec 2024 01:07:21 GMT"} })
69892024-12-19T01:07:21.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69902024-12-19T01:07:21.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69912024-12-19T01:07:21.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69922024-12-19T01:07:21.774ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 400.017682ms iteration = 19 status = null
69932024-12-19T01:07:21.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 69e0ab3c-e286-4640-8358-40f62a1c2ba1 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
69942024-12-19T01:07:21.776ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69952024-12-19T01:07:21.776ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69962024-12-19T01:07:21.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69972024-12-19T01:07:21.831ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
69982024-12-19T01:07:21.831ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69992024-12-19T01:07:21.831ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e96fa5db-1ff6-4095-8687-83ea0782f533", "date": "Thu, 19 Dec 2024 01:07:21 GMT"} })
70002024-12-19T01:07:21.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70012024-12-19T01:07:21.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70022024-12-19T01:07:21.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70032024-12-19T01:07:21.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70042024-12-19T01:07:21.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70052024-12-19T01:07:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70062024-12-19T01:07:21.845ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
70072024-12-19T01:07:21.845ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70082024-12-19T01:07:21.846ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d94533bd-7079-4740-892b-6d470ae317fb", "date": "Thu, 19 Dec 2024 01:07:21 GMT"} })
70092024-12-19T01:07:21.847ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 472.725439ms iteration = 20 status = {}
70102024-12-19T01:07:21.861ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
70112024-12-19T01:07:21.861ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e6018d74-b627-4115-95ef-a1a3836e8c86", "date": "Thu, 19 Dec 2024 01:07:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
70122024-12-19T01:07:21.861ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
70132024-12-19T01:07:21.863ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c89f286e-5501-415c-9c1e-e40e24d7d971", "date": "Thu, 19 Dec 2024 01:07:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
70142024-12-19T01:07:21.863ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
70152024-12-19T01:07:21.864ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "db699b8d-36e3-4c45-a44d-d9d4459c0169", "date": "Thu, 19 Dec 2024 01:07:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
70162024-12-19T01:07:21.864ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
70172024-12-19T01:07:21.866ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
70182024-12-19T01:07:21.866ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 491.704067ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
70192024-12-19T01:07:21.916ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 541.382461ms iteration = 19 status = {}
70202024-12-19T01:07:21.918ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
70212024-12-19T01:07:21.918ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70222024-12-19T01:07:21.918ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebdd22ad-69b0-4f6c-94ba-ecb77b771b32", "content-length": "26", "date": "Thu, 19 Dec 2024 01:07:21 GMT"} })
70232024-12-19T01:07:21.918ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70242024-12-19T01:07:21.920ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
70252024-12-19T01:07:21.929ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
70262024-12-19T01:07:21.930ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e4df3527-4844-438a-890e-73753761a7f3", "date": "Thu, 19 Dec 2024 01:07:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70272024-12-19T01:07:21.930ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70282024-12-19T01:07:21.931ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1188748b-2a5c-4b58-8991-8483ce864e1d", "date": "Thu, 19 Dec 2024 01:07:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70292024-12-19T01:07:21.931ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70302024-12-19T01:07:21.933ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70312024-12-19T01:07:21.933ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 558.19623ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
70322024-12-19T01:07:21.942ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70332024-12-19T01:07:22.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70342024-12-19T01:07:22.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70352024-12-19T01:07:22.022ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
70362024-12-19T01:07:22.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70372024-12-19T01:07:22.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70382024-12-19T01:07:22.028ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec1c97e1-c565-4074-8f87-90c7305d2b9a", "content-length": "691", "date": "Thu, 19 Dec 2024 01:07:22 GMT"} })
70392024-12-19T01:07:22.028ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
70402024-12-19T01:07:22.028ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
70412024-12-19T01:07:22.028ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
70422024-12-19T01:07:22.030ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 655.40272ms iteration = 19 status = {}
70432024-12-19T01:07:22.032ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
70442024-12-19T01:07:22.033ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "07f1a775-da12-4dc1-8e38-985bad784f4b", "content-length": "134", "date": "Thu, 19 Dec 2024 01:07:22 GMT"} })
70452024-12-19T01:07:22.033ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
70462024-12-19T01:07:22.033ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
70472024-12-19T01:07:22.033ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
70482024-12-19T01:07:22.033ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
70492024-12-19T01:07:22.033ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70502024-12-19T01:07:22.033ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70512024-12-19T01:07:22.033ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70522024-12-19T01:07:22.033ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70532024-12-19T01:07:22.033ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70542024-12-19T01:07:22.033ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70552024-12-19T01:07:22.033ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
70562024-12-19T01:07:22.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70572024-12-19T01:07:22.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70582024-12-19T01:07:22.036ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
70592024-12-19T01:07:22.036ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "60e026c6-80ad-4b35-b2b4-1e35beeb0a13", "content-length": "2", "date": "Thu, 19 Dec 2024 01:07:22 GMT"} })
70602024-12-19T01:07:22.036ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
70612024-12-19T01:07:22.036ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e17c4bf2-1171-498c-b44a-c7db55ce9aef", "content-length": "52", "date": "Thu, 19 Dec 2024 01:07:22 GMT"} })
70622024-12-19T01:07:22.036ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
70632024-12-19T01:07:22.036ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
70642024-12-19T01:07:22.146ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4b2ae27a-9f25-47a4-b5cd-5b96088867ae", "date": "Thu, 19 Dec 2024 01:07:22 GMT"} })
70652024-12-19T01:07:22.146ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
70662024-12-19T01:07:22.146ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
70672024-12-19T01:07:22.146ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "89ed2d78-ab33-49e0-b6cb-f7dfdbbaa13d", "content-length": "682", "date": "Thu, 19 Dec 2024 01:07:22 GMT"} })
70682024-12-19T01:07:22.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70692024-12-19T01:07:22.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70702024-12-19T01:07:22.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70712024-12-19T01:07:22.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70722024-12-19T01:07:22.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70732024-12-19T01:07:22.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70742024-12-19T01:07:22.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70752024-12-19T01:07:22.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70762024-12-19T01:07:22.164ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 789.706413ms iteration = 19 status = {}
70772024-12-19T01:07:22.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6ed3a979-c4d7-4856-b848-a8ca68a21f1c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70782024-12-19T01:07:22.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6ed3a979-c4d7-4856-b848-a8ca68a21f1c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70792024-12-19T01:07:22.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6ed3a979-c4d7-4856-b848-a8ca68a21f1c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70802024-12-19T01:07:22.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = b4ba5ed8-cc39-4472-92ed-fb0489931002 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
70812024-12-19T01:07:22.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = b4ba5ed8-cc39-4472-92ed-fb0489931002 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
70822024-12-19T01:07:22.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = b4ba5ed8-cc39-4472-92ed-fb0489931002 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
70832024-12-19T01:07:23.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c44dbc66-d643-4bd8-9173-76242be9f451 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70842024-12-19T01:07:23.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c44dbc66-d643-4bd8-9173-76242be9f451 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70852024-12-19T01:07:23.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c44dbc66-d643-4bd8-9173-76242be9f451 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70862024-12-19T01:07:24.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d950e1dc-29be-4ff9-b64e-362357e0bc54 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70872024-12-19T01:07:24.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d950e1dc-29be-4ff9-b64e-362357e0bc54 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70882024-12-19T01:07:24.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d950e1dc-29be-4ff9-b64e-362357e0bc54 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70892024-12-19T01:07:25.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1286 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 113d7657-d403-4eca-97bb-922632f02d61 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
70902024-12-19T01:07:25.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = af935579-49a4-4f18-a8c1-b0196fe560a2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70912024-12-19T01:07:25.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = af935579-49a4-4f18-a8c1-b0196fe560a2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70922024-12-19T01:07:25.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = af935579-49a4-4f18-a8c1-b0196fe560a2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70932024-12-19T01:07:26.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 41798bca-a1e4-44c4-8493-a03d250ddca2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70942024-12-19T01:07:26.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 41798bca-a1e4-44c4-8493-a03d250ddca2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70952024-12-19T01:07:26.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 41798bca-a1e4-44c4-8493-a03d250ddca2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70962024-12-19T01:07:27.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3b162d07-8b74-4505-906b-96d7494ee339 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70972024-12-19T01:07:27.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3b162d07-8b74-4505-906b-96d7494ee339 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70982024-12-19T01:07:27.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3b162d07-8b74-4505-906b-96d7494ee339 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
70992024-12-19T01:07:28.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2194acf1-d34b-49db-ae0d-3d32dac0cee8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71002024-12-19T01:07:28.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2194acf1-d34b-49db-ae0d-3d32dac0cee8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71012024-12-19T01:07:28.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2194acf1-d34b-49db-ae0d-3d32dac0cee8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71022024-12-19T01:07:29.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 83ac383f-edaa-4355-ab24-22dfcb8de73d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71032024-12-19T01:07:29.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 83ac383f-edaa-4355-ab24-22dfcb8de73d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71042024-12-19T01:07:29.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 83ac383f-edaa-4355-ab24-22dfcb8de73d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71052024-12-19T01:07:30.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = db98c633-cb4f-4861-9670-5723b42ae1fe roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71062024-12-19T01:07:30.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = db98c633-cb4f-4861-9670-5723b42ae1fe resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71072024-12-19T01:07:30.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = db98c633-cb4f-4861-9670-5723b42ae1fe response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71082024-12-19T01:07:31.374ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
71092024-12-19T01:07:31.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71102024-12-19T01:07:31.374ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
71112024-12-19T01:07:31.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71122024-12-19T01:07:31.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71132024-12-19T01:07:31.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71142024-12-19T01:07:31.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71152024-12-19T01:07:31.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71162024-12-19T01:07:31.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71172024-12-19T01:07:31.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71182024-12-19T01:07:31.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71192024-12-19T01:07:31.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71202024-12-19T01:07:31.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71212024-12-19T01:07:31.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
71222024-12-19T01:07:31.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71232024-12-19T01:07:31.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71242024-12-19T01:07:31.400ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
71252024-12-19T01:07:31.400ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.055734ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
71262024-12-19T01:07:31.409ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71272024-12-19T01:07:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71282024-12-19T01:07:31.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.276791ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71292024-12-19T01:07:31.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f9bdf25b-aa57-4ecb-8685-dd26451793ef roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71302024-12-19T01:07:31.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f9bdf25b-aa57-4ecb-8685-dd26451793ef resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71312024-12-19T01:07:31.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f9bdf25b-aa57-4ecb-8685-dd26451793ef response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71322024-12-19T01:07:33.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6e36cd33-dcd1-4b65-abb6-b36a5b221df2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71332024-12-19T01:07:33.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6e36cd33-dcd1-4b65-abb6-b36a5b221df2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71342024-12-19T01:07:33.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6e36cd33-dcd1-4b65-abb6-b36a5b221df2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71352024-12-19T01:07:34.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 90a850d8-9189-439d-8051-cc8e44263f2b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71362024-12-19T01:07:34.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 90a850d8-9189-439d-8051-cc8e44263f2b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71372024-12-19T01:07:34.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 90a850d8-9189-439d-8051-cc8e44263f2b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71382024-12-19T01:07:35.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f37a13c5-cd40-4b84-a6c3-5b4677336d31 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71392024-12-19T01:07:35.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f37a13c5-cd40-4b84-a6c3-5b4677336d31 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71402024-12-19T01:07:35.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f37a13c5-cd40-4b84-a6c3-5b4677336d31 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71412024-12-19T01:07:35.772ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1585 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 847b4f90-ef17-4808-b4e7-5d61c8731c68 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
71422024-12-19T01:07:36.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3dab9c82-6283-4b86-860f-b270eff69f5b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71432024-12-19T01:07:36.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3dab9c82-6283-4b86-860f-b270eff69f5b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71442024-12-19T01:07:36.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3dab9c82-6283-4b86-860f-b270eff69f5b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71452024-12-19T01:07:37.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d801bb2f-c977-4daa-bac9-90d3a91dfca2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71462024-12-19T01:07:37.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d801bb2f-c977-4daa-bac9-90d3a91dfca2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71472024-12-19T01:07:37.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d801bb2f-c977-4daa-bac9-90d3a91dfca2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71482024-12-19T01:07:38.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 56a3dbe8-11ca-4f42-9ad2-538e87dbf258 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71492024-12-19T01:07:38.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 56a3dbe8-11ca-4f42-9ad2-538e87dbf258 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71502024-12-19T01:07:38.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 56a3dbe8-11ca-4f42-9ad2-538e87dbf258 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71512024-12-19T01:07:39.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8b0d2b21-9390-4cb4-8d63-f90185f25bcc roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71522024-12-19T01:07:39.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8b0d2b21-9390-4cb4-8d63-f90185f25bcc resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71532024-12-19T01:07:39.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8b0d2b21-9390-4cb4-8d63-f90185f25bcc response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71542024-12-19T01:07:40.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9cd87af7-f345-463b-84db-aefd2de3d62b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71552024-12-19T01:07:40.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9cd87af7-f345-463b-84db-aefd2de3d62b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71562024-12-19T01:07:40.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9cd87af7-f345-463b-84db-aefd2de3d62b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71572024-12-19T01:07:41.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 56653ffe-f617-4f7f-af64-af04eb1b33d5 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71582024-12-19T01:07:41.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 56653ffe-f617-4f7f-af64-af04eb1b33d5 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71592024-12-19T01:07:41.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 56653ffe-f617-4f7f-af64-af04eb1b33d5 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71602024-12-19T01:07:41.374ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
71612024-12-19T01:07:41.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71622024-12-19T01:07:41.374ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
71632024-12-19T01:07:41.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71642024-12-19T01:07:41.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71652024-12-19T01:07:41.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71662024-12-19T01:07:41.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71672024-12-19T01:07:41.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71682024-12-19T01:07:41.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71692024-12-19T01:07:41.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71702024-12-19T01:07:41.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71712024-12-19T01:07:41.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71722024-12-19T01:07:41.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71732024-12-19T01:07:41.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71742024-12-19T01:07:41.409ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.257329ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71752024-12-19T01:07:41.409ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71762024-12-19T01:07:41.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
71772024-12-19T01:07:41.412ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71782024-12-19T01:07:41.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71792024-12-19T01:07:41.423ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
71802024-12-19T01:07:41.423ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.123367ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
71812024-12-19T01:07:42.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7c476409-e2ec-44c8-b7a3-df8d7405feaa roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71822024-12-19T01:07:42.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7c476409-e2ec-44c8-b7a3-df8d7405feaa resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71832024-12-19T01:07:42.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7c476409-e2ec-44c8-b7a3-df8d7405feaa response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71842024-12-19T01:07:43.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4269aef8-6085-4eca-97a5-a1d1552bfc82 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71852024-12-19T01:07:43.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4269aef8-6085-4eca-97a5-a1d1552bfc82 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71862024-12-19T01:07:43.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4269aef8-6085-4eca-97a5-a1d1552bfc82 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71872024-12-19T01:07:44.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 65c4c8b7-d500-46d9-b01f-4649b87eade9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71882024-12-19T01:07:44.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 65c4c8b7-d500-46d9-b01f-4649b87eade9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71892024-12-19T01:07:44.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 65c4c8b7-d500-46d9-b01f-4649b87eade9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71902024-12-19T01:07:45.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8975d305-cf3d-4cc7-89bc-46cedb8f1ad8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71912024-12-19T01:07:45.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8975d305-cf3d-4cc7-89bc-46cedb8f1ad8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71922024-12-19T01:07:45.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8975d305-cf3d-4cc7-89bc-46cedb8f1ad8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71932024-12-19T01:07:45.772ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1419 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 375aea0f-d8b7-4af1-b1e5-a29d7b591804 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
71942024-12-19T01:07:46.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f449a5f1-7eb7-4fa4-a558-405d9f1948ca roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71952024-12-19T01:07:46.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f449a5f1-7eb7-4fa4-a558-405d9f1948ca resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71962024-12-19T01:07:46.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f449a5f1-7eb7-4fa4-a558-405d9f1948ca response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71972024-12-19T01:07:47.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 91c95a63-c75c-4f64-b878-780dcef177ab roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71982024-12-19T01:07:47.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 91c95a63-c75c-4f64-b878-780dcef177ab resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
71992024-12-19T01:07:47.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 91c95a63-c75c-4f64-b878-780dcef177ab response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
72002024-12-19T01:07:48.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ee3732fe-cd8f-4fac-84f1-9be40b2b4109 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
72012024-12-19T01:07:48.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ee3732fe-cd8f-4fac-84f1-9be40b2b4109 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
72022024-12-19T01:07:48.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ee3732fe-cd8f-4fac-84f1-9be40b2b4109 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
72032024-12-19T01:07:49.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 11a212ed-9f10-4e01-acc5-228cf2785e17 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
72042024-12-19T01:07:49.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 11a212ed-9f10-4e01-acc5-228cf2785e17 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
72052024-12-19T01:07:49.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 11a212ed-9f10-4e01-acc5-228cf2785e17 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
72062024-12-19T01:07:50.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 20e87475-b80f-4c23-a959-54d42c360c40 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
72072024-12-19T01:07:50.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 20e87475-b80f-4c23-a959-54d42c360c40 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
72082024-12-19T01:07:50.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 20e87475-b80f-4c23-a959-54d42c360c40 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
72092024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
72102024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
72112024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
72122024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
72132024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72142024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72152024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72162024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
72172024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
72182024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
72192024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72202024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
72212024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
72222024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72232024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
72242024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
72252024-12-19T01:07:51.374ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
72262024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72272024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
72282024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72292024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
72302024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
72312024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
72322024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72332024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72342024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
72352024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72362024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
72372024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
72382024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
72392024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72402024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
72412024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72422024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
72432024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72442024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
72452024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72462024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72472024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72482024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72492024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72502024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72512024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72522024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72532024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72542024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
72552024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72562024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72572024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72582024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72592024-12-19T01:07:51.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
72602024-12-19T01:07:51.376ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72612024-12-19T01:07:51.377ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72622024-12-19T01:07:51.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72632024-12-19T01:07:51.378ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.213577ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72642024-12-19T01:07:51.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72652024-12-19T01:07:51.379ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72662024-12-19T01:07:51.380ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72672024-12-19T01:07:51.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72682024-12-19T01:07:51.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72692024-12-19T01:07:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72702024-12-19T01:07:51.381ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72712024-12-19T01:07:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72722024-12-19T01:07:51.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72732024-12-19T01:07:51.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72742024-12-19T01:07:51.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72752024-12-19T01:07:51.383ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72762024-12-19T01:07:51.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72772024-12-19T01:07:51.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72782024-12-19T01:07:51.383ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72792024-12-19T01:07:51.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72802024-12-19T01:07:51.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72812024-12-19T01:07:51.388ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1360, tv_nsec: 232020754 } })
72822024-12-19T01:07:51.389ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1360, tv_nsec: 232202606 } })
72832024-12-19T01:07:51.389ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
72842024-12-19T01:07:51.389ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
72852024-12-19T01:07:51.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72862024-12-19T01:07:51.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72872024-12-19T01:07:51.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72882024-12-19T01:07:51.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72892024-12-19T01:07:51.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72902024-12-19T01:07:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72912024-12-19T01:07:51.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7b5f923a-9afc-4570-8081-e1e3a83db366 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
72922024-12-19T01:07:51.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7b5f923a-9afc-4570-8081-e1e3a83db366 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
72932024-12-19T01:07:51.416ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1360, tv_nsec: 260104316 } })
72942024-12-19T01:07:51.417ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
72952024-12-19T01:07:51.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 15732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7b5f923a-9afc-4570-8081-e1e3a83db366 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
72962024-12-19T01:07:51.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.957653ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
72972024-12-19T01:07:51.439ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72982024-12-19T01:07:51.439ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
72992024-12-19T01:07:51.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73002024-12-19T01:07:51.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73012024-12-19T01:07:51.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73022024-12-19T01:07:51.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73032024-12-19T01:07:51.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73042024-12-19T01:07:51.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73052024-12-19T01:07:51.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73062024-12-19T01:07:51.447ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73072024-12-19T01:07:51.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.401707ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
73082024-12-19T01:07:51.448ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73092024-12-19T01:07:51.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73102024-12-19T01:07:51.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
73112024-12-19T01:07:51.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73122024-12-19T01:07:51.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73132024-12-19T01:07:51.452ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73142024-12-19T01:07:51.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73152024-12-19T01:07:51.452ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73162024-12-19T01:07:51.452ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73172024-12-19T01:07:51.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73182024-12-19T01:07:51.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73192024-12-19T01:07:51.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73202024-12-19T01:07:51.455ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73212024-12-19T01:07:51.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73222024-12-19T01:07:51.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73232024-12-19T01:07:51.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73242024-12-19T01:07:51.462ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 88.765586ms iteration = 23 status = {"physical_disks_added":0}
73252024-12-19T01:07:51.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73262024-12-19T01:07:51.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73272024-12-19T01:07:51.465ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73282024-12-19T01:07:51.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
73292024-12-19T01:07:51.468ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73302024-12-19T01:07:51.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73312024-12-19T01:07:51.475ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
73322024-12-19T01:07:51.475ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 101.541769ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
73332024-12-19T01:07:51.477ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73342024-12-19T01:07:51.477ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 103.154761ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73352024-12-19T01:07:51.488ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.959208ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73362024-12-19T01:07:51.488ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73372024-12-19T01:07:51.488ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
73382024-12-19T01:07:51.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73392024-12-19T01:07:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73402024-12-19T01:07:51.492ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73412024-12-19T01:07:51.493ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
73422024-12-19T01:07:51.493ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73432024-12-19T01:07:51.493ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "edcc6c55-5961-4e5d-b16f-a87c31f68fbe", "content-length": "26", "date": "Thu, 19 Dec 2024 01:07:51 GMT"} })
73442024-12-19T01:07:51.493ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73452024-12-19T01:07:51.497ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73462024-12-19T01:07:51.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
73472024-12-19T01:07:51.497ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73482024-12-19T01:07:51.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73492024-12-19T01:07:51.505ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73502024-12-19T01:07:51.505ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 131.700459ms iteration = 20 status = 0
73512024-12-19T01:07:51.506ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 131.684089ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
73522024-12-19T01:07:51.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73532024-12-19T01:07:51.511ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
73542024-12-19T01:07:51.511ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73552024-12-19T01:07:51.512ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a312bdb5-afc2-4d19-9f68-1b604a183852", "content-length": "26", "date": "Thu, 19 Dec 2024 01:07:51 GMT"} })
73562024-12-19T01:07:51.512ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73572024-12-19T01:07:51.514ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73582024-12-19T01:07:51.514ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 140.221784ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73592024-12-19T01:07:51.523ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73602024-12-19T01:07:51.523ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
73612024-12-19T01:07:51.523ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.884312ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
73622024-12-19T01:07:51.527ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
73632024-12-19T01:07:51.527ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73642024-12-19T01:07:51.527ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2461c52-20a1-4eb2-9ff8-e35bb6219054", "content-length": "26", "date": "Thu, 19 Dec 2024 01:07:51 GMT"} })
73652024-12-19T01:07:51.527ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73662024-12-19T01:07:51.529ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
73672024-12-19T01:07:51.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73682024-12-19T01:07:51.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73692024-12-19T01:07:51.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 167.435514ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
73702024-12-19T01:07:51.605ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
73712024-12-19T01:07:51.605ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2ab30b1-7f09-4759-b78a-cb1b8c56524b", "content-length": "1", "date": "Thu, 19 Dec 2024 01:07:51 GMT"} })
73722024-12-19T01:07:51.607ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73732024-12-19T01:07:51.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73742024-12-19T01:07:51.628ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 253.855157ms iteration = 20 status = {}
73752024-12-19T01:07:51.656ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73762024-12-19T01:07:51.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73772024-12-19T01:07:51.657ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73782024-12-19T01:07:51.657ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73792024-12-19T01:07:51.658ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b2cf86c-718a-4529-aecf-ab1a59a1c007", "content-length": "372", "date": "Thu, 19 Dec 2024 01:07:51 GMT"} })
73802024-12-19T01:07:51.658ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73812024-12-19T01:07:51.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73822024-12-19T01:07:51.659ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 285.652499ms iteration = 20 status = null
73832024-12-19T01:07:51.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73842024-12-19T01:07:51.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73852024-12-19T01:07:51.664ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73862024-12-19T01:07:51.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73872024-12-19T01:07:51.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73882024-12-19T01:07:51.668ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73892024-12-19T01:07:51.668ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73902024-12-19T01:07:51.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73912024-12-19T01:07:51.716ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
73922024-12-19T01:07:51.716ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73932024-12-19T01:07:51.717ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8b562e94-083d-46a8-8e1e-89f6d7b59478", "date": "Thu, 19 Dec 2024 01:07:51 GMT"} })
73942024-12-19T01:07:51.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73952024-12-19T01:07:51.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73962024-12-19T01:07:51.720ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73972024-12-19T01:07:51.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73982024-12-19T01:07:51.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73992024-12-19T01:07:51.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74002024-12-19T01:07:51.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74012024-12-19T01:07:51.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74022024-12-19T01:07:51.727ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
74032024-12-19T01:07:51.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74042024-12-19T01:07:51.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74052024-12-19T01:07:51.729ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74062024-12-19T01:07:51.729ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74072024-12-19T01:07:51.740ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
74082024-12-19T01:07:51.741ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "10beb66c-ba83-4326-810e-9f17a862b21c", "content-length": "134", "date": "Thu, 19 Dec 2024 01:07:51 GMT"} })
74092024-12-19T01:07:51.741ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
74102024-12-19T01:07:51.741ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
74112024-12-19T01:07:51.741ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
74122024-12-19T01:07:51.741ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
74132024-12-19T01:07:51.741ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74142024-12-19T01:07:51.741ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74152024-12-19T01:07:51.741ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74162024-12-19T01:07:51.741ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74172024-12-19T01:07:51.741ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74182024-12-19T01:07:51.741ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74192024-12-19T01:07:51.742ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
74202024-12-19T01:07:51.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74212024-12-19T01:07:51.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74222024-12-19T01:07:51.743ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74232024-12-19T01:07:51.744ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e7b93d6-a1e6-42c1-8db1-516b0c1598eb", "content-length": "2", "date": "Thu, 19 Dec 2024 01:07:51 GMT"} })
74242024-12-19T01:07:51.744ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74252024-12-19T01:07:51.744ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb51127f-9bb0-4ed7-9d53-cf6c2bcbacd4", "content-length": "52", "date": "Thu, 19 Dec 2024 01:07:51 GMT"} })
74262024-12-19T01:07:51.744ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
74272024-12-19T01:07:51.744ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74282024-12-19T01:07:51.791ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
74292024-12-19T01:07:51.866ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7a8bbce9-8521-429f-9717-d3f7ab1a175e", "date": "Thu, 19 Dec 2024 01:07:51 GMT"} })
74302024-12-19T01:07:51.868ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 494.697636ms iteration = 21 status = {}
74312024-12-19T01:07:51.868ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9d47147-4d3d-4a2e-9d92-f12dff7411ab", "content-length": "691", "date": "Thu, 19 Dec 2024 01:07:51 GMT"} })
74322024-12-19T01:07:51.869ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
74332024-12-19T01:07:51.869ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
74342024-12-19T01:07:51.869ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
74352024-12-19T01:07:51.870ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 496.716235ms iteration = 20 status = {}
74362024-12-19T01:07:51.983ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "10fd49bc-49b4-49a8-87c6-2cb8cdb575e2", "date": "Thu, 19 Dec 2024 01:07:51 GMT"} })
74372024-12-19T01:07:51.983ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
74382024-12-19T01:07:51.983ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74392024-12-19T01:07:51.989ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f7e3166-a27e-4294-8320-d13dcfc16394", "content-length": "682", "date": "Thu, 19 Dec 2024 01:07:51 GMT"} })
74402024-12-19T01:07:51.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74412024-12-19T01:07:51.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74422024-12-19T01:07:51.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74432024-12-19T01:07:51.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74442024-12-19T01:07:51.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74452024-12-19T01:07:51.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74462024-12-19T01:07:51.998ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74472024-12-19T01:07:51.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74482024-12-19T01:07:52.006ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 632.542978ms iteration = 20 status = {}
74492024-12-19T01:07:52.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 82fc0c21-339d-4e94-a753-4748451b56f9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74502024-12-19T01:07:52.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 82fc0c21-339d-4e94-a753-4748451b56f9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74512024-12-19T01:07:52.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 82fc0c21-339d-4e94-a753-4748451b56f9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74522024-12-19T01:07:52.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = f0828a5e-75ba-45be-bee5-2c363e906f3d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
74532024-12-19T01:07:52.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = f0828a5e-75ba-45be-bee5-2c363e906f3d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
74542024-12-19T01:07:52.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = f0828a5e-75ba-45be-bee5-2c363e906f3d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
74552024-12-19T01:07:53.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 069b490a-ccc6-4e93-907f-886d46c63106 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74562024-12-19T01:07:53.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 069b490a-ccc6-4e93-907f-886d46c63106 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74572024-12-19T01:07:53.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 069b490a-ccc6-4e93-907f-886d46c63106 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74582024-12-19T01:07:54.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = aceb182f-7a38-47cc-8ab6-f5aad6ebd362 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74592024-12-19T01:07:54.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = aceb182f-7a38-47cc-8ab6-f5aad6ebd362 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74602024-12-19T01:07:54.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = aceb182f-7a38-47cc-8ab6-f5aad6ebd362 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74612024-12-19T01:07:55.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dcfabd74-76da-4d06-b770-b7ae0b3be52f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74622024-12-19T01:07:55.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dcfabd74-76da-4d06-b770-b7ae0b3be52f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74632024-12-19T01:07:55.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dcfabd74-76da-4d06-b770-b7ae0b3be52f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74642024-12-19T01:07:55.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1396 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 31a70d26-456d-4c9c-939e-123289f126e6 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
74652024-12-19T01:07:56.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7ee735cd-a8e2-4c64-8e2f-eb194e7ff2f6 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74662024-12-19T01:07:56.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7ee735cd-a8e2-4c64-8e2f-eb194e7ff2f6 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74672024-12-19T01:07:56.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7ee735cd-a8e2-4c64-8e2f-eb194e7ff2f6 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74682024-12-19T01:07:57.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b41437d0-ee55-4666-a5fc-e6346c74ff0f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74692024-12-19T01:07:57.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b41437d0-ee55-4666-a5fc-e6346c74ff0f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74702024-12-19T01:07:57.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b41437d0-ee55-4666-a5fc-e6346c74ff0f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74712024-12-19T01:07:58.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0070aa72-1ed8-482c-a970-46df8a46b0cc roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74722024-12-19T01:07:58.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0070aa72-1ed8-482c-a970-46df8a46b0cc resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74732024-12-19T01:07:58.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0070aa72-1ed8-482c-a970-46df8a46b0cc response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74742024-12-19T01:07:59.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b67310a0-b7e7-4af2-ae85-f3778ee3124f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74752024-12-19T01:07:59.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b67310a0-b7e7-4af2-ae85-f3778ee3124f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74762024-12-19T01:07:59.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b67310a0-b7e7-4af2-ae85-f3778ee3124f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74772024-12-19T01:08:00.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c65b010d-b690-405b-85a4-0e6cf2596229 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74782024-12-19T01:08:00.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c65b010d-b690-405b-85a4-0e6cf2596229 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74792024-12-19T01:08:00.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c65b010d-b690-405b-85a4-0e6cf2596229 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
74802024-12-19T01:08:01.374ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
74812024-12-19T01:08:01.374ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
74822024-12-19T01:08:01.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74832024-12-19T01:08:01.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74842024-12-19T01:08:01.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74852024-12-19T01:08:01.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74862024-12-19T01:08:01.376ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74872024-12-19T01:08:01.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74882024-12-19T01:08:01.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74892024-12-19T01:08:01.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74902024-12-19T01:08:01.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74912024-12-19T01:08:01.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74922024-12-19T01:08:01.410ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74932024-12-19T01:08:01.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74942024-12-19T01:08:01.412ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74952024-12-19T01:08:01.414ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.905422ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74962024-12-19T01:08:01.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
74972024-12-19T01:08:01.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74982024-12-19T01:08:01.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74992024-12-19T01:08:01.425ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
75002024-12-19T01:08:01.425ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.108445ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
75012024-12-19T01:08:01.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 33c036d3-2d3a-4ae4-9101-50f1471c550f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75022024-12-19T01:08:01.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 33c036d3-2d3a-4ae4-9101-50f1471c550f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75032024-12-19T01:08:01.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 33c036d3-2d3a-4ae4-9101-50f1471c550f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75042024-12-19T01:08:02.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a2884e07-a5db-47ab-abba-3bfa67ccdd8f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75052024-12-19T01:08:02.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a2884e07-a5db-47ab-abba-3bfa67ccdd8f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75062024-12-19T01:08:02.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a2884e07-a5db-47ab-abba-3bfa67ccdd8f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75072024-12-19T01:08:03.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b4fa309c-c162-473b-bf36-c8fa834123c7 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75082024-12-19T01:08:03.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b4fa309c-c162-473b-bf36-c8fa834123c7 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75092024-12-19T01:08:03.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b4fa309c-c162-473b-bf36-c8fa834123c7 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75102024-12-19T01:08:04.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 09a82f18-8356-4f12-b6e0-db71e8f7116e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75112024-12-19T01:08:04.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 09a82f18-8356-4f12-b6e0-db71e8f7116e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75122024-12-19T01:08:04.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 09a82f18-8356-4f12-b6e0-db71e8f7116e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75132024-12-19T01:08:05.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e27762d8-0a04-449c-8459-0037de6f0c7c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75142024-12-19T01:08:05.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e27762d8-0a04-449c-8459-0037de6f0c7c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75152024-12-19T01:08:05.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e27762d8-0a04-449c-8459-0037de6f0c7c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75162024-12-19T01:08:05.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1303 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = ec2b50ee-5e6c-427b-95ea-562ad9ff7bfe response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
75172024-12-19T01:08:06.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 982f0ace-7f8b-4eb7-b388-a4afa2c28dbf roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75182024-12-19T01:08:06.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 982f0ace-7f8b-4eb7-b388-a4afa2c28dbf resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75192024-12-19T01:08:06.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 982f0ace-7f8b-4eb7-b388-a4afa2c28dbf response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75202024-12-19T01:08:07.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ec8cf52e-3441-443d-8488-a6e3f10466d6 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75212024-12-19T01:08:07.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ec8cf52e-3441-443d-8488-a6e3f10466d6 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75222024-12-19T01:08:07.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ec8cf52e-3441-443d-8488-a6e3f10466d6 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75232024-12-19T01:08:08.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3d0f7b67-41bf-41d6-82e9-0eb8e09832d1 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75242024-12-19T01:08:08.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3d0f7b67-41bf-41d6-82e9-0eb8e09832d1 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75252024-12-19T01:08:08.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3d0f7b67-41bf-41d6-82e9-0eb8e09832d1 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75262024-12-19T01:08:09.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 727c7315-88e6-4f96-be69-34a632a77222 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75272024-12-19T01:08:09.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 727c7315-88e6-4f96-be69-34a632a77222 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75282024-12-19T01:08:09.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 727c7315-88e6-4f96-be69-34a632a77222 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75292024-12-19T01:08:10.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 37b4816c-0254-4b86-aeb4-727be4b7a23c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75302024-12-19T01:08:10.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 37b4816c-0254-4b86-aeb4-727be4b7a23c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75312024-12-19T01:08:10.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 37b4816c-0254-4b86-aeb4-727be4b7a23c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75322024-12-19T01:08:11.374ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
75332024-12-19T01:08:11.374ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
75342024-12-19T01:08:11.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75352024-12-19T01:08:11.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75362024-12-19T01:08:11.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75372024-12-19T01:08:11.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75382024-12-19T01:08:11.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75392024-12-19T01:08:11.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75402024-12-19T01:08:11.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75412024-12-19T01:08:11.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75422024-12-19T01:08:11.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75432024-12-19T01:08:11.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75442024-12-19T01:08:11.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75452024-12-19T01:08:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
75462024-12-19T01:08:11.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75472024-12-19T01:08:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75482024-12-19T01:08:11.393ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
75492024-12-19T01:08:11.393ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.601203ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
75502024-12-19T01:08:11.405ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75512024-12-19T01:08:11.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75522024-12-19T01:08:11.434ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.594249ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75532024-12-19T01:08:11.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5d0e927e-2b54-41ee-8a05-d28f20d183e2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75542024-12-19T01:08:11.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5d0e927e-2b54-41ee-8a05-d28f20d183e2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75552024-12-19T01:08:11.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5d0e927e-2b54-41ee-8a05-d28f20d183e2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75562024-12-19T01:08:12.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c8731638-0dc9-4774-8212-fa81edaf41b8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75572024-12-19T01:08:12.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c8731638-0dc9-4774-8212-fa81edaf41b8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75582024-12-19T01:08:12.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c8731638-0dc9-4774-8212-fa81edaf41b8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75592024-12-19T01:08:13.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 29f33790-99d5-44f5-8f6d-894613f03d16 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75602024-12-19T01:08:13.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 29f33790-99d5-44f5-8f6d-894613f03d16 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75612024-12-19T01:08:13.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 29f33790-99d5-44f5-8f6d-894613f03d16 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75622024-12-19T01:08:14.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ae91582b-b9ec-4b30-a66a-1a434671e41d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75632024-12-19T01:08:14.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ae91582b-b9ec-4b30-a66a-1a434671e41d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75642024-12-19T01:08:14.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ae91582b-b9ec-4b30-a66a-1a434671e41d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75652024-12-19T01:08:15.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1341 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = fcc35076-f0d4-4ae4-8a4d-9e7fc5a91e1e response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
75662024-12-19T01:08:15.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d1b23e9f-0126-4e8d-9a2f-feae872c2f8d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75672024-12-19T01:08:15.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d1b23e9f-0126-4e8d-9a2f-feae872c2f8d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75682024-12-19T01:08:15.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d1b23e9f-0126-4e8d-9a2f-feae872c2f8d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75692024-12-19T01:08:16.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bad60420-13e9-40a5-b82f-22034b24cbd1 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75702024-12-19T01:08:16.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bad60420-13e9-40a5-b82f-22034b24cbd1 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75712024-12-19T01:08:16.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bad60420-13e9-40a5-b82f-22034b24cbd1 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75722024-12-19T01:08:17.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0a02889e-f6a1-41d2-841b-633d2157a024 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75732024-12-19T01:08:17.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0a02889e-f6a1-41d2-841b-633d2157a024 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75742024-12-19T01:08:17.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0a02889e-f6a1-41d2-841b-633d2157a024 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75752024-12-19T01:08:19.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f02f97b8-a029-48da-9a2d-5bc5a871e29e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75762024-12-19T01:08:19.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f02f97b8-a029-48da-9a2d-5bc5a871e29e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75772024-12-19T01:08:19.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f02f97b8-a029-48da-9a2d-5bc5a871e29e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75782024-12-19T01:08:20.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 45cedf3c-231e-4496-90b4-ccc9110ed1c4 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75792024-12-19T01:08:20.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 45cedf3c-231e-4496-90b4-ccc9110ed1c4 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75802024-12-19T01:08:20.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 45cedf3c-231e-4496-90b4-ccc9110ed1c4 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75812024-12-19T01:08:21.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c8ec10a4-67f3-449f-8647-0a508d383bd0 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75822024-12-19T01:08:21.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c8ec10a4-67f3-449f-8647-0a508d383bd0 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75832024-12-19T01:08:21.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c8ec10a4-67f3-449f-8647-0a508d383bd0 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
75842024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
75852024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
75862024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
75872024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
75882024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75892024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75902024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
75912024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
75922024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
75932024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
75942024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
75952024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
75962024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
75972024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75982024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75992024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
76002024-12-19T01:08:21.374ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
76012024-12-19T01:08:21.374ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
76022024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
76032024-12-19T01:08:21.374ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 00:58:21.374760601 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
76042024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
76052024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
76062024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
76072024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76082024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
76092024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
76102024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76112024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
76122024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76132024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
76142024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
76152024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76162024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76172024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
76182024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
76192024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
76202024-12-19T01:08:21.374ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
76212024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76222024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
76232024-12-19T01:08:21.374ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
76242024-12-19T01:08:21.374ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76252024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
76262024-12-19T01:08:21.375ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a
76272024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
76282024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.19\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a"}
76292024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
76302024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76312024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
76322024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
76332024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76342024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
76352024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76362024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
76372024-12-19T01:08:21.375ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
76382024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
76392024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76402024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
76412024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
76422024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
76432024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76442024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76452024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
76462024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
76472024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76482024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76492024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
76502024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
76512024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76522024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76532024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
76542024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
76552024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76562024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76572024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
76582024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76592024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
76602024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76612024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76622024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
76632024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
76642024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
76652024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76662024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76672024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76682024-12-19T01:08:21.375ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
76692024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76702024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76712024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76722024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76732024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76742024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76752024-12-19T01:08:21.375ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a880a2e-2471-4fd8-9ad5-3e0c3fbde317.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1390, tv_nsec: 218630999 } })
76762024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76772024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76782024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76792024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76802024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76812024-12-19T01:08:21.375ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0018a454-75c0-41b1-be69-9476391f01e1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("050cdbd7-4ebc-471c-b4dc-ec1b3741f763.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1390, tv_nsec: 218689130 } })
76822024-12-19T01:08:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76832024-12-19T01:08:21.376ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
76842024-12-19T01:08:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.013604ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
76852024-12-19T01:08:21.376ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
76862024-12-19T01:08:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.119405ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
76872024-12-19T01:08:21.377ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76882024-12-19T01:08:21.378ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.67353ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
76892024-12-19T01:08:21.378ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.942023ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
76902024-12-19T01:08:21.379ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
76912024-12-19T01:08:21.379ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
76922024-12-19T01:08:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
76932024-12-19T01:08:21.382ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1390, tv_nsec: 225606484 } })
76942024-12-19T01:08:21.382ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76952024-12-19T01:08:21.382ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
76962024-12-19T01:08:21.383ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 00:58:21.374760601 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
76972024-12-19T01:08:21.383ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.701188ms iteration = 11 status = {"expiration":"2024-12-19T00:58:21.374760601Z","pruned":[]}
76982024-12-19T01:08:21.384ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1390, tv_nsec: 227840144 } })
76992024-12-19T01:08:21.385ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
77002024-12-19T01:08:21.385ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77012024-12-19T01:08:21.385ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77022024-12-19T01:08:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77032024-12-19T01:08:21.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77042024-12-19T01:08:21.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77052024-12-19T01:08:21.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77062024-12-19T01:08:21.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77072024-12-19T01:08:21.400ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77082024-12-19T01:08:21.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77092024-12-19T01:08:21.404ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77102024-12-19T01:08:21.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77112024-12-19T01:08:21.408ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77122024-12-19T01:08:21.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77132024-12-19T01:08:21.434ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(1e0da6b1-c415-4171-ba0c-ef26e9e728fe, 0), (ccfdeb32-1708-4921-95ee-f213ceb107b4, 0), (19fc81a2-6175-4335-bc25-54a2d29172fe, 0), (d7e66fd1-ed2e-4b67-aa27-4897ce3c2f3c, 0)] collection_id = 1e0da6b1-c415-4171-ba0c-ef26e9e728fe
77142024-12-19T01:08:21.434ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
77152024-12-19T01:08:21.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
77162024-12-19T01:08:21.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77172024-12-19T01:08:21.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77182024-12-19T01:08:21.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77192024-12-19T01:08:21.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77202024-12-19T01:08:21.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77212024-12-19T01:08:21.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77222024-12-19T01:08:21.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77232024-12-19T01:08:21.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77242024-12-19T01:08:21.444ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77252024-12-19T01:08:21.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77262024-12-19T01:08:21.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.281718ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
77272024-12-19T01:08:21.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77282024-12-19T01:08:21.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
77292024-12-19T01:08:21.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77302024-12-19T01:08:21.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77312024-12-19T01:08:21.456ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77322024-12-19T01:08:21.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77332024-12-19T01:08:21.458ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 84.328635ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77342024-12-19T01:08:21.461ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
77352024-12-19T01:08:21.462ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
77362024-12-19T01:08:21.462ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 87.108783ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
77372024-12-19T01:08:21.463ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 89.023569ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
77382024-12-19T01:08:21.468ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77392024-12-19T01:08:21.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77402024-12-19T01:08:21.469ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77412024-12-19T01:08:21.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77422024-12-19T01:08:21.470ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77432024-12-19T01:08:21.472ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77442024-12-19T01:08:21.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77452024-12-19T01:08:21.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77462024-12-19T01:08:21.473ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77472024-12-19T01:08:21.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77482024-12-19T01:08:21.478ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77492024-12-19T01:08:21.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77502024-12-19T01:08:21.483ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77512024-12-19T01:08:21.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77522024-12-19T01:08:21.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77532024-12-19T01:08:21.486ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77542024-12-19T01:08:21.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
77552024-12-19T01:08:21.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77562024-12-19T01:08:21.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77572024-12-19T01:08:21.487ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77582024-12-19T01:08:21.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77592024-12-19T01:08:21.488ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77602024-12-19T01:08:21.488ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77612024-12-19T01:08:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77622024-12-19T01:08:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77632024-12-19T01:08:21.491ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77642024-12-19T01:08:21.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77652024-12-19T01:08:21.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77662024-12-19T01:08:21.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77672024-12-19T01:08:21.494ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77682024-12-19T01:08:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77692024-12-19T01:08:21.494ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
77702024-12-19T01:08:21.494ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77712024-12-19T01:08:21.494ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77722024-12-19T01:08:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77732024-12-19T01:08:21.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77742024-12-19T01:08:21.496ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1390, tv_nsec: 339416380 } })
77752024-12-19T01:08:21.496ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
77762024-12-19T01:08:21.497ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77772024-12-19T01:08:21.497ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77782024-12-19T01:08:21.497ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77792024-12-19T01:08:21.497ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77802024-12-19T01:08:21.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77812024-12-19T01:08:21.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77822024-12-19T01:08:21.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77832024-12-19T01:08:21.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
77842024-12-19T01:08:21.499ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
77852024-12-19T01:08:21.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
77862024-12-19T01:08:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77872024-12-19T01:08:21.500ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77882024-12-19T01:08:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77892024-12-19T01:08:21.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
77902024-12-19T01:08:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
77912024-12-19T01:08:21.504ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77922024-12-19T01:08:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
77932024-12-19T01:08:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77942024-12-19T01:08:21.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77952024-12-19T01:08:21.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77962024-12-19T01:08:21.507ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
77972024-12-19T01:08:21.507ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 132.864973ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
77982024-12-19T01:08:21.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77992024-12-19T01:08:21.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78002024-12-19T01:08:21.511ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 1e0da6b1-c415-4171-ba0c-ef26e9e728fe file = nexus/db-queries/src/db/datastore/inventory.rs:1452 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
78012024-12-19T01:08:21.511ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
78022024-12-19T01:08:21.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
78032024-12-19T01:08:21.512ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78042024-12-19T01:08:21.512ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78052024-12-19T01:08:21.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78062024-12-19T01:08:21.514ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78072024-12-19T01:08:21.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78082024-12-19T01:08:21.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
78092024-12-19T01:08:21.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78102024-12-19T01:08:21.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78112024-12-19T01:08:21.518ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(ccfdeb32-1708-4921-95ee-f213ceb107b4, 0), (19fc81a2-6175-4335-bc25-54a2d29172fe, 0), (d7e66fd1-ed2e-4b67-aa27-4897ce3c2f3c, 0)]
78122024-12-19T01:08:21.518ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78132024-12-19T01:08:21.519ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1390, tv_nsec: 362158438 } })
78142024-12-19T01:08:21.519ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78152024-12-19T01:08:21.519ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 144.594693ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
78162024-12-19T01:08:21.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78172024-12-19T01:08:21.519ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78182024-12-19T01:08:21.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78192024-12-19T01:08:21.521ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
78202024-12-19T01:08:21.522ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78212024-12-19T01:08:21.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
78222024-12-19T01:08:21.523ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78232024-12-19T01:08:21.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78242024-12-19T01:08:21.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
78252024-12-19T01:08:21.528ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78262024-12-19T01:08:21.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78272024-12-19T01:08:21.530ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78282024-12-19T01:08:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78292024-12-19T01:08:21.542ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78302024-12-19T01:08:21.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78312024-12-19T01:08:21.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78322024-12-19T01:08:21.545ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78332024-12-19T01:08:21.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78342024-12-19T01:08:21.546ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
78352024-12-19T01:08:21.546ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 171.770273ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
78362024-12-19T01:08:21.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
78372024-12-19T01:08:21.547ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78382024-12-19T01:08:21.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78392024-12-19T01:08:21.552ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 177.716964ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78402024-12-19T01:08:21.553ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 178.337022ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
78412024-12-19T01:08:21.554ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
78422024-12-19T01:08:21.554ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 54ab3fad-99ef-4246-84f7-615e8e7947a4
78432024-12-19T01:08:21.554ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = fbf42f83-e906-477b-a9e9-1fba30fb233c
78442024-12-19T01:08:21.554ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78452024-12-19T01:08:21.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78462024-12-19T01:08:21.558ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 183.891557ms iteration = 21 status = 0
78472024-12-19T01:08:21.558ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = b258af3a-62fb-414a-b636-4579e47513b8
78482024-12-19T01:08:21.558ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 54ab3fad-99ef-4246-84f7-615e8e7947a4
78492024-12-19T01:08:21.558ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = b258af3a-62fb-414a-b636-4579e47513b8
78502024-12-19T01:08:21.558ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = fbf42f83-e906-477b-a9e9-1fba30fb233c
78512024-12-19T01:08:21.558ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 184.052179ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
78522024-12-19T01:08:21.559ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78532024-12-19T01:08:21.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78542024-12-19T01:08:21.561ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78552024-12-19T01:08:21.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78562024-12-19T01:08:21.565ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
78572024-12-19T01:08:21.567ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
78582024-12-19T01:08:21.567ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
78592024-12-19T01:08:21.567ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
78602024-12-19T01:08:21.567ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78612024-12-19T01:08:21.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78622024-12-19T01:08:21.571ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78632024-12-19T01:08:21.573ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78642024-12-19T01:08:21.573ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
78652024-12-19T01:08:21.573ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 198.129601ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
78662024-12-19T01:08:21.573ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
78672024-12-19T01:08:21.573ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
78682024-12-19T01:08:21.573ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
78692024-12-19T01:08:21.573ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78702024-12-19T01:08:21.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78712024-12-19T01:08:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
78722024-12-19T01:08:21.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78732024-12-19T01:08:21.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78742024-12-19T01:08:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78752024-12-19T01:08:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
78762024-12-19T01:08:21.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78772024-12-19T01:08:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78782024-12-19T01:08:21.585ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
78792024-12-19T01:08:21.585ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
78802024-12-19T01:08:21.585ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 210.611869ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
78812024-12-19T01:08:21.597ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78822024-12-19T01:08:21.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78832024-12-19T01:08:21.611ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78842024-12-19T01:08:21.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78852024-12-19T01:08:21.614ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78862024-12-19T01:08:21.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78872024-12-19T01:08:21.632ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78882024-12-19T01:08:21.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78892024-12-19T01:08:21.646ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
78902024-12-19T01:08:21.646ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 0 version = 2
78912024-12-19T01:08:21.646ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
78922024-12-19T01:08:21.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
78932024-12-19T01:08:21.649ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78942024-12-19T01:08:21.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78952024-12-19T01:08:21.654ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
78962024-12-19T01:08:21.654ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
78972024-12-19T01:08:21.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
78982024-12-19T01:08:21.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
78992024-12-19T01:08:21.662ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
79002024-12-19T01:08:21.662ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79012024-12-19T01:08:21.662ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d1851ce-aeee-4bba-a0d1-96b21538d39f", "content-length": "26", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79022024-12-19T01:08:21.662ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79032024-12-19T01:08:21.671ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
79042024-12-19T01:08:21.672ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
79052024-12-19T01:08:21.672ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
79062024-12-19T01:08:21.672ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
79072024-12-19T01:08:21.673ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "014bbd91-3f39-4fae-8c17-0ffadd36dc77", "content-length": "476", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79082024-12-19T01:08:21.673ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
79092024-12-19T01:08:21.673ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8353f1c7-168f-4d00-a66b-415399edc571", "content-length": "734", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79102024-12-19T01:08:21.674ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
79112024-12-19T01:08:21.674ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7c378cf-6870-4ef3-9cfd-1e601899e7d8", "content-length": "111", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79122024-12-19T01:08:21.674ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
79132024-12-19T01:08:21.675ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8a698f8-20fc-45fb-92df-fb7432044bec", "content-length": "111", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79142024-12-19T01:08:21.675ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
79152024-12-19T01:08:21.675ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "610bda51-6f0b-4321-a739-436d191aa576", "content-length": "167", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79162024-12-19T01:08:21.675ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
79172024-12-19T01:08:21.676ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9df1ebbc-5d80-440e-8fcb-7da5d56455e4", "content-length": "167", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79182024-12-19T01:08:21.677ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
79192024-12-19T01:08:21.677ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "468c7249-f6ce-4801-862c-49a9325c6e03", "content-length": "175", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79202024-12-19T01:08:21.677ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
79212024-12-19T01:08:21.678ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5e6a17d-e3af-4295-937e-7dd50cd65e00", "content-length": "175", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79222024-12-19T01:08:21.678ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
79232024-12-19T01:08:21.678ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f74ec2e-57d0-4bdf-806c-507c9c73e7bc", "content-length": "702", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79242024-12-19T01:08:21.679ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
79252024-12-19T01:08:21.679ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e06e57bb-d8d3-4329-a3d4-63d88dab2314", "content-length": "727", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79262024-12-19T01:08:21.679ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
79272024-12-19T01:08:21.679ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7beed35-4eb1-4010-858f-a46eb94bce98", "content-length": "729", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79282024-12-19T01:08:21.679ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
79292024-12-19T01:08:21.679ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b229f37a-b2ae-46a3-935a-4ba6878b31a0", "content-length": "728", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79302024-12-19T01:08:21.679ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
79312024-12-19T01:08:21.681ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4b0848d-4814-4df3-8771-162611eb3934", "content-length": "722", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79322024-12-19T01:08:21.681ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
79332024-12-19T01:08:21.681ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9439d3e8-657a-40fa-a557-eecc44d5a5bf", "content-length": "109", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79342024-12-19T01:08:21.681ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
79352024-12-19T01:08:21.682ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d87129d-0690-4847-997c-8f1fbc6b11cd", "content-length": "109", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79362024-12-19T01:08:21.682ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
79372024-12-19T01:08:21.682ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f39c9e0b-3f52-4539-b55d-bec0502fd297", "content-length": "169", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79382024-12-19T01:08:21.682ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
79392024-12-19T01:08:21.683ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79402024-12-19T01:08:21.683ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79412024-12-19T01:08:21.683ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c78c293d-6bb3-440d-9614-8df36cc1778e", "content-length": "169", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79422024-12-19T01:08:21.683ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
79432024-12-19T01:08:21.683ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "28062ec4-6df7-4c96-b9b8-9352b7b0d806", "content-length": "178", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79442024-12-19T01:08:21.683ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
79452024-12-19T01:08:21.684ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa770239-dff7-4dba-85e3-cacf5662ec56", "content-length": "26", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79462024-12-19T01:08:21.684ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79472024-12-19T01:08:21.684ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdd98134-23ab-4bb1-9dbd-b40bc0fc227e", "content-length": "178", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79482024-12-19T01:08:21.684ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
79492024-12-19T01:08:21.684ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6c6ce81-31cd-45a1-bccd-ce15ca261641", "content-length": "702", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79502024-12-19T01:08:21.684ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
79512024-12-19T01:08:21.684ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "75ad4b68-0b10-48de-82cb-92eb950cfb32", "content-length": "727", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79522024-12-19T01:08:21.684ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
79532024-12-19T01:08:21.685ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7f86199-d6fc-4553-b6b0-3129b4e51f55", "content-length": "729", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79542024-12-19T01:08:21.685ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
79552024-12-19T01:08:21.685ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7871c6a7-4eeb-4ab4-9b1b-481ed0a49598", "content-length": "728", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79562024-12-19T01:08:21.685ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
79572024-12-19T01:08:21.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
79582024-12-19T01:08:21.687ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79592024-12-19T01:08:21.699ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T00:58:19.687181Z, time_modified: 2024-12-19T00:58:19.687181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }) }
79602024-12-19T01:08:21.699ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 324.620728ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]}},"default_endpoint":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
79612024-12-19T01:08:21.710ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
79622024-12-19T01:08:21.710ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 335.346994ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
79632024-12-19T01:08:21.719ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79642024-12-19T01:08:21.719ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79652024-12-19T01:08:21.719ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "693d107c-5236-41bf-9291-5182d24975cf", "content-length": "26", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79662024-12-19T01:08:21.719ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79672024-12-19T01:08:21.722ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79682024-12-19T01:08:21.731ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 356.46782ms iteration = 24 status = {"physical_disks_added":0}
79692024-12-19T01:08:21.795ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
79702024-12-19T01:08:21.808ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
79712024-12-19T01:08:21.809ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8a7f80fa-0c26-4a34-988b-5d8f2119f974", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79722024-12-19T01:08:21.809ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79732024-12-19T01:08:21.809ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
79742024-12-19T01:08:21.809ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79752024-12-19T01:08:21.809ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d53f048d-724d-433d-bd65-d37934634c91", "content-length": "372", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
79762024-12-19T01:08:21.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79772024-12-19T01:08:21.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79782024-12-19T01:08:21.810ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f9af4d99-40f4-4ecf-9644-ac21de75439c", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79792024-12-19T01:08:21.810ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79802024-12-19T01:08:21.812ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79812024-12-19T01:08:21.812ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79822024-12-19T01:08:21.813ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
79832024-12-19T01:08:21.813ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 438.093648ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
79842024-12-19T01:08:21.813ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79852024-12-19T01:08:21.815ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
79862024-12-19T01:08:21.815ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
79872024-12-19T01:08:21.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
79882024-12-19T01:08:21.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
79892024-12-19T01:08:21.816ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79902024-12-19T01:08:21.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79912024-12-19T01:08:21.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
79922024-12-19T01:08:21.816ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79932024-12-19T01:08:21.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79942024-12-19T01:08:21.818ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79952024-12-19T01:08:21.819ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 1 version = 2
79962024-12-19T01:08:21.819ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
79972024-12-19T01:08:21.819ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 00:59:02.707744 UTC dns_group = external generation = 2
79982024-12-19T01:08:21.819ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 444.609057ms iteration = 12 status = {"generation":2}
79992024-12-19T01:08:21.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
80002024-12-19T01:08:21.823ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
80012024-12-19T01:08:21.823ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
80022024-12-19T01:08:21.823ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
80032024-12-19T01:08:21.823ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 00:59:01.994004 UTC dns_group = internal generation = 1
80042024-12-19T01:08:21.823ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 448.584181ms iteration = 12 status = {"generation":1}
80052024-12-19T01:08:21.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
80062024-12-19T01:08:21.858ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80072024-12-19T01:08:21.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80082024-12-19T01:08:21.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80092024-12-19T01:08:21.861ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80102024-12-19T01:08:21.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
80112024-12-19T01:08:21.863ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80122024-12-19T01:08:21.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80132024-12-19T01:08:21.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80142024-12-19T01:08:21.863ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80152024-12-19T01:08:21.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80162024-12-19T01:08:21.865ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80172024-12-19T01:08:21.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80182024-12-19T01:08:21.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80192024-12-19T01:08:21.868ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80202024-12-19T01:08:21.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80212024-12-19T01:08:21.869ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80222024-12-19T01:08:21.869ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80232024-12-19T01:08:21.869ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
80242024-12-19T01:08:21.869ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80252024-12-19T01:08:21.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80262024-12-19T01:08:21.869ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "23295367-8762-4b4d-8462-5d7e046b094f", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
80272024-12-19T01:08:21.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80282024-12-19T01:08:21.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80292024-12-19T01:08:21.880ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80302024-12-19T01:08:21.881ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5baea603-ed01-4523-ad94-5f4d35980ae3", "content-length": "1", "date": "Thu, 19 Dec 2024 01:08:20 GMT"} })
80312024-12-19T01:08:21.884ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80322024-12-19T01:08:21.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80332024-12-19T01:08:21.947ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
80342024-12-19T01:08:21.948ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1ed92f30-9f59-4510-8e36-af2de6424c03", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80352024-12-19T01:08:21.948ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80362024-12-19T01:08:21.950ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b384a130-f61d-45ee-8cdf-e15468167c3e", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80372024-12-19T01:08:21.950ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80382024-12-19T01:08:21.952ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d23fa96e-3266-42c2-9788-b875584b2453", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80392024-12-19T01:08:21.952ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80402024-12-19T01:08:21.955ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
80412024-12-19T01:08:21.955ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 580.965808ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
80422024-12-19T01:08:21.958ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 583.965489ms iteration = 21 status = {}
80432024-12-19T01:08:21.976ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
80442024-12-19T01:08:21.977ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
80452024-12-19T01:08:21.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80462024-12-19T01:08:21.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80472024-12-19T01:08:21.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80482024-12-19T01:08:21.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80492024-12-19T01:08:21.981ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 606.410133ms iteration = 21 status = null
80502024-12-19T01:08:21.983ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80512024-12-19T01:08:21.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80522024-12-19T01:08:21.988ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80532024-12-19T01:08:21.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80542024-12-19T01:08:22.023ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
80552024-12-19T01:08:22.023ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cfd61f8-6dcd-421d-a26b-fbfad4592369", "content-length": "691", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
80562024-12-19T01:08:22.023ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
80572024-12-19T01:08:22.023ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
80582024-12-19T01:08:22.023ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
80592024-12-19T01:08:22.024ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 650.065986ms iteration = 21 status = {}
80602024-12-19T01:08:22.024ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80612024-12-19T01:08:22.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80622024-12-19T01:08:22.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80632024-12-19T01:08:22.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80642024-12-19T01:08:22.027ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80652024-12-19T01:08:22.027ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80662024-12-19T01:08:22.028ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80672024-12-19T01:08:22.031ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d604684f-1bce-4d09-a3c2-4101a8ebd446", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
80682024-12-19T01:08:22.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
80692024-12-19T01:08:22.032ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80702024-12-19T01:08:22.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80712024-12-19T01:08:22.032ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 658.075555ms iteration = 22 status = {}
80722024-12-19T01:08:22.034ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80732024-12-19T01:08:22.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80742024-12-19T01:08:22.036ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80752024-12-19T01:08:22.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80762024-12-19T01:08:22.038ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80772024-12-19T01:08:22.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
80782024-12-19T01:08:22.042ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80792024-12-19T01:08:22.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80802024-12-19T01:08:22.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80812024-12-19T01:08:22.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80822024-12-19T01:08:22.046ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80832024-12-19T01:08:22.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80842024-12-19T01:08:22.048ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
80852024-12-19T01:08:22.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80862024-12-19T01:08:22.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80872024-12-19T01:08:22.048ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80882024-12-19T01:08:22.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80892024-12-19T01:08:22.051ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80902024-12-19T01:08:22.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80912024-12-19T01:08:22.052ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80922024-12-19T01:08:22.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80932024-12-19T01:08:22.055ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80942024-12-19T01:08:22.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80952024-12-19T01:08:22.057ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80962024-12-19T01:08:22.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80972024-12-19T01:08:22.058ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
80982024-12-19T01:08:22.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
80992024-12-19T01:08:22.059ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81002024-12-19T01:08:22.059ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7138e34e-adb1-4954-b868-1f01bacf15af", "content-length": "134", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
81012024-12-19T01:08:22.059ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
81022024-12-19T01:08:22.059ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
81032024-12-19T01:08:22.059ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
81042024-12-19T01:08:22.059ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81052024-12-19T01:08:22.059ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81062024-12-19T01:08:22.059ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81072024-12-19T01:08:22.059ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81082024-12-19T01:08:22.059ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81092024-12-19T01:08:22.060ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81102024-12-19T01:08:22.060ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81112024-12-19T01:08:22.060ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
81122024-12-19T01:08:22.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81132024-12-19T01:08:22.060ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81142024-12-19T01:08:22.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81152024-12-19T01:08:22.062ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81162024-12-19T01:08:22.062ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ee8e771-f0ae-4546-ac28-3cc81ca959c1", "content-length": "2", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
81172024-12-19T01:08:22.062ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81182024-12-19T01:08:22.063ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "eaa3dfe2-ab09-4941-8d9f-0342560f633b", "content-length": "52", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
81192024-12-19T01:08:22.063ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
81202024-12-19T01:08:22.063ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81212024-12-19T01:08:22.064ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
81222024-12-19T01:08:22.064ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81232024-12-19T01:08:22.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81242024-12-19T01:08:22.065ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81252024-12-19T01:08:22.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81262024-12-19T01:08:22.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81272024-12-19T01:08:22.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81282024-12-19T01:08:22.068ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81292024-12-19T01:08:22.072ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
81302024-12-19T01:08:22.072ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81312024-12-19T01:08:22.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81322024-12-19T01:08:22.080ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 5b97cf45-6db1-45ed-9f7e-111d132f7ed4, kind: Service { id: 2a880a2e-2471-4fd8-9ad5-3e0c3fbde317 }, name: Name("external-dns-2a880a2e-2471-4fd8-9ad5-3e0c3fbde317"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d21d0095-8e84-486f-b3a4-f9dca167b9d5, kind: Service { id: 679d67b5-9925-49ac-b78d-613e816394dc }, name: Name("external-dns-679d67b5-9925-49ac-b78d-613e816394dc"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 205])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 82094354-655d-415c-9763-28731eb50642, kind: Service { id: e1a83ba4-ec9f-4cc1-ae29-0ab5f6b211f9 }, name: Name("nexus-e1a83ba4-ec9f-4cc1-ae29-0ab5f6b211f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5c3ad41-155b-469b-bb3f-412814b9d0ff, kind: Service { id: 1176f008-4a9d-4835-a5aa-1a86ec3c619c }, name: Name("nexus-1176f008-4a9d-4835-a5aa-1a86ec3c619c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 188])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef89a8b8-3cc5-4637-aee2-3b98f04f51be, kind: Service { id: 1d1e5635-dd2b-4bf7-8ace-6cb3ea634995 }, name: Name("nexus-1d1e5635-dd2b-4bf7-8ace-6cb3ea634995"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
81332024-12-19T01:08:22.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81342024-12-19T01:08:22.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81352024-12-19T01:08:22.081ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81362024-12-19T01:08:22.083ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
81372024-12-19T01:08:22.083ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81382024-12-19T01:08:22.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81392024-12-19T01:08:22.085ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
81402024-12-19T01:08:22.085ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 5b97cf45-6db1-45ed-9f7e-111d132f7ed4, kind: Service { id: 2a880a2e-2471-4fd8-9ad5-3e0c3fbde317 }, name: Name("external-dns-2a880a2e-2471-4fd8-9ad5-3e0c3fbde317"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 253])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d21d0095-8e84-486f-b3a4-f9dca167b9d5, kind: Service { id: 679d67b5-9925-49ac-b78d-613e816394dc }, name: Name("external-dns-679d67b5-9925-49ac-b78d-613e816394dc"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 245, 205])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 82094354-655d-415c-9763-28731eb50642, kind: Service { id: e1a83ba4-ec9f-4cc1-ae29-0ab5f6b211f9 }, name: Name("nexus-e1a83ba4-ec9f-4cc1-ae29-0ab5f6b211f9"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a5c3ad41-155b-469b-bb3f-412814b9d0ff, kind: Service { id: 1176f008-4a9d-4835-a5aa-1a86ec3c619c }, name: Name("nexus-1176f008-4a9d-4835-a5aa-1a86ec3c619c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 188])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ef89a8b8-3cc5-4637-aee2-3b98f04f51be, kind: Service { id: 1d1e5635-dd2b-4bf7-8ace-6cb3ea634995 }, name: Name("nexus-1d1e5635-dd2b-4bf7-8ace-6cb3ea634995"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 215, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
81412024-12-19T01:08:22.085ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
81422024-12-19T01:08:22.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 73f910bb-8409-4af2-9bd8-cb5939181705 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
81432024-12-19T01:08:22.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 73f910bb-8409-4af2-9bd8-cb5939181705 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
81442024-12-19T01:08:22.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 73f910bb-8409-4af2-9bd8-cb5939181705 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
81452024-12-19T01:08:22.141ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: de9bec7d-f8ce-44a0-879c-5e088768f91c, time_created: 2024-12-19T00:58:58.564641Z, time_modified: 2024-12-19T00:58:58.564641Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
81462024-12-19T01:08:22.141ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
81472024-12-19T01:08:22.141ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81482024-12-19T01:08:22.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81492024-12-19T01:08:22.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
81502024-12-19T01:08:22.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
81512024-12-19T01:08:22.144ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81522024-12-19T01:08:22.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
81532024-12-19T01:08:22.178ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
81542024-12-19T01:08:22.195ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "be632602-0344-46f9-b59e-94d28e2721c5", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
81552024-12-19T01:08:22.195ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
81562024-12-19T01:08:22.195ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81572024-12-19T01:08:22.195ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "b68a86cf-79e9-425c-a8ae-4582240985a5", "date": "Thu, 19 Dec 2024 01:08:22 GMT"} })
81582024-12-19T01:08:22.197ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
81592024-12-19T01:08:22.197ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 822.536019ms
81602024-12-19T01:08:22.197ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 822.546379ms iteration = 3 status = {}
81612024-12-19T01:08:22.197ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c737c5f2-3f19-43bf-889f-d32dccae3cc7", "content-length": "682", "date": "Thu, 19 Dec 2024 01:08:22 GMT"} })
81622024-12-19T01:08:22.197ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81632024-12-19T01:08:22.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81642024-12-19T01:08:22.200ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81652024-12-19T01:08:22.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81662024-12-19T01:08:22.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81672024-12-19T01:08:22.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81682024-12-19T01:08:22.205ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81692024-12-19T01:08:22.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81702024-12-19T01:08:22.213ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 837.948677ms iteration = 21 status = {}
81712024-12-19T01:08:22.323ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebe7c3a3-8b82-4ce2-82f6-ad3b6c7d9b05", "content-length": "30795", "date": "Thu, 19 Dec 2024 01:08:21 GMT"} })
81722024-12-19T01:08:22.324ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
81732024-12-19T01:08:22.324ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
81742024-12-19T01:08:22.324ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
81752024-12-19T01:08:22.326ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
81762024-12-19T01:08:22.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
81772024-12-19T01:08:22.328ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81782024-12-19T01:08:22.329ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
81792024-12-19T01:08:22.330ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
81802024-12-19T01:08:22.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
81812024-12-19T01:08:22.505ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = e072ac9e-f3a5-4ce4-88a0-af304655a53c file = nexus/db-queries/src/db/datastore/inventory.rs:1006
81822024-12-19T01:08:22.505ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = e072ac9e-f3a5-4ce4-88a0-af304655a53c time_started = 2024-12-19 01:08:21.672909 UTC
81832024-12-19T01:08:22.505ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.130660453s iteration = 4 status = {"collection_id":"e072ac9e-f3a5-4ce4-88a0-af304655a53c","time_done":"2024-12-19 01:08:22.324945 UTC","time_started":"2024-12-19 01:08:21.672909 UTC"}
81842024-12-19T01:08:22.505ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
81852024-12-19T01:08:22.505ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81862024-12-19T01:08:22.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81872024-12-19T01:08:22.507ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81882024-12-19T01:08:22.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81892024-12-19T01:08:22.509ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81902024-12-19T01:08:22.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81912024-12-19T01:08:22.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81922024-12-19T01:08:22.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81932024-12-19T01:08:22.514ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81942024-12-19T01:08:22.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81952024-12-19T01:08:22.516ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81962024-12-19T01:08:22.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81972024-12-19T01:08:22.617ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 112.420246ms iteration = 25 status = {"physical_disks_added":0}
81982024-12-19T01:08:22.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 48ec9f58-edd2-4464-87a7-e7127a59a5d2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
81992024-12-19T01:08:22.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 48ec9f58-edd2-4464-87a7-e7127a59a5d2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
82002024-12-19T01:08:22.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2561 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 48ec9f58-edd2-4464-87a7-e7127a59a5d2 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
82012024-12-19T01:08:23.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f0d8ecb-e34c-4957-8a02-47cdb0ffd3a1 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82022024-12-19T01:08:23.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f0d8ecb-e34c-4957-8a02-47cdb0ffd3a1 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82032024-12-19T01:08:23.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f0d8ecb-e34c-4957-8a02-47cdb0ffd3a1 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82042024-12-19T01:08:24.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 29d79c61-36df-45d3-8270-9e03451217ae roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82052024-12-19T01:08:24.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 29d79c61-36df-45d3-8270-9e03451217ae resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82062024-12-19T01:08:24.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 29d79c61-36df-45d3-8270-9e03451217ae response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82072024-12-19T01:08:24.197ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:63335
82082024-12-19T01:08:24.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63335 req_id = 27e9d3db-f8bc-4149-b0cb-ef888382191f roles = RoleSet { roles: {} } uri = /metrics/producers
82092024-12-19T01:08:24.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63335 req_id = 27e9d3db-f8bc-4149-b0cb-ef888382191f resource = Database result = Ok(()) uri = /metrics/producers
82102024-12-19T01:08:24.235ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = de9bec7d-f8ce-44a0-879c-5e088768f91c
82112024-12-19T01:08:24.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37669 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63335 req_id = 27e9d3db-f8bc-4149-b0cb-ef888382191f response_code = 201 uri = /metrics/producers
82122024-12-19T01:08:25.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 78a3227d-0d5d-4c5a-86a9-03a8677dace3 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82132024-12-19T01:08:25.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 78a3227d-0d5d-4c5a-86a9-03a8677dace3 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82142024-12-19T01:08:25.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 78a3227d-0d5d-4c5a-86a9-03a8677dace3 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82152024-12-19T01:08:25.723ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:55090
82162024-12-19T01:08:25.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55090 req_id = d39696eb-92b8-46a6-aff8-bce22247b83e roles = RoleSet { roles: {} } uri = /metrics/producers
82172024-12-19T01:08:25.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55090 req_id = d39696eb-92b8-46a6-aff8-bce22247b83e resource = Database result = Ok(()) uri = /metrics/producers
82182024-12-19T01:08:25.730ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:44496
82192024-12-19T01:08:25.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44496 req_id = 83e233ac-9c60-4f96-90ca-7d886166471c roles = RoleSet { roles: {} } uri = /metrics/producers
82202024-12-19T01:08:25.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44496 req_id = 83e233ac-9c60-4f96-90ca-7d886166471c resource = Database result = Ok(()) uri = /metrics/producers
82212024-12-19T01:08:25.757ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 9544d6fb-0646-44f2-8d7c-f02b0fe1f856
82222024-12-19T01:08:25.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33714 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55090 req_id = d39696eb-92b8-46a6-aff8-bce22247b83e response_code = 201 uri = /metrics/producers
82232024-12-19T01:08:25.762ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = a59c27fd-a846-41a8-8577-0c2618144732
82242024-12-19T01:08:25.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31958 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44496 req_id = 83e233ac-9c60-4f96-90ca-7d886166471c response_code = 201 uri = /metrics/producers
82252024-12-19T01:08:25.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1394 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 45dc86fc-1964-49ad-b315-e41c59650941 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
82262024-12-19T01:08:26.068ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:49491
82272024-12-19T01:08:26.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49491 req_id = 23619cca-f98a-48df-a465-c05e9312efbc roles = RoleSet { roles: {} } uri = /metrics/producers
82282024-12-19T01:08:26.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49491 req_id = 23619cca-f98a-48df-a465-c05e9312efbc resource = Database result = Ok(()) uri = /metrics/producers
82292024-12-19T01:08:26.103ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 51ab14f8-f146-4958-aacf-1a2334aec785
82302024-12-19T01:08:26.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35176 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49491 req_id = 23619cca-f98a-48df-a465-c05e9312efbc response_code = 201 uri = /metrics/producers
82312024-12-19T01:08:26.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f6b52f0-7935-423a-88a7-989669443c1b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82322024-12-19T01:08:26.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f6b52f0-7935-423a-88a7-989669443c1b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82332024-12-19T01:08:26.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f6b52f0-7935-423a-88a7-989669443c1b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82342024-12-19T01:08:26.829ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:48077
82352024-12-19T01:08:26.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48077 req_id = eaa11e6a-15f6-450b-9c73-15a53e41030a roles = RoleSet { roles: {} } uri = /metrics/producers
82362024-12-19T01:08:26.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48077 req_id = eaa11e6a-15f6-450b-9c73-15a53e41030a resource = Database result = Ok(()) uri = /metrics/producers
82372024-12-19T01:08:26.863ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 9f4eb089-639f-444f-a6bb-061685ba22f0
82382024-12-19T01:08:26.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33943 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48077 req_id = eaa11e6a-15f6-450b-9c73-15a53e41030a response_code = 201 uri = /metrics/producers
82392024-12-19T01:08:27.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 98fca3bc-9657-4d3c-8598-673558f14021 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82402024-12-19T01:08:27.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 98fca3bc-9657-4d3c-8598-673558f14021 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82412024-12-19T01:08:27.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 98fca3bc-9657-4d3c-8598-673558f14021 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82422024-12-19T01:08:28.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 72f8af36-aa3a-4d68-b90b-8b1a4a83f886 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82432024-12-19T01:08:28.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 72f8af36-aa3a-4d68-b90b-8b1a4a83f886 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82442024-12-19T01:08:28.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 72f8af36-aa3a-4d68-b90b-8b1a4a83f886 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82452024-12-19T01:08:29.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4a809f09-6b14-42f5-aaa9-44c59d25e782 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82462024-12-19T01:08:29.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4a809f09-6b14-42f5-aaa9-44c59d25e782 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82472024-12-19T01:08:29.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2075 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4a809f09-6b14-42f5-aaa9-44c59d25e782 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82482024-12-19T01:08:30.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8b23660d-e620-43e1-b20c-cfd0a04194a3 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82492024-12-19T01:08:30.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8b23660d-e620-43e1-b20c-cfd0a04194a3 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82502024-12-19T01:08:30.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8b23660d-e620-43e1-b20c-cfd0a04194a3 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82512024-12-19T01:08:31.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bf51f503-50a8-47d8-af7a-6cad2d42ac55 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82522024-12-19T01:08:31.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bf51f503-50a8-47d8-af7a-6cad2d42ac55 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82532024-12-19T01:08:31.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bf51f503-50a8-47d8-af7a-6cad2d42ac55 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82542024-12-19T01:08:31.374ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
82552024-12-19T01:08:31.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82562024-12-19T01:08:31.374ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
82572024-12-19T01:08:31.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82582024-12-19T01:08:31.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82592024-12-19T01:08:31.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82602024-12-19T01:08:31.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82612024-12-19T01:08:31.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82622024-12-19T01:08:31.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82632024-12-19T01:08:31.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82642024-12-19T01:08:31.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82652024-12-19T01:08:31.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82662024-12-19T01:08:31.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82672024-12-19T01:08:31.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
82682024-12-19T01:08:31.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82692024-12-19T01:08:31.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82702024-12-19T01:08:31.407ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
82712024-12-19T01:08:31.407ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.143027ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
82722024-12-19T01:08:31.415ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82732024-12-19T01:08:31.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82742024-12-19T01:08:31.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.170679ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82752024-12-19T01:08:32.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2295f95d-0283-483c-923e-59141d23cda2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82762024-12-19T01:08:32.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2295f95d-0283-483c-923e-59141d23cda2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82772024-12-19T01:08:32.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2295f95d-0283-483c-923e-59141d23cda2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82782024-12-19T01:08:33.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 350a77b4-55d6-42f5-acd5-3746c85fc5ac roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82792024-12-19T01:08:33.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 350a77b4-55d6-42f5-acd5-3746c85fc5ac resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82802024-12-19T01:08:33.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 350a77b4-55d6-42f5-acd5-3746c85fc5ac response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82812024-12-19T01:08:34.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fdb75137-b39d-4e41-943b-816b54989aa5 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82822024-12-19T01:08:34.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fdb75137-b39d-4e41-943b-816b54989aa5 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82832024-12-19T01:08:34.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fdb75137-b39d-4e41-943b-816b54989aa5 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82842024-12-19T01:08:35.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ba92e8de-5bee-4a56-8134-6d9e0fec727e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82852024-12-19T01:08:35.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ba92e8de-5bee-4a56-8134-6d9e0fec727e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82862024-12-19T01:08:35.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ba92e8de-5bee-4a56-8134-6d9e0fec727e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82872024-12-19T01:08:35.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 429429bb-b837-4d36-bbbd-3de67bc66ce3 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
82882024-12-19T01:08:35.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 429429bb-b837-4d36-bbbd-3de67bc66ce3 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
82892024-12-19T01:08:35.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 429429bb-b837-4d36-bbbd-3de67bc66ce3 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
82902024-12-19T01:08:35.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 67bc6150-e83c-4a4f-9f28-1b0a606cecf1 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
82912024-12-19T01:08:35.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 67bc6150-e83c-4a4f-9f28-1b0a606cecf1 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
82922024-12-19T01:08:35.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 67bc6150-e83c-4a4f-9f28-1b0a606cecf1 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
82932024-12-19T01:08:35.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1300 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = f8a80d1a-333a-413e-8cc9-d5f2e828deee response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
82942024-12-19T01:08:36.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a94e325c-0b7e-4e08-83c6-e8181ab45e43 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82952024-12-19T01:08:36.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a94e325c-0b7e-4e08-83c6-e8181ab45e43 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82962024-12-19T01:08:36.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a94e325c-0b7e-4e08-83c6-e8181ab45e43 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82972024-12-19T01:08:37.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e32fb646-5af7-4530-9788-c07d2a00a25d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82982024-12-19T01:08:37.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e32fb646-5af7-4530-9788-c07d2a00a25d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
82992024-12-19T01:08:37.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e32fb646-5af7-4530-9788-c07d2a00a25d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83002024-12-19T01:08:38.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 14448f34-eb0a-47cc-b347-59373d646c09 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83012024-12-19T01:08:38.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 14448f34-eb0a-47cc-b347-59373d646c09 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83022024-12-19T01:08:38.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2810 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 14448f34-eb0a-47cc-b347-59373d646c09 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83032024-12-19T01:08:39.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9ed8ce6a-1118-47c6-b7a0-6778c5c6e983 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83042024-12-19T01:08:39.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9ed8ce6a-1118-47c6-b7a0-6778c5c6e983 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83052024-12-19T01:08:39.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9ed8ce6a-1118-47c6-b7a0-6778c5c6e983 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83062024-12-19T01:08:40.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7ba77b44-b480-487c-b922-6a312a1ec963 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83072024-12-19T01:08:40.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7ba77b44-b480-487c-b922-6a312a1ec963 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83082024-12-19T01:08:40.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7ba77b44-b480-487c-b922-6a312a1ec963 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83092024-12-19T01:08:41.374ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
83102024-12-19T01:08:41.374ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
83112024-12-19T01:08:41.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83122024-12-19T01:08:41.374ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83132024-12-19T01:08:41.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83142024-12-19T01:08:41.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83152024-12-19T01:08:41.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83162024-12-19T01:08:41.377ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83172024-12-19T01:08:41.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83182024-12-19T01:08:41.379ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.44049ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83192024-12-19T01:08:41.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83202024-12-19T01:08:41.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83212024-12-19T01:08:41.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83222024-12-19T01:08:41.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83232024-12-19T01:08:41.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83242024-12-19T01:08:41.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83252024-12-19T01:08:41.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
83262024-12-19T01:08:41.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83272024-12-19T01:08:41.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83282024-12-19T01:08:41.392ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
83292024-12-19T01:08:41.392ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.322559ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
83302024-12-19T01:08:41.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1d84553e-ac00-4e85-a33b-2c96e762f874 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83312024-12-19T01:08:41.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1d84553e-ac00-4e85-a33b-2c96e762f874 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83322024-12-19T01:08:41.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1863 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1d84553e-ac00-4e85-a33b-2c96e762f874 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83332024-12-19T01:08:41.587ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35412
83342024-12-19T01:08:41.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35412 req_id = 43fb1f66-14fd-4c08-add0-7905ed821df2 roles = RoleSet { roles: {} } uri = /metrics/producers
83352024-12-19T01:08:41.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35412 req_id = 43fb1f66-14fd-4c08-add0-7905ed821df2 resource = Database result = Ok(()) uri = /metrics/producers
83362024-12-19T01:08:41.596ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = ac09f416-2290-4c96-b514-dc021f54a2f5
83372024-12-19T01:08:41.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8414 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35412 req_id = 43fb1f66-14fd-4c08-add0-7905ed821df2 response_code = 201 uri = /metrics/producers
83382024-12-19T01:08:42.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = eca877a1-d400-40bb-8d01-37e363e4655f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83392024-12-19T01:08:42.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = eca877a1-d400-40bb-8d01-37e363e4655f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83402024-12-19T01:08:42.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1660 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = eca877a1-d400-40bb-8d01-37e363e4655f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83412024-12-19T01:08:43.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8cb10820-e8d4-4f10-befb-fb1bc2b2ebd6 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83422024-12-19T01:08:43.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8cb10820-e8d4-4f10-befb-fb1bc2b2ebd6 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83432024-12-19T01:08:43.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8cb10820-e8d4-4f10-befb-fb1bc2b2ebd6 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83442024-12-19T01:08:44.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a461ba68-246b-4c48-b1c8-e8a3df7e6e21 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83452024-12-19T01:08:44.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a461ba68-246b-4c48-b1c8-e8a3df7e6e21 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83462024-12-19T01:08:44.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a461ba68-246b-4c48-b1c8-e8a3df7e6e21 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83472024-12-19T01:08:45.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 11421df4-0adf-4dfd-910d-ee15f0f93c89 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83482024-12-19T01:08:45.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 11421df4-0adf-4dfd-910d-ee15f0f93c89 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83492024-12-19T01:08:45.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 11421df4-0adf-4dfd-910d-ee15f0f93c89 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83502024-12-19T01:08:45.772ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1386 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 140fdce5-3219-45f3-bb6a-020621ff5982 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
83512024-12-19T01:08:46.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 01843f44-d953-4a7a-9fd7-5712fac19d71 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83522024-12-19T01:08:46.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 01843f44-d953-4a7a-9fd7-5712fac19d71 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83532024-12-19T01:08:46.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 01843f44-d953-4a7a-9fd7-5712fac19d71 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83542024-12-19T01:08:47.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e836cc4c-eda0-41a0-8fa1-744548de1cbd roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83552024-12-19T01:08:47.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e836cc4c-eda0-41a0-8fa1-744548de1cbd resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83562024-12-19T01:08:47.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e836cc4c-eda0-41a0-8fa1-744548de1cbd response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83572024-12-19T01:08:48.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6579f2da-fb1a-4e61-abe3-5e98c1a1ce97 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83582024-12-19T01:08:48.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6579f2da-fb1a-4e61-abe3-5e98c1a1ce97 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83592024-12-19T01:08:48.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6579f2da-fb1a-4e61-abe3-5e98c1a1ce97 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83602024-12-19T01:08:49.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2595aa73-7ea4-4e96-9bee-b3f3916559dd roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83612024-12-19T01:08:49.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2595aa73-7ea4-4e96-9bee-b3f3916559dd resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83622024-12-19T01:08:49.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2595aa73-7ea4-4e96-9bee-b3f3916559dd response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83632024-12-19T01:08:50.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = b4425b48-0de4-4093-ae47-4fcf6ef62785 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
83642024-12-19T01:08:50.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = b4425b48-0de4-4093-ae47-4fcf6ef62785 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
83652024-12-19T01:08:50.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 951c6c1c-8666-43c0-8962-34c07a8cca3d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83662024-12-19T01:08:50.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 951c6c1c-8666-43c0-8962-34c07a8cca3d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83672024-12-19T01:08:50.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 951c6c1c-8666-43c0-8962-34c07a8cca3d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
83682024-12-19T01:08:50.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = b4425b48-0de4-4093-ae47-4fcf6ef62785 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
83692024-12-19T01:08:50.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = bdee4da0-b204-41ed-8b0a-e0d59268bb03 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
83702024-12-19T01:08:50.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = bdee4da0-b204-41ed-8b0a-e0d59268bb03 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
83712024-12-19T01:08:50.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1854 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = bdee4da0-b204-41ed-8b0a-e0d59268bb03 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
83722024-12-19T01:08:51.374ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
83732024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83742024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
83752024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
83762024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83772024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
83782024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83792024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83802024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
83812024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83822024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
83832024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
83842024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
83852024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83862024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
83872024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
83882024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
83892024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
83902024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83912024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83922024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
83932024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
83942024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83952024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83962024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
83972024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
83982024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83992024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
84002024-12-19T01:08:51.375ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
84012024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84022024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
84032024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84042024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
84052024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84062024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84072024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84082024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84092024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84102024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84112024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84122024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84132024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84142024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
84152024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84162024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84172024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84182024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84192024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84202024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84212024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84222024-12-19T01:08:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84232024-12-19T01:08:51.377ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84242024-12-19T01:08:51.378ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1420, tv_nsec: 221584666 } })
84252024-12-19T01:08:51.379ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
84262024-12-19T01:08:51.379ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.916603ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
84272024-12-19T01:08:51.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84282024-12-19T01:08:51.379ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1420, tv_nsec: 222339777 } })
84292024-12-19T01:08:51.379ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
84302024-12-19T01:08:51.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84312024-12-19T01:08:51.380ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84322024-12-19T01:08:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84332024-12-19T01:08:51.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84342024-12-19T01:08:51.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84352024-12-19T01:08:51.383ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84362024-12-19T01:08:51.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84372024-12-19T01:08:51.383ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.551256ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
84382024-12-19T01:08:51.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84392024-12-19T01:08:51.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84402024-12-19T01:08:51.386ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84412024-12-19T01:08:51.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84422024-12-19T01:08:51.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84432024-12-19T01:08:51.388ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84442024-12-19T01:08:51.388ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84452024-12-19T01:08:51.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84462024-12-19T01:08:51.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84472024-12-19T01:08:51.388ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84482024-12-19T01:08:51.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84492024-12-19T01:08:51.390ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84502024-12-19T01:08:51.390ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84512024-12-19T01:08:51.390ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84522024-12-19T01:08:51.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84532024-12-19T01:08:51.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84542024-12-19T01:08:51.391ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84552024-12-19T01:08:51.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84562024-12-19T01:08:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84572024-12-19T01:08:51.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84582024-12-19T01:08:51.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84592024-12-19T01:08:51.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84602024-12-19T01:08:51.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84612024-12-19T01:08:51.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84622024-12-19T01:08:51.403ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.314222ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84632024-12-19T01:08:51.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84642024-12-19T01:08:51.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84652024-12-19T01:08:51.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84662024-12-19T01:08:51.404ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84672024-12-19T01:08:51.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84682024-12-19T01:08:51.405ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1420, tv_nsec: 247881833 } })
84692024-12-19T01:08:51.405ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
84702024-12-19T01:08:51.406ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84712024-12-19T01:08:51.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84722024-12-19T01:08:51.415ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84732024-12-19T01:08:51.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84742024-12-19T01:08:51.427ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.115578ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
84752024-12-19T01:08:51.432ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84762024-12-19T01:08:51.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84772024-12-19T01:08:51.436ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 61.480245ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
84782024-12-19T01:08:51.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84792024-12-19T01:08:51.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84802024-12-19T01:08:51.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.247053ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84812024-12-19T01:08:51.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84822024-12-19T01:08:51.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84832024-12-19T01:08:51.451ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
84842024-12-19T01:08:51.451ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84852024-12-19T01:08:51.451ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ff90982-5c64-469a-a720-9cc4609552ca", "content-length": "26", "date": "Thu, 19 Dec 2024 01:08:51 GMT"} })
84862024-12-19T01:08:51.451ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84872024-12-19T01:08:51.453ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84882024-12-19T01:08:51.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84892024-12-19T01:08:51.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84902024-12-19T01:08:51.455ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84912024-12-19T01:08:51.455ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
84922024-12-19T01:08:51.455ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84932024-12-19T01:08:51.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84942024-12-19T01:08:51.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84952024-12-19T01:08:51.456ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
84962024-12-19T01:08:51.456ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.720609ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
84972024-12-19T01:08:51.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
84982024-12-19T01:08:51.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84992024-12-19T01:08:51.459ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85002024-12-19T01:08:51.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85012024-12-19T01:08:51.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85022024-12-19T01:08:51.461ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85032024-12-19T01:08:51.461ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.582956ms iteration = 22 status = 0
85042024-12-19T01:08:51.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85052024-12-19T01:08:51.461ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85062024-12-19T01:08:51.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
85072024-12-19T01:08:51.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85082024-12-19T01:08:51.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85092024-12-19T01:08:51.470ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 95.818551ms iteration = 26 status = {"physical_disks_added":0}
85102024-12-19T01:08:51.473ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
85112024-12-19T01:08:51.473ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85122024-12-19T01:08:51.473ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3df5446-e14a-489d-ba64-80d607a4e704", "content-length": "26", "date": "Thu, 19 Dec 2024 01:08:51 GMT"} })
85132024-12-19T01:08:51.473ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85142024-12-19T01:08:51.473ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
85152024-12-19T01:08:51.473ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 98.980654ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
85162024-12-19T01:08:51.475ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85172024-12-19T01:08:51.476ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85182024-12-19T01:08:51.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85192024-12-19T01:08:51.479ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 104.202775ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
85202024-12-19T01:08:51.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85212024-12-19T01:08:51.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85222024-12-19T01:08:51.500ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85232024-12-19T01:08:51.500ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
85242024-12-19T01:08:51.500ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.988178ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
85252024-12-19T01:08:51.502ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
85262024-12-19T01:08:51.502ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85272024-12-19T01:08:51.502ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4034e346-b2d8-4395-88a5-6df8ec411b23", "content-length": "26", "date": "Thu, 19 Dec 2024 01:08:51 GMT"} })
85282024-12-19T01:08:51.502ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85292024-12-19T01:08:51.503ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85302024-12-19T01:08:51.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85312024-12-19T01:08:51.504ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
85322024-12-19T01:08:51.558ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85332024-12-19T01:08:51.558ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "84f5c5b0-4fc7-4515-9644-7c33147b396f", "content-length": "1", "date": "Thu, 19 Dec 2024 01:08:51 GMT"} })
85342024-12-19T01:08:51.559ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85352024-12-19T01:08:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85362024-12-19T01:08:51.658ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 283.319258ms iteration = 22 status = {}
85372024-12-19T01:08:51.663ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
85382024-12-19T01:08:51.663ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85392024-12-19T01:08:51.664ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "be5f1314-3745-4e85-86fe-22a668a13dde", "content-length": "372", "date": "Thu, 19 Dec 2024 01:08:51 GMT"} })
85402024-12-19T01:08:51.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85412024-12-19T01:08:51.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85422024-12-19T01:08:51.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85432024-12-19T01:08:51.666ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 291.65141ms iteration = 22 status = null
85442024-12-19T01:08:51.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85452024-12-19T01:08:51.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85462024-12-19T01:08:51.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85472024-12-19T01:08:51.670ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85482024-12-19T01:08:51.672ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85492024-12-19T01:08:51.672ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85502024-12-19T01:08:51.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85512024-12-19T01:08:51.685ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
85522024-12-19T01:08:51.685ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
85532024-12-19T01:08:51.686ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1e742f02-8063-4073-80f0-a95806cc82d9", "date": "Thu, 19 Dec 2024 01:08:51 GMT"} })
85542024-12-19T01:08:51.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85552024-12-19T01:08:51.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85562024-12-19T01:08:51.688ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85572024-12-19T01:08:51.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85582024-12-19T01:08:51.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85592024-12-19T01:08:51.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85602024-12-19T01:08:51.694ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85612024-12-19T01:08:51.694ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85622024-12-19T01:08:51.695ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "af5696d1-1998-43f4-869f-d7efef8dd4e3", "date": "Thu, 19 Dec 2024 01:08:51 GMT"} })
85632024-12-19T01:08:51.696ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 321.212961ms iteration = 23 status = {}
85642024-12-19T01:08:51.732ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85652024-12-19T01:08:51.732ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "54aaaeaf-e67b-4782-975b-19d21db85e9a", "content-length": "691", "date": "Thu, 19 Dec 2024 01:08:51 GMT"} })
85662024-12-19T01:08:51.732ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
85672024-12-19T01:08:51.732ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
85682024-12-19T01:08:51.732ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
85692024-12-19T01:08:51.734ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 359.000215ms iteration = 22 status = {}
85702024-12-19T01:08:51.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85712024-12-19T01:08:51.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85722024-12-19T01:08:51.739ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
85732024-12-19T01:08:51.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85742024-12-19T01:08:51.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85752024-12-19T01:08:51.751ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85762024-12-19T01:08:51.752ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b36b9e36-f405-4c5a-b0bb-8c8a8fe12728", "content-length": "134", "date": "Thu, 19 Dec 2024 01:08:51 GMT"} })
85772024-12-19T01:08:51.752ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85782024-12-19T01:08:51.752ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
85792024-12-19T01:08:51.752ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85802024-12-19T01:08:51.752ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85812024-12-19T01:08:51.752ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85822024-12-19T01:08:51.752ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85832024-12-19T01:08:51.752ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85842024-12-19T01:08:51.752ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85852024-12-19T01:08:51.752ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85862024-12-19T01:08:51.752ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85872024-12-19T01:08:51.752ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
85882024-12-19T01:08:51.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85892024-12-19T01:08:51.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85902024-12-19T01:08:51.755ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85912024-12-19T01:08:51.755ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "97a28f8b-12ba-49c1-9c12-326791119330", "content-length": "2", "date": "Thu, 19 Dec 2024 01:08:51 GMT"} })
85922024-12-19T01:08:51.755ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85932024-12-19T01:08:51.755ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d68e71e7-9aca-4c33-8a90-fbb1138dea88", "content-length": "52", "date": "Thu, 19 Dec 2024 01:08:51 GMT"} })
85942024-12-19T01:08:51.755ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
85952024-12-19T01:08:51.755ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85962024-12-19T01:08:51.852ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "95ab82d7-f561-4fe2-be55-6590e35b6148", "date": "Thu, 19 Dec 2024 01:08:51 GMT"} })
85972024-12-19T01:08:51.852ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
85982024-12-19T01:08:51.852ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85992024-12-19T01:08:51.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0fbc1401-29de-497f-8519-593193e299d5 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86002024-12-19T01:08:51.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0fbc1401-29de-497f-8519-593193e299d5 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86012024-12-19T01:08:51.853ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e92df47f-8e26-46a8-8421-83ce3fb13021", "content-length": "682", "date": "Thu, 19 Dec 2024 01:08:51 GMT"} })
86022024-12-19T01:08:51.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86032024-12-19T01:08:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86042024-12-19T01:08:51.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0fbc1401-29de-497f-8519-593193e299d5 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86052024-12-19T01:08:51.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86062024-12-19T01:08:51.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86072024-12-19T01:08:51.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86082024-12-19T01:08:51.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86092024-12-19T01:08:51.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86102024-12-19T01:08:51.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86112024-12-19T01:08:51.868ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 493.245427ms iteration = 22 status = {}
86122024-12-19T01:08:52.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8c92b156-afb6-4fcd-b732-655d7142ddab roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86132024-12-19T01:08:52.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8c92b156-afb6-4fcd-b732-655d7142ddab resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86142024-12-19T01:08:52.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8c92b156-afb6-4fcd-b732-655d7142ddab response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86152024-12-19T01:08:52.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 22cd1d42-660d-4f8e-8fed-68d8cf150be8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
86162024-12-19T01:08:52.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 22cd1d42-660d-4f8e-8fed-68d8cf150be8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
86172024-12-19T01:08:52.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 22cd1d42-660d-4f8e-8fed-68d8cf150be8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
86182024-12-19T01:08:53.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 372de576-e04b-411c-8e82-7156330ed70a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86192024-12-19T01:08:53.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 372de576-e04b-411c-8e82-7156330ed70a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86202024-12-19T01:08:53.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 372de576-e04b-411c-8e82-7156330ed70a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86212024-12-19T01:08:54.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4ccc365f-1337-4c97-9a5e-65db903f2009 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86222024-12-19T01:08:54.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4ccc365f-1337-4c97-9a5e-65db903f2009 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86232024-12-19T01:08:54.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4ccc365f-1337-4c97-9a5e-65db903f2009 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86242024-12-19T01:08:55.772ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1278 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 5d89a507-75d1-4f03-8c49-6e3722a6cf3e response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
86252024-12-19T01:08:55.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8608bfbf-9fba-482b-abb9-76529c3f08f1 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86262024-12-19T01:08:55.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8608bfbf-9fba-482b-abb9-76529c3f08f1 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86272024-12-19T01:08:55.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8608bfbf-9fba-482b-abb9-76529c3f08f1 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86282024-12-19T01:08:56.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e975d334-c9f9-4b43-8967-17b808e32db4 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86292024-12-19T01:08:56.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e975d334-c9f9-4b43-8967-17b808e32db4 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86302024-12-19T01:08:56.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = e975d334-c9f9-4b43-8967-17b808e32db4 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86312024-12-19T01:08:57.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 00d027e7-388a-4693-8433-2b94e1c667aa roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86322024-12-19T01:08:57.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 00d027e7-388a-4693-8433-2b94e1c667aa resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86332024-12-19T01:08:57.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 00d027e7-388a-4693-8433-2b94e1c667aa response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86342024-12-19T01:08:59.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5c241c8f-d5a6-4b27-a65b-ab26b0d9dee8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86352024-12-19T01:08:59.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5c241c8f-d5a6-4b27-a65b-ab26b0d9dee8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86362024-12-19T01:08:59.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5c241c8f-d5a6-4b27-a65b-ab26b0d9dee8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86372024-12-19T01:09:00.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bc69fe60-015d-41ae-a5e8-45580527f8f3 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86382024-12-19T01:09:00.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bc69fe60-015d-41ae-a5e8-45580527f8f3 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86392024-12-19T01:09:00.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bc69fe60-015d-41ae-a5e8-45580527f8f3 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86402024-12-19T01:09:01.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = abdf09eb-1f2a-48d9-b2dc-573f3b6b1917 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86412024-12-19T01:09:01.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = abdf09eb-1f2a-48d9-b2dc-573f3b6b1917 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86422024-12-19T01:09:01.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = abdf09eb-1f2a-48d9-b2dc-573f3b6b1917 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86432024-12-19T01:09:01.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
86442024-12-19T01:09:01.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
86452024-12-19T01:09:01.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86462024-12-19T01:09:01.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86472024-12-19T01:09:01.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86482024-12-19T01:09:01.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86492024-12-19T01:09:01.376ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86502024-12-19T01:09:01.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86512024-12-19T01:09:01.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86522024-12-19T01:09:01.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86532024-12-19T01:09:01.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86542024-12-19T01:09:01.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86552024-12-19T01:09:01.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86562024-12-19T01:09:01.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86572024-12-19T01:09:01.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86582024-12-19T01:09:01.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
86592024-12-19T01:09:01.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86602024-12-19T01:09:01.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86612024-12-19T01:09:01.399ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
86622024-12-19T01:09:01.399ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.216339ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
86632024-12-19T01:09:01.405ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.377302ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86642024-12-19T01:09:02.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 12736683-a0ee-4dbb-8642-b44cdae6a40f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86652024-12-19T01:09:02.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 12736683-a0ee-4dbb-8642-b44cdae6a40f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86662024-12-19T01:09:02.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 12736683-a0ee-4dbb-8642-b44cdae6a40f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86672024-12-19T01:09:03.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ca1aa6ee-e1a8-4851-8a64-7ec56f14ce19 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86682024-12-19T01:09:03.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ca1aa6ee-e1a8-4851-8a64-7ec56f14ce19 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86692024-12-19T01:09:03.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ca1aa6ee-e1a8-4851-8a64-7ec56f14ce19 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86702024-12-19T01:09:03.969ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
86712024-12-19T01:09:03.970ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
86722024-12-19T01:09:04.000ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
86732024-12-19T01:09:04.000ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:56361
86742024-12-19T01:09:04.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:56361 req_id = eb913337-0ad1-4fe8-92cb-d420141ac080 roles = RoleSet { roles: {} } uri = /metrics/producers
86752024-12-19T01:09:04.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:56361 req_id = eb913337-0ad1-4fe8-92cb-d420141ac080 resource = Database result = Ok(()) uri = /metrics/producers
86762024-12-19T01:09:04.010ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
86772024-12-19T01:09:04.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10572 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:56361 req_id = eb913337-0ad1-4fe8-92cb-d420141ac080 response_code = 201 uri = /metrics/producers
86782024-12-19T01:09:04.010ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "eb913337-0ad1-4fe8-92cb-d420141ac080", "content-length": "41", "date": "Thu, 19 Dec 2024 01:09:04 GMT"} })
86792024-12-19T01:09:04.012ZDEBGnexus (producer-registration-task): registered with nexus successfully
86802024-12-19T01:09:04.012ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
86812024-12-19T01:09:04.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6636c717-e7de-41df-b212-2bfdebd58b90 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86822024-12-19T01:09:04.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6636c717-e7de-41df-b212-2bfdebd58b90 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86832024-12-19T01:09:04.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6636c717-e7de-41df-b212-2bfdebd58b90 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86842024-12-19T01:09:05.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a0d78056-3917-4a9b-aa32-8f03d6b9ecf4 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86852024-12-19T01:09:05.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a0d78056-3917-4a9b-aa32-8f03d6b9ecf4 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86862024-12-19T01:09:05.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a0d78056-3917-4a9b-aa32-8f03d6b9ecf4 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86872024-12-19T01:09:05.771ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1393 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 98f605ff-b000-49b6-9473-2ecad9cbbdda response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
86882024-12-19T01:09:06.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 33ce66ac-edad-4c7e-8777-f4c2225f9015 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86892024-12-19T01:09:06.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 33ce66ac-edad-4c7e-8777-f4c2225f9015 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86902024-12-19T01:09:06.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 33ce66ac-edad-4c7e-8777-f4c2225f9015 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86912024-12-19T01:09:07.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 08a3ca35-c12c-4dec-a371-0b82dc8a7367 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86922024-12-19T01:09:07.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 08a3ca35-c12c-4dec-a371-0b82dc8a7367 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86932024-12-19T01:09:07.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2684 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 08a3ca35-c12c-4dec-a371-0b82dc8a7367 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86942024-12-19T01:09:08.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = df4aa569-8541-446b-889a-f778a978df34 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86952024-12-19T01:09:08.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = df4aa569-8541-446b-889a-f778a978df34 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86962024-12-19T01:09:08.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = df4aa569-8541-446b-889a-f778a978df34 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86972024-12-19T01:09:09.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 70275eb5-22ed-4552-b3c0-c61582546854 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86982024-12-19T01:09:09.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 70275eb5-22ed-4552-b3c0-c61582546854 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
86992024-12-19T01:09:09.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 70275eb5-22ed-4552-b3c0-c61582546854 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87002024-12-19T01:09:10.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 98fa7383-d98c-4bb3-895d-16b6180db5d2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87012024-12-19T01:09:10.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 98fa7383-d98c-4bb3-895d-16b6180db5d2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87022024-12-19T01:09:10.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 98fa7383-d98c-4bb3-895d-16b6180db5d2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87032024-12-19T01:09:11.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 670ac898-e7f0-4ac3-8b7b-789b513418ac roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87042024-12-19T01:09:11.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 670ac898-e7f0-4ac3-8b7b-789b513418ac resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87052024-12-19T01:09:11.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 670ac898-e7f0-4ac3-8b7b-789b513418ac response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87062024-12-19T01:09:11.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
87072024-12-19T01:09:11.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
87082024-12-19T01:09:11.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87092024-12-19T01:09:11.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87102024-12-19T01:09:11.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87112024-12-19T01:09:11.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87122024-12-19T01:09:11.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87132024-12-19T01:09:11.377ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87142024-12-19T01:09:11.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87152024-12-19T01:09:11.379ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.130376ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87162024-12-19T01:09:11.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87172024-12-19T01:09:11.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87182024-12-19T01:09:11.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87192024-12-19T01:09:11.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87202024-12-19T01:09:11.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87212024-12-19T01:09:11.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87222024-12-19T01:09:11.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
87232024-12-19T01:09:11.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87242024-12-19T01:09:11.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87252024-12-19T01:09:11.396ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
87262024-12-19T01:09:11.396ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.643704ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
87272024-12-19T01:09:12.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f235479-86b6-4c5e-9c21-824f3f13c61e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87282024-12-19T01:09:12.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f235479-86b6-4c5e-9c21-824f3f13c61e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87292024-12-19T01:09:12.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4f235479-86b6-4c5e-9c21-824f3f13c61e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87302024-12-19T01:09:13.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2fd911b1-5ef4-4628-a239-781114db9255 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87312024-12-19T01:09:13.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2fd911b1-5ef4-4628-a239-781114db9255 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87322024-12-19T01:09:13.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2fd911b1-5ef4-4628-a239-781114db9255 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87332024-12-19T01:09:14.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a218cefe-9e89-4afd-b85c-04f4d2c5ea20 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87342024-12-19T01:09:14.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a218cefe-9e89-4afd-b85c-04f4d2c5ea20 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87352024-12-19T01:09:14.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a218cefe-9e89-4afd-b85c-04f4d2c5ea20 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87362024-12-19T01:09:15.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b23a01b9-bfe1-43a2-ae27-7ff21bd82b8c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87372024-12-19T01:09:15.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b23a01b9-bfe1-43a2-ae27-7ff21bd82b8c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87382024-12-19T01:09:15.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b23a01b9-bfe1-43a2-ae27-7ff21bd82b8c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87392024-12-19T01:09:15.772ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1446 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 2524c991-3a10-46d2-b772-2e9a60e94a80 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
87402024-12-19T01:09:16.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 046d6849-7d69-439d-ac2e-677ce7e6e869 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87412024-12-19T01:09:16.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 046d6849-7d69-439d-ac2e-677ce7e6e869 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87422024-12-19T01:09:16.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 046d6849-7d69-439d-ac2e-677ce7e6e869 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87432024-12-19T01:09:17.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f338cf4-7aec-4d2f-98b2-931623e3dd6e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87442024-12-19T01:09:17.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f338cf4-7aec-4d2f-98b2-931623e3dd6e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87452024-12-19T01:09:17.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f338cf4-7aec-4d2f-98b2-931623e3dd6e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87462024-12-19T01:09:18.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 59a90340-bc2d-4d52-82a9-39278ac03fc2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87472024-12-19T01:09:18.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 59a90340-bc2d-4d52-82a9-39278ac03fc2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87482024-12-19T01:09:18.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 59a90340-bc2d-4d52-82a9-39278ac03fc2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87492024-12-19T01:09:19.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4ddc27ef-237f-495e-8fe3-fccbc53d6089 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87502024-12-19T01:09:19.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4ddc27ef-237f-495e-8fe3-fccbc53d6089 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87512024-12-19T01:09:19.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 4ddc27ef-237f-495e-8fe3-fccbc53d6089 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87522024-12-19T01:09:20.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e2a01e0-20bc-4f6a-89a6-82d12b16191e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87532024-12-19T01:09:20.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e2a01e0-20bc-4f6a-89a6-82d12b16191e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87542024-12-19T01:09:20.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e2a01e0-20bc-4f6a-89a6-82d12b16191e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
87552024-12-19T01:09:20.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = baf30376-43a2-48b8-9764-6c67700c831d roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
87562024-12-19T01:09:20.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = baf30376-43a2-48b8-9764-6c67700c831d resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
87572024-12-19T01:09:20.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = baf30376-43a2-48b8-9764-6c67700c831d response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
87582024-12-19T01:09:20.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 96bc0151-1b71-4681-8491-cc3de4451cf3 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
87592024-12-19T01:09:20.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 96bc0151-1b71-4681-8491-cc3de4451cf3 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
87602024-12-19T01:09:20.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 96bc0151-1b71-4681-8491-cc3de4451cf3 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
87612024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
87622024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
87632024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87642024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
87652024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
87662024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87672024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
87682024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87692024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
87702024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
87712024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87722024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
87732024-12-19T01:09:21.375ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a
87742024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a"}
87752024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
87762024-12-19T01:09:21.375ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
87772024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
87782024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
87792024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
87802024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
87812024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87822024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
87832024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
87842024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87852024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
87862024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87872024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
87882024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
87892024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87902024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
87912024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87922024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
87932024-12-19T01:09:21.375ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 00:59:21.375420660 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
87942024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
87952024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
87962024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87972024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
87982024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
87992024-12-19T01:09:21.375ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
88002024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88012024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
88022024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88032024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
88042024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88052024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88062024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
88072024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88082024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
88092024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88102024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
88112024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88122024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
88132024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
88142024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
88152024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88162024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
88172024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
88182024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
88192024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88202024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
88212024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
88222024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
88232024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88242024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88252024-12-19T01:09:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88262024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88272024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88282024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88292024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
88302024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88312024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88322024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
88332024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88342024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88352024-12-19T01:09:21.376ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a880a2e-2471-4fd8-9ad5-3e0c3fbde317.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1450, tv_nsec: 218745655 } })
88362024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88372024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88382024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88392024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88402024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88412024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88422024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88432024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
88442024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88452024-12-19T01:09:21.376ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0018a454-75c0-41b1-be69-9476391f01e1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("050cdbd7-4ebc-471c-b4dc-ec1b3741f763.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1450, tv_nsec: 218835116 } })
88462024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88472024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
88482024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88492024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
88502024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 917.763\u{b5}s iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
88512024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
88522024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.373899ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
88532024-12-19T01:09:21.376ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88542024-12-19T01:09:21.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88552024-12-19T01:09:21.377ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88562024-12-19T01:09:21.378ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88572024-12-19T01:09:21.378ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.68655ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88582024-12-19T01:09:21.379ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88592024-12-19T01:09:21.379ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
88602024-12-19T01:09:21.379ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88612024-12-19T01:09:21.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88622024-12-19T01:09:21.381ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88632024-12-19T01:09:21.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88642024-12-19T01:09:21.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88652024-12-19T01:09:21.381ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88662024-12-19T01:09:21.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88672024-12-19T01:09:21.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
88682024-12-19T01:09:21.382ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
88692024-12-19T01:09:21.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88702024-12-19T01:09:21.382ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 00:59:21.375420660 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
88712024-12-19T01:09:21.382ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.825672ms iteration = 12 status = {"expiration":"2024-12-19T00:59:21.375420660Z","pruned":[]}
88722024-12-19T01:09:21.384ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88732024-12-19T01:09:21.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88742024-12-19T01:09:21.385ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.738582ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
88752024-12-19T01:09:21.386ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1450, tv_nsec: 228998694 } })
88762024-12-19T01:09:21.386ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88772024-12-19T01:09:21.386ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
88782024-12-19T01:09:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88792024-12-19T01:09:21.388ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88802024-12-19T01:09:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88812024-12-19T01:09:21.389ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88822024-12-19T01:09:21.389ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88832024-12-19T01:09:21.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88842024-12-19T01:09:21.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88852024-12-19T01:09:21.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88862024-12-19T01:09:21.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88872024-12-19T01:09:21.398ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88882024-12-19T01:09:21.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88892024-12-19T01:09:21.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88902024-12-19T01:09:21.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88912024-12-19T01:09:21.402ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.232789ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
88922024-12-19T01:09:21.403ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1450, tv_nsec: 246166677 } })
88932024-12-19T01:09:21.403ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
88942024-12-19T01:09:21.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88952024-12-19T01:09:21.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88962024-12-19T01:09:21.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88972024-12-19T01:09:21.405ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88982024-12-19T01:09:21.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88992024-12-19T01:09:21.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89002024-12-19T01:09:21.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89012024-12-19T01:09:21.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89022024-12-19T01:09:21.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 31.838682ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
89032024-12-19T01:09:21.410ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89042024-12-19T01:09:21.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89052024-12-19T01:09:21.411ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89062024-12-19T01:09:21.412ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89072024-12-19T01:09:21.412ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89082024-12-19T01:09:21.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89092024-12-19T01:09:21.414ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89102024-12-19T01:09:21.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89112024-12-19T01:09:21.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
89122024-12-19T01:09:21.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89132024-12-19T01:09:21.424ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89142024-12-19T01:09:21.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89152024-12-19T01:09:21.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89162024-12-19T01:09:21.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89172024-12-19T01:09:21.435ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89182024-12-19T01:09:21.435ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89192024-12-19T01:09:21.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89202024-12-19T01:09:21.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89212024-12-19T01:09:21.436ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1450, tv_nsec: 278768860 } })
89222024-12-19T01:09:21.436ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89232024-12-19T01:09:21.436ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
89242024-12-19T01:09:21.440ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
89252024-12-19T01:09:21.441ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89262024-12-19T01:09:21.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89272024-12-19T01:09:21.442ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89282024-12-19T01:09:21.442ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89292024-12-19T01:09:21.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89302024-12-19T01:09:21.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89312024-12-19T01:09:21.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89322024-12-19T01:09:21.444ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89332024-12-19T01:09:21.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89342024-12-19T01:09:21.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
89352024-12-19T01:09:21.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89362024-12-19T01:09:21.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89372024-12-19T01:09:21.450ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89382024-12-19T01:09:21.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89392024-12-19T01:09:21.450ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89402024-12-19T01:09:21.450ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89412024-12-19T01:09:21.450ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89422024-12-19T01:09:21.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89432024-12-19T01:09:21.451ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89442024-12-19T01:09:21.455ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89452024-12-19T01:09:21.455ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89462024-12-19T01:09:21.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89472024-12-19T01:09:21.460ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89482024-12-19T01:09:21.462ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89492024-12-19T01:09:21.462ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89502024-12-19T01:09:21.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89512024-12-19T01:09:21.465ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
89522024-12-19T01:09:21.465ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
89532024-12-19T01:09:21.465ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 90.291035ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
89542024-12-19T01:09:21.468ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
89552024-12-19T01:09:21.468ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
89562024-12-19T01:09:21.468ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
89572024-12-19T01:09:21.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89582024-12-19T01:09:21.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89592024-12-19T01:09:21.469ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
89602024-12-19T01:09:21.469ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.331201ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
89612024-12-19T01:09:21.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89622024-12-19T01:09:21.473ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89632024-12-19T01:09:21.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89642024-12-19T01:09:21.474ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
89652024-12-19T01:09:21.474ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
89662024-12-19T01:09:21.474ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
89672024-12-19T01:09:21.474ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89682024-12-19T01:09:21.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89692024-12-19T01:09:21.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89702024-12-19T01:09:21.474ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89712024-12-19T01:09:21.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89722024-12-19T01:09:21.475ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89732024-12-19T01:09:21.475ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89742024-12-19T01:09:21.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89752024-12-19T01:09:21.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89762024-12-19T01:09:21.478ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
89772024-12-19T01:09:21.478ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
89782024-12-19T01:09:21.478ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 103.218652ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
89792024-12-19T01:09:21.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fa3b7974-3c31-4acf-adaa-8bb52690841b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
89802024-12-19T01:09:21.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fa3b7974-3c31-4acf-adaa-8bb52690841b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
89812024-12-19T01:09:21.481ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
89822024-12-19T01:09:21.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
89832024-12-19T01:09:21.483ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
89842024-12-19T01:09:21.484ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
89852024-12-19T01:09:21.484ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 109.050041ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
89862024-12-19T01:09:21.486ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 111.282511ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89872024-12-19T01:09:21.488ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89882024-12-19T01:09:21.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89892024-12-19T01:09:21.490ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89902024-12-19T01:09:21.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89912024-12-19T01:09:21.490ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89922024-12-19T01:09:21.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89932024-12-19T01:09:21.494ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89942024-12-19T01:09:21.494ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
89952024-12-19T01:09:21.494ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.079977ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
89962024-12-19T01:09:21.496ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89972024-12-19T01:09:21.498ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89982024-12-19T01:09:21.498ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89992024-12-19T01:09:21.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90002024-12-19T01:09:21.515ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
90012024-12-19T01:09:21.618ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
90022024-12-19T01:09:21.618ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90032024-12-19T01:09:21.619ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b53a88c5-b428-4c96-8ada-9250309606cd", "content-length": "26", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} })
90042024-12-19T01:09:21.619ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90052024-12-19T01:09:21.622ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90062024-12-19T01:09:21.628ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
90072024-12-19T01:09:21.628ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90082024-12-19T01:09:21.628ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7942eae6-315f-48d8-9507-26825985d6b3", "content-length": "26", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} })
90092024-12-19T01:09:21.628ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90102024-12-19T01:09:21.630ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90112024-12-19T01:09:21.677ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
90122024-12-19T01:09:21.677ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "838155dc-1172-43db-ad75-82c501c260fe", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90132024-12-19T01:09:21.677ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90142024-12-19T01:09:21.680ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "da45a274-df73-4406-a945-59f604d31de1", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90152024-12-19T01:09:21.680ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90162024-12-19T01:09:21.682ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
90172024-12-19T01:09:21.682ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 307.214612ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
90182024-12-19T01:09:21.720ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
90192024-12-19T01:09:21.720ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90202024-12-19T01:09:21.721ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba0c34e3-2e65-4855-8c27-30f774e706dd", "content-length": "26", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} })
90212024-12-19T01:09:21.721ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90222024-12-19T01:09:21.724ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
90232024-12-19T01:09:21.761ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
90242024-12-19T01:09:21.762ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90252024-12-19T01:09:21.763ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "08ed6255-6176-4302-bfe5-59bb96cb9f7b", "content-length": "372", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} })
90262024-12-19T01:09:21.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90272024-12-19T01:09:21.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90282024-12-19T01:09:21.774ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
90292024-12-19T01:09:21.790ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90302024-12-19T01:09:21.791ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f23f71c5-ef14-4eef-a288-e3c89e27b2cc", "content-length": "691", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} })
90312024-12-19T01:09:21.791ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
90322024-12-19T01:09:21.791ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
90332024-12-19T01:09:21.791ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
90342024-12-19T01:09:21.793ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 418.012496ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90352024-12-19T01:09:21.794ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 418.604853ms iteration = 23 status = {}
90362024-12-19T01:09:21.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90372024-12-19T01:09:21.797ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90382024-12-19T01:09:21.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90392024-12-19T01:09:21.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90402024-12-19T01:09:21.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90412024-12-19T01:09:21.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90422024-12-19T01:09:21.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fa3b7974-3c31-4acf-adaa-8bb52690841b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
90432024-12-19T01:09:21.812ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90442024-12-19T01:09:21.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
90452024-12-19T01:09:21.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90462024-12-19T01:09:21.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90472024-12-19T01:09:21.820ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 445.182534ms iteration = 23 status = 0
90482024-12-19T01:09:21.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 468.834865ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
90492024-12-19T01:09:21.845ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 469.842329ms iteration = 23 status = {}
90502024-12-19T01:09:21.846ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
90512024-12-19T01:09:21.846ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
90522024-12-19T01:09:21.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90532024-12-19T01:09:21.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90542024-12-19T01:09:21.864ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T00:58:19.687181Z, time_modified: 2024-12-19T00:58:19.687181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }) }
90552024-12-19T01:09:21.864ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 489.438725ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]}},"default_endpoint":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
90562024-12-19T01:09:21.865ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 489.973722ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
90572024-12-19T01:09:21.875ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
90582024-12-19T01:09:21.875ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 0 version = 2
90592024-12-19T01:09:21.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90602024-12-19T01:09:21.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90612024-12-19T01:09:21.878ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90622024-12-19T01:09:21.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90632024-12-19T01:09:21.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90642024-12-19T01:09:21.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90652024-12-19T01:09:21.885ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 1 version = 2
90662024-12-19T01:09:21.885ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
90672024-12-19T01:09:21.885ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 00:59:02.707744 UTC dns_group = external generation = 2
90682024-12-19T01:09:21.885ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 510.164016ms iteration = 13 status = {"generation":2}
90692024-12-19T01:09:21.893ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
90702024-12-19T01:09:21.893ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90712024-12-19T01:09:21.893ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3b430e1f-f5b2-4a04-93da-c681a741f43d", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} })
90722024-12-19T01:09:21.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90732024-12-19T01:09:21.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90742024-12-19T01:09:21.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90752024-12-19T01:09:21.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90762024-12-19T01:09:21.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90772024-12-19T01:09:21.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90782024-12-19T01:09:21.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90792024-12-19T01:09:21.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90802024-12-19T01:09:21.901ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
90812024-12-19T01:09:21.901ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
90822024-12-19T01:09:21.901ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 00:59:01.994004 UTC dns_group = internal generation = 1
90832024-12-19T01:09:21.901ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 526.112783ms iteration = 13 status = {"generation":1}
90842024-12-19T01:09:21.902ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90852024-12-19T01:09:21.903ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "21c8cc7b-d4ae-452b-883a-170aacd0e449", "content-length": "1", "date": "Thu, 19 Dec 2024 01:09:20 GMT"} })
90862024-12-19T01:09:21.904ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90872024-12-19T01:09:21.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90882024-12-19T01:09:21.905ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90892024-12-19T01:09:21.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90902024-12-19T01:09:21.907ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 532.027714ms iteration = 23 status = null
90912024-12-19T01:09:21.909ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
90922024-12-19T01:09:21.909ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90932024-12-19T01:09:21.909ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "06e51342-fda1-4067-a500-3a56f4347fc3", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} })
90942024-12-19T01:09:21.909ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
90952024-12-19T01:09:21.910ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "befd97d8-fb65-4576-b114-5d732f90e252", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
90962024-12-19T01:09:21.910ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
90972024-12-19T01:09:21.912ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 536.830199ms iteration = 24 status = {}
90982024-12-19T01:09:21.913ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9613a736-1848-4294-8483-ac48dcce62d4", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
90992024-12-19T01:09:21.913ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91002024-12-19T01:09:21.915ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e42b8806-0131-4320-93c6-472d160fe70d", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91012024-12-19T01:09:21.915ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91022024-12-19T01:09:21.918ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91032024-12-19T01:09:21.918ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 542.937482ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
91042024-12-19T01:09:21.945ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
91052024-12-19T01:09:21.945ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 570.141271ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
91062024-12-19T01:09:21.947ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 572.30906ms iteration = 27 status = {"physical_disks_added":0}
91072024-12-19T01:09:21.994ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91082024-12-19T01:09:21.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91092024-12-19T01:09:21.997ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
91102024-12-19T01:09:21.997ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91112024-12-19T01:09:21.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91122024-12-19T01:09:22.011ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
91132024-12-19T01:09:22.011ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "694eb490-6ede-4227-b444-95096411bf29", "content-length": "134", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} })
91142024-12-19T01:09:22.011ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
91152024-12-19T01:09:22.011ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
91162024-12-19T01:09:22.012ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
91172024-12-19T01:09:22.012ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
91182024-12-19T01:09:22.012ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91192024-12-19T01:09:22.012ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91202024-12-19T01:09:22.012ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91212024-12-19T01:09:22.012ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91222024-12-19T01:09:22.012ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91232024-12-19T01:09:22.012ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91242024-12-19T01:09:22.012ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
91252024-12-19T01:09:22.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91262024-12-19T01:09:22.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91272024-12-19T01:09:22.015ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
91282024-12-19T01:09:22.015ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "99c816ba-164c-474a-99dd-d1f840b36537", "content-length": "2", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} })
91292024-12-19T01:09:22.015ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
91302024-12-19T01:09:22.015ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "76f9a267-3bdf-455b-939f-2d26aef9bfbb", "content-length": "52", "date": "Thu, 19 Dec 2024 01:09:21 GMT"} })
91312024-12-19T01:09:22.015ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
91322024-12-19T01:09:22.015ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
91332024-12-19T01:09:22.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 472f6e11-8de6-4e1e-8faf-e53f1c1f078b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
91342024-12-19T01:09:22.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 472f6e11-8de6-4e1e-8faf-e53f1c1f078b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
91352024-12-19T01:09:22.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 472f6e11-8de6-4e1e-8faf-e53f1c1f078b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
91362024-12-19T01:09:22.176ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "11a89db4-b218-4e31-88d3-bd179f35a9a3", "date": "Thu, 19 Dec 2024 01:09:22 GMT"} })
91372024-12-19T01:09:22.176ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
91382024-12-19T01:09:22.176ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91392024-12-19T01:09:22.176ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba8721e8-47ab-430d-b254-552248f9f552", "content-length": "682", "date": "Thu, 19 Dec 2024 01:09:22 GMT"} })
91402024-12-19T01:09:22.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91412024-12-19T01:09:22.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91422024-12-19T01:09:22.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91432024-12-19T01:09:22.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91442024-12-19T01:09:22.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91452024-12-19T01:09:22.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91462024-12-19T01:09:22.185ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91472024-12-19T01:09:22.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91482024-12-19T01:09:22.192ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 816.71406ms iteration = 23 status = {}
91492024-12-19T01:09:22.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f4d111c-7316-4446-9052-e566974bc26c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91502024-12-19T01:09:22.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f4d111c-7316-4446-9052-e566974bc26c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91512024-12-19T01:09:22.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f4d111c-7316-4446-9052-e566974bc26c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91522024-12-19T01:09:23.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0824f407-a2a8-4c6b-bf49-6321a54c0861 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91532024-12-19T01:09:23.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0824f407-a2a8-4c6b-bf49-6321a54c0861 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91542024-12-19T01:09:23.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0824f407-a2a8-4c6b-bf49-6321a54c0861 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91552024-12-19T01:09:24.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 92ad3f2e-ead1-4199-814b-dda03513e527 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91562024-12-19T01:09:24.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 92ad3f2e-ead1-4199-814b-dda03513e527 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91572024-12-19T01:09:24.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 92ad3f2e-ead1-4199-814b-dda03513e527 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91582024-12-19T01:09:25.772ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1283 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = fa35830d-16b0-4456-b2ff-e4fce3ad1616 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
91592024-12-19T01:09:25.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8a4812aa-6752-4c10-888d-bf627306dba8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91602024-12-19T01:09:25.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8a4812aa-6752-4c10-888d-bf627306dba8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91612024-12-19T01:09:25.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8a4812aa-6752-4c10-888d-bf627306dba8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91622024-12-19T01:09:26.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ba051502-3f86-445a-91be-37d66c959701 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91632024-12-19T01:09:26.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ba051502-3f86-445a-91be-37d66c959701 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91642024-12-19T01:09:26.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ba051502-3f86-445a-91be-37d66c959701 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91652024-12-19T01:09:27.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f2362dfd-e1a4-4a1b-85a0-f6d3015e6827 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91662024-12-19T01:09:27.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f2362dfd-e1a4-4a1b-85a0-f6d3015e6827 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91672024-12-19T01:09:27.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f2362dfd-e1a4-4a1b-85a0-f6d3015e6827 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91682024-12-19T01:09:28.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = da342752-56e7-450f-b179-8fe476ddc9e4 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91692024-12-19T01:09:28.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = da342752-56e7-450f-b179-8fe476ddc9e4 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91702024-12-19T01:09:28.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = da342752-56e7-450f-b179-8fe476ddc9e4 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91712024-12-19T01:09:29.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f57338ab-643e-454c-a44d-9f3237d46713 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91722024-12-19T01:09:29.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f57338ab-643e-454c-a44d-9f3237d46713 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91732024-12-19T01:09:29.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f57338ab-643e-454c-a44d-9f3237d46713 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91742024-12-19T01:09:31.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b28de089-fb33-46af-840b-b20e6dc1c075 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91752024-12-19T01:09:31.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b28de089-fb33-46af-840b-b20e6dc1c075 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91762024-12-19T01:09:31.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b28de089-fb33-46af-840b-b20e6dc1c075 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91772024-12-19T01:09:31.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
91782024-12-19T01:09:31.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91792024-12-19T01:09:31.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
91802024-12-19T01:09:31.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91812024-12-19T01:09:31.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91822024-12-19T01:09:31.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91832024-12-19T01:09:31.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91842024-12-19T01:09:31.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91852024-12-19T01:09:31.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91862024-12-19T01:09:31.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91872024-12-19T01:09:31.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91882024-12-19T01:09:31.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91892024-12-19T01:09:31.413ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91902024-12-19T01:09:31.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91912024-12-19T01:09:31.415ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.679699ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91922024-12-19T01:09:31.421ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91932024-12-19T01:09:31.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
91942024-12-19T01:09:31.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91952024-12-19T01:09:31.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91962024-12-19T01:09:31.433ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
91972024-12-19T01:09:31.433ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.496655ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
91982024-12-19T01:09:32.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 870ea219-601d-40ea-b886-d7d062387fd2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
91992024-12-19T01:09:32.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 870ea219-601d-40ea-b886-d7d062387fd2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92002024-12-19T01:09:32.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 870ea219-601d-40ea-b886-d7d062387fd2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92012024-12-19T01:09:33.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 64b1be88-09d3-4ec5-b37d-256270151700 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92022024-12-19T01:09:33.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 64b1be88-09d3-4ec5-b37d-256270151700 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92032024-12-19T01:09:33.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 64b1be88-09d3-4ec5-b37d-256270151700 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92042024-12-19T01:09:34.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7baa49d3-106c-4e4b-9522-14eefff3f006 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92052024-12-19T01:09:34.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7baa49d3-106c-4e4b-9522-14eefff3f006 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92062024-12-19T01:09:34.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7baa49d3-106c-4e4b-9522-14eefff3f006 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92072024-12-19T01:09:35.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = b66917ec-12b0-4ff0-900a-34353963a62d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
92082024-12-19T01:09:35.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = b66917ec-12b0-4ff0-900a-34353963a62d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
92092024-12-19T01:09:35.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = b66917ec-12b0-4ff0-900a-34353963a62d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
92102024-12-19T01:09:35.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 6f368ab6-8126-4bac-9bca-7127c03d0887 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
92112024-12-19T01:09:35.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 6f368ab6-8126-4bac-9bca-7127c03d0887 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
92122024-12-19T01:09:35.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 6f368ab6-8126-4bac-9bca-7127c03d0887 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
92132024-12-19T01:09:35.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = db316a2c-271c-4ed0-bef7-632314df21fe roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92142024-12-19T01:09:35.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = db316a2c-271c-4ed0-bef7-632314df21fe resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92152024-12-19T01:09:35.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = db316a2c-271c-4ed0-bef7-632314df21fe response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92162024-12-19T01:09:35.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 92210349-249e-493e-a9f6-feae445d27f8 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
92172024-12-19T01:09:35.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 92210349-249e-493e-a9f6-feae445d27f8 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
92182024-12-19T01:09:35.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 92210349-249e-493e-a9f6-feae445d27f8 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
92192024-12-19T01:09:35.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 00639dec-60bf-4735-b262-856776205b57 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
92202024-12-19T01:09:35.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 00639dec-60bf-4735-b262-856776205b57 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
92212024-12-19T01:09:35.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2780 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 00639dec-60bf-4735-b262-856776205b57 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
92222024-12-19T01:09:35.772ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1433 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = ba70601e-a0e4-483e-b58a-5e11ee78b69d response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
92232024-12-19T01:09:36.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f6c26521-1939-47bb-a4b1-4f8c41ffa048 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92242024-12-19T01:09:36.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f6c26521-1939-47bb-a4b1-4f8c41ffa048 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92252024-12-19T01:09:36.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f6c26521-1939-47bb-a4b1-4f8c41ffa048 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92262024-12-19T01:09:37.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c9bb1257-1189-4cab-901d-6433528f2ce8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92272024-12-19T01:09:37.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c9bb1257-1189-4cab-901d-6433528f2ce8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92282024-12-19T01:09:37.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c9bb1257-1189-4cab-901d-6433528f2ce8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92292024-12-19T01:09:38.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1fc51bc9-d3a0-4ea0-8b42-073c3e84bde9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92302024-12-19T01:09:38.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1fc51bc9-d3a0-4ea0-8b42-073c3e84bde9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92312024-12-19T01:09:38.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1fc51bc9-d3a0-4ea0-8b42-073c3e84bde9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92322024-12-19T01:09:39.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1af0ad61-8295-45f4-9926-879d63f4560f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92332024-12-19T01:09:39.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1af0ad61-8295-45f4-9926-879d63f4560f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92342024-12-19T01:09:39.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1af0ad61-8295-45f4-9926-879d63f4560f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92352024-12-19T01:09:40.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ccd9a42f-f6e4-4334-b87e-13035044790e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92362024-12-19T01:09:40.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ccd9a42f-f6e4-4334-b87e-13035044790e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92372024-12-19T01:09:40.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ccd9a42f-f6e4-4334-b87e-13035044790e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92382024-12-19T01:09:41.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 181a3815-0477-4fd7-87d1-05d2d2d44335 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92392024-12-19T01:09:41.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 181a3815-0477-4fd7-87d1-05d2d2d44335 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92402024-12-19T01:09:41.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 181a3815-0477-4fd7-87d1-05d2d2d44335 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92412024-12-19T01:09:41.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
92422024-12-19T01:09:41.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
92432024-12-19T01:09:41.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92442024-12-19T01:09:41.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92452024-12-19T01:09:41.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92462024-12-19T01:09:41.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92472024-12-19T01:09:41.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92482024-12-19T01:09:41.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92492024-12-19T01:09:41.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92502024-12-19T01:09:41.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92512024-12-19T01:09:41.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92522024-12-19T01:09:41.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92532024-12-19T01:09:41.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92542024-12-19T01:09:41.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
92552024-12-19T01:09:41.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92562024-12-19T01:09:41.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92572024-12-19T01:09:41.399ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
92582024-12-19T01:09:41.399ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.557089ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
92592024-12-19T01:09:41.413ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92602024-12-19T01:09:41.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92612024-12-19T01:09:41.415ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.76444ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92622024-12-19T01:09:42.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bd8f013e-779f-483e-8161-f9c7357e1bf3 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92632024-12-19T01:09:42.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bd8f013e-779f-483e-8161-f9c7357e1bf3 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92642024-12-19T01:09:42.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2767 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = bd8f013e-779f-483e-8161-f9c7357e1bf3 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92652024-12-19T01:09:42.758ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 807c9dac-06bf-4827-8ab6-4e7d2843a439 remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f4d427e-ebcd-4455-b716-980eb0058a63 uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-19T01:09:42.751239645Z }
92662024-12-19T01:09:42.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f4d427e-ebcd-4455-b716-980eb0058a63 roles = RoleSet { roles: {} } uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
92672024-12-19T01:09:42.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f4d427e-ebcd-4455-b716-980eb0058a63 resource = Database result = Ok(()) uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
92682024-12-19T01:09:42.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 17185 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8f4d427e-ebcd-4455-b716-980eb0058a63 response_code = 204 uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
92692024-12-19T01:09:42.769ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 807c9dac-06bf-4827-8ab6-4e7d2843a439 remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5f4eaeea-52c2-4451-a481-509023e9933f uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-19T01:09:42.768991286Z }
92702024-12-19T01:09:42.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5f4eaeea-52c2-4451-a481-509023e9933f roles = RoleSet { roles: {} } uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
92712024-12-19T01:09:42.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5f4eaeea-52c2-4451-a481-509023e9933f resource = Database result = Ok(()) uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
92722024-12-19T01:09:42.786ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:53198
92732024-12-19T01:09:42.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:53198 req_id = a7511a30-37b7-4a14-93fc-9c5f6d4013b9 roles = RoleSet { roles: {} } uri = /metrics/producers
92742024-12-19T01:09:42.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:53198 req_id = a7511a30-37b7-4a14-93fc-9c5f6d4013b9 resource = Database result = Ok(()) uri = /metrics/producers
92752024-12-19T01:09:42.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36943 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5f4eaeea-52c2-4451-a481-509023e9933f response_code = 204 uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
92762024-12-19T01:09:42.820ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 3351ff91-e235-41a8-aa20-009c343a2e26
92772024-12-19T01:09:42.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33842 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:53198 req_id = a7511a30-37b7-4a14-93fc-9c5f6d4013b9 response_code = 201 uri = /metrics/producers
92782024-12-19T01:09:43.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6fb78c6b-4e26-4908-b132-a0dcd61d9c82 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92792024-12-19T01:09:43.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6fb78c6b-4e26-4908-b132-a0dcd61d9c82 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92802024-12-19T01:09:43.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6fb78c6b-4e26-4908-b132-a0dcd61d9c82 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92812024-12-19T01:09:44.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 93bacc91-510a-418e-aa6c-c8b363c49456 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92822024-12-19T01:09:44.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 93bacc91-510a-418e-aa6c-c8b363c49456 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92832024-12-19T01:09:44.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 93bacc91-510a-418e-aa6c-c8b363c49456 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92842024-12-19T01:09:45.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 737e4262-1c90-478a-9e95-ef1affb257a2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92852024-12-19T01:09:45.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 737e4262-1c90-478a-9e95-ef1affb257a2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92862024-12-19T01:09:45.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 737e4262-1c90-478a-9e95-ef1affb257a2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92872024-12-19T01:09:45.772ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1380 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = f79be1ad-1625-489e-b425-3e81b6993f1e response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
92882024-12-19T01:09:46.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b93b9224-951a-4d49-b14a-477fdec8d36d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92892024-12-19T01:09:46.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b93b9224-951a-4d49-b14a-477fdec8d36d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92902024-12-19T01:09:46.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b93b9224-951a-4d49-b14a-477fdec8d36d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92912024-12-19T01:09:47.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 454b6090-3e2e-412d-956c-cf23d35372d1 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92922024-12-19T01:09:47.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 454b6090-3e2e-412d-956c-cf23d35372d1 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92932024-12-19T01:09:47.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 454b6090-3e2e-412d-956c-cf23d35372d1 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92942024-12-19T01:09:48.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 24aba88c-416c-4d34-90fd-477b3e8e4395 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92952024-12-19T01:09:48.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 24aba88c-416c-4d34-90fd-477b3e8e4395 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92962024-12-19T01:09:48.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 24aba88c-416c-4d34-90fd-477b3e8e4395 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92972024-12-19T01:09:49.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7372bf5c-5580-47da-bf01-45c3da285abb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92982024-12-19T01:09:49.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7372bf5c-5580-47da-bf01-45c3da285abb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
92992024-12-19T01:09:49.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7372bf5c-5580-47da-bf01-45c3da285abb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
93002024-12-19T01:09:50.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5ae4b19b-0114-4a24-a1e3-39159408f283 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
93012024-12-19T01:09:50.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5ae4b19b-0114-4a24-a1e3-39159408f283 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
93022024-12-19T01:09:50.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5ae4b19b-0114-4a24-a1e3-39159408f283 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
93032024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
93042024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
93052024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
93062024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
93072024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93082024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93092024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
93102024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93112024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
93122024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93132024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93142024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
93152024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
93162024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
93172024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93182024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
93192024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
93202024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
93212024-12-19T01:09:51.375ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
93222024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93232024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
93242024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93252024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
93262024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
93272024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93282024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
93292024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
93302024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
93312024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93322024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
93332024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93342024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
93352024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93362024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
93372024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93382024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93392024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93402024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93412024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93422024-12-19T01:09:51.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93432024-12-19T01:09:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
93442024-12-19T01:09:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93452024-12-19T01:09:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
93462024-12-19T01:09:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93472024-12-19T01:09:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93482024-12-19T01:09:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93492024-12-19T01:09:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93502024-12-19T01:09:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
93512024-12-19T01:09:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93522024-12-19T01:09:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93532024-12-19T01:09:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93542024-12-19T01:09:51.377ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93552024-12-19T01:09:51.377ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93562024-12-19T01:09:51.378ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.96938ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
93572024-12-19T01:09:51.380ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93582024-12-19T01:09:51.380ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93592024-12-19T01:09:51.380ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93602024-12-19T01:09:51.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93612024-12-19T01:09:51.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93622024-12-19T01:09:51.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93632024-12-19T01:09:51.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93642024-12-19T01:09:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93652024-12-19T01:09:51.381ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93662024-12-19T01:09:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93672024-12-19T01:09:51.383ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93682024-12-19T01:09:51.385ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1480, tv_nsec: 227896428 } })
93692024-12-19T01:09:51.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93702024-12-19T01:09:51.385ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
93712024-12-19T01:09:51.386ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93722024-12-19T01:09:51.386ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93732024-12-19T01:09:51.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93742024-12-19T01:09:51.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93752024-12-19T01:09:51.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93762024-12-19T01:09:51.389ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93772024-12-19T01:09:51.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93782024-12-19T01:09:51.390ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1480, tv_nsec: 233147779 } })
93792024-12-19T01:09:51.390ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
93802024-12-19T01:09:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93812024-12-19T01:09:51.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93822024-12-19T01:09:51.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93832024-12-19T01:09:51.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93842024-12-19T01:09:51.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93852024-12-19T01:09:51.403ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93862024-12-19T01:09:51.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93872024-12-19T01:09:51.405ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1480, tv_nsec: 248181753 } })
93882024-12-19T01:09:51.405ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
93892024-12-19T01:09:51.410ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93902024-12-19T01:09:51.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
93912024-12-19T01:09:51.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93922024-12-19T01:09:51.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93932024-12-19T01:09:51.418ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93942024-12-19T01:09:51.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93952024-12-19T01:09:51.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93962024-12-19T01:09:51.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93972024-12-19T01:09:51.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93982024-12-19T01:09:51.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93992024-12-19T01:09:51.428ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94002024-12-19T01:09:51.428ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94012024-12-19T01:09:51.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94022024-12-19T01:09:51.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
94032024-12-19T01:09:51.431ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94042024-12-19T01:09:51.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
94052024-12-19T01:09:51.431ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
94062024-12-19T01:09:51.431ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.055822ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
94072024-12-19T01:09:51.435ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.60696ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
94082024-12-19T01:09:51.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
94092024-12-19T01:09:51.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
94102024-12-19T01:09:51.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.147219ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
94112024-12-19T01:09:51.445ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94122024-12-19T01:09:51.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94132024-12-19T01:09:51.448ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94142024-12-19T01:09:51.448ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
94152024-12-19T01:09:51.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94162024-12-19T01:09:51.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94172024-12-19T01:09:51.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94182024-12-19T01:09:51.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94192024-12-19T01:09:51.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94202024-12-19T01:09:51.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94212024-12-19T01:09:51.458ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94222024-12-19T01:09:51.461ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
94232024-12-19T01:09:51.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
94242024-12-19T01:09:51.462ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94252024-12-19T01:09:51.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
94262024-12-19T01:09:51.462ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94272024-12-19T01:09:51.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94282024-12-19T01:09:51.464ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94292024-12-19T01:09:51.464ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94302024-12-19T01:09:51.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94312024-12-19T01:09:51.464ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.990679ms iteration = 24 status = 0
94322024-12-19T01:09:51.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 39d0c57d-841e-4305-a4c6-785cd266393d roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
94332024-12-19T01:09:51.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 39d0c57d-841e-4305-a4c6-785cd266393d resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
94342024-12-19T01:09:51.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 39d0c57d-841e-4305-a4c6-785cd266393d response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
94352024-12-19T01:09:51.469ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
94362024-12-19T01:09:51.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
94372024-12-19T01:09:51.474ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.248547ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94382024-12-19T01:09:51.476ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 101.195835ms iteration = 28 status = {"physical_disks_added":0}
94392024-12-19T01:09:51.477ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 102.227128ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94402024-12-19T01:09:51.484ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94412024-12-19T01:09:51.484ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94422024-12-19T01:09:51.484ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.242944ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
94432024-12-19T01:09:51.504ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 129.037242ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
94442024-12-19T01:09:51.514ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
94452024-12-19T01:09:51.514ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94462024-12-19T01:09:51.514ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d04b624-6317-4f3e-b500-be7aa81c2a3f", "content-length": "26", "date": "Thu, 19 Dec 2024 01:09:51 GMT"} })
94472024-12-19T01:09:51.514ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94482024-12-19T01:09:51.517ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.406861ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
94492024-12-19T01:09:51.517ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94502024-12-19T01:09:51.521ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94512024-12-19T01:09:51.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94522024-12-19T01:09:51.544ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
94532024-12-19T01:09:51.544ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94542024-12-19T01:09:51.544ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2da59696-7157-4248-8375-b650adc4553d", "content-length": "26", "date": "Thu, 19 Dec 2024 01:09:51 GMT"} })
94552024-12-19T01:09:51.544ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94562024-12-19T01:09:51.545ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94572024-12-19T01:09:51.592ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439/state
94582024-12-19T01:09:51.598ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd840928-8f91-4b8d-95e9-cdfc9389a3b1", "content-length": "130", "date": "Thu, 19 Dec 2024 01:09:51 GMT"} })
94592024-12-19T01:09:51.601ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 sled_id = de9bec7d-f8ce-44a0-879c-5e088768f91c state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-19T01:09:42.768991286Z }, migration_in: None, migration_out: None } vmm_id = 807c9dac-06bf-4827-8ab6-4e7d2843a439
94602024-12-19T01:09:51.601ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2116 instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 807c9dac-06bf-4827-8ab6-4e7d2843a439 sled_id = de9bec7d-f8ce-44a0-879c-5e088768f91c vmm_id = 807c9dac-06bf-4827-8ab6-4e7d2843a439 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-19T01:09:42.768991286Z }
94612024-12-19T01:09:51.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 roles = RoleSet { roles: {} } sled_id = de9bec7d-f8ce-44a0-879c-5e088768f91c vmm_id = 807c9dac-06bf-4827-8ab6-4e7d2843a439
94622024-12-19T01:09:51.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 resource = Database result = Ok(()) sled_id = de9bec7d-f8ce-44a0-879c-5e088768f91c vmm_id = 807c9dac-06bf-4827-8ab6-4e7d2843a439
94632024-12-19T01:09:51.612ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
94642024-12-19T01:09:51.612ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94652024-12-19T01:09:51.612ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d31e1e6-a27f-449c-9bbc-187d69729b49", "content-length": "26", "date": "Thu, 19 Dec 2024 01:09:51 GMT"} })
94662024-12-19T01:09:51.612ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94672024-12-19T01:09:51.614ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
94682024-12-19T01:09:51.649ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94692024-12-19T01:09:51.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94702024-12-19T01:09:51.678ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
94712024-12-19T01:09:51.679ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94722024-12-19T01:09:51.679ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cbf0ee6-876d-4261-9bfa-0c61b9eb195c", "content-length": "581", "date": "Thu, 19 Dec 2024 01:09:51 GMT"} })
94732024-12-19T01:09:51.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94742024-12-19T01:09:51.679ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 304.300832ms iteration = 24 status = {}
94752024-12-19T01:09:51.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94762024-12-19T01:09:51.681ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94772024-12-19T01:09:51.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94782024-12-19T01:09:51.684ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94792024-12-19T01:09:51.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94802024-12-19T01:09:51.690ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
94812024-12-19T01:09:51.690ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "aafc2556-20b5-4e4d-bf79-8ec28f784bfb", "content-length": "1", "date": "Thu, 19 Dec 2024 01:09:51 GMT"} })
94822024-12-19T01:09:51.692ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94832024-12-19T01:09:51.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94842024-12-19T01:09:51.695ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 319.63377ms iteration = 24 status = null
94852024-12-19T01:09:51.700ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {2aa1db5d-9b5c-4679-b0fc-a689dfdf0c13: {10.151.2.175: {4adfe2d7-5ea8-460f-955e-a23ce87027ea}, 10.151.2.176: {4adfe2d7-5ea8-460f-955e-a23ce87027ea}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
94862024-12-19T01:09:51.700ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
94872024-12-19T01:09:51.700ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3d6357d3-9012-4b2c-8c0a-7f8478e9f996", "date": "Thu, 19 Dec 2024 01:09:51 GMT"} })
94882024-12-19T01:09:51.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94892024-12-19T01:09:51.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94902024-12-19T01:09:51.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94912024-12-19T01:09:51.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94922024-12-19T01:09:51.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94932024-12-19T01:09:51.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94942024-12-19T01:09:51.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94952024-12-19T01:09:51.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94962024-12-19T01:09:51.711ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94972024-12-19T01:09:51.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94982024-12-19T01:09:51.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94992024-12-19T01:09:51.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95002024-12-19T01:09:51.717ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
95012024-12-19T01:09:51.719ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 344.328356ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
95022024-12-19T01:09:51.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95032024-12-19T01:09:51.725ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95042024-12-19T01:09:51.725ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
95052024-12-19T01:09:51.725ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
95062024-12-19T01:09:51.725ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6257468b-86da-4d8f-940a-f32304c016d5", "date": "Thu, 19 Dec 2024 01:09:51 GMT"} })
95072024-12-19T01:09:51.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95082024-12-19T01:09:51.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95092024-12-19T01:09:51.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95102024-12-19T01:09:51.727ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 351.543584ms iteration = 25 status = {}
95112024-12-19T01:09:51.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95122024-12-19T01:09:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95132024-12-19T01:09:51.779ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
95142024-12-19T01:09:51.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95152024-12-19T01:09:51.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95162024-12-19T01:09:51.791ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
95172024-12-19T01:09:51.792ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "636f775e-4a77-4da2-89e6-c9fb993b6a02", "content-length": "134", "date": "Thu, 19 Dec 2024 01:09:51 GMT"} })
95182024-12-19T01:09:51.792ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
95192024-12-19T01:09:51.792ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
95202024-12-19T01:09:51.792ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
95212024-12-19T01:09:51.792ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
95222024-12-19T01:09:51.792ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95232024-12-19T01:09:51.792ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95242024-12-19T01:09:51.792ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95252024-12-19T01:09:51.792ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95262024-12-19T01:09:51.793ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95272024-12-19T01:09:51.793ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95282024-12-19T01:09:51.793ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
95292024-12-19T01:09:51.793ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95302024-12-19T01:09:51.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95312024-12-19T01:09:51.796ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
95322024-12-19T01:09:51.796ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "570bfda5-706f-4032-a57c-b693d9ce8e9e", "content-length": "2", "date": "Thu, 19 Dec 2024 01:09:51 GMT"} })
95332024-12-19T01:09:51.796ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
95342024-12-19T01:09:51.796ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5ce4064-9381-4286-9e5d-9a9599dea25c", "content-length": "52", "date": "Thu, 19 Dec 2024 01:09:51 GMT"} })
95352024-12-19T01:09:51.796ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
95362024-12-19T01:09:51.796ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
95372024-12-19T01:09:51.829ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
95382024-12-19T01:09:51.905ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "51bd5b0d-7e8c-4fd6-a77b-5e1a047fba2c", "date": "Thu, 19 Dec 2024 01:09:51 GMT"} })
95392024-12-19T01:09:51.905ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
95402024-12-19T01:09:51.905ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
95412024-12-19T01:09:51.906ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2e03a9e-a0c9-4fdc-9237-fe3082ec9140", "content-length": "682", "date": "Thu, 19 Dec 2024 01:09:51 GMT"} })
95422024-12-19T01:09:51.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95432024-12-19T01:09:51.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95442024-12-19T01:09:51.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95452024-12-19T01:09:51.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95462024-12-19T01:09:51.911ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "231e0963-23cb-4b17-a6b2-5c81ee3fb6b2", "content-length": "809", "date": "Thu, 19 Dec 2024 01:09:51 GMT"} })
95472024-12-19T01:09:51.911ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(456258) }} sled = sock
95482024-12-19T01:09:51.911ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
95492024-12-19T01:09:51.911ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
95502024-12-19T01:09:51.913ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 538.098466ms iteration = 24 status = {}
95512024-12-19T01:09:51.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95522024-12-19T01:09:51.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95532024-12-19T01:09:51.918ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95542024-12-19T01:09:51.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95552024-12-19T01:09:51.926ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 550.676927ms iteration = 24 status = {}
95562024-12-19T01:09:52.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e910edd-7827-4319-abea-0e44a61ed539 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
95572024-12-19T01:09:52.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e910edd-7827-4319-abea-0e44a61ed539 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
95582024-12-19T01:09:52.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1756 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e910edd-7827-4319-abea-0e44a61ed539 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
95592024-12-19T01:09:52.661ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 807c9dac-06bf-4827-8ab6-4e7d2843a439 remote_addr = [fd00:1122:3344:101::1]:54085 req_id = eb681e1e-427a-4143-ac89-d2d47c41ffc2 uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-19T01:09:52.661029483Z }
95602024-12-19T01:09:52.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = eb681e1e-427a-4143-ac89-d2d47c41ffc2 roles = RoleSet { roles: {} } uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95612024-12-19T01:09:52.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = eb681e1e-427a-4143-ac89-d2d47c41ffc2 resource = Database result = Ok(()) uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95622024-12-19T01:09:52.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11673 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = eb681e1e-427a-4143-ac89-d2d47c41ffc2 response_code = 204 uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95632024-12-19T01:09:53.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = d5546f47-85b3-498d-a0fa-d06cb6c069f2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
95642024-12-19T01:09:53.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = d5546f47-85b3-498d-a0fa-d06cb6c069f2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
95652024-12-19T01:09:53.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = d5546f47-85b3-498d-a0fa-d06cb6c069f2 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
95662024-12-19T01:09:53.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 68604244-a740-4fd6-8313-c923294d92a1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
95672024-12-19T01:09:53.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 68604244-a740-4fd6-8313-c923294d92a1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
95682024-12-19T01:09:53.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 68604244-a740-4fd6-8313-c923294d92a1 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
95692024-12-19T01:09:53.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a6d10004-eb8f-4aac-9394-b616dbe8d831 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
95702024-12-19T01:09:53.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a6d10004-eb8f-4aac-9394-b616dbe8d831 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
95712024-12-19T01:09:53.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a6d10004-eb8f-4aac-9394-b616dbe8d831 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
95722024-12-19T01:09:54.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2dc2b1c2-c55a-49d1-8293-c72bdb531a80 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
95732024-12-19T01:09:54.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2dc2b1c2-c55a-49d1-8293-c72bdb531a80 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
95742024-12-19T01:09:54.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2dc2b1c2-c55a-49d1-8293-c72bdb531a80 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
95752024-12-19T01:09:55.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = ae81a266-fd04-42e9-a888-3142a1950a63 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
95762024-12-19T01:09:55.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = ae81a266-fd04-42e9-a888-3142a1950a63 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
95772024-12-19T01:09:55.074ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 807c9dac-06bf-4827-8ab6-4e7d2843a439 remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-19T01:09:55.073992606Z }
95782024-12-19T01:09:55.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 roles = RoleSet { roles: {} } uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95792024-12-19T01:09:55.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 resource = Database result = Ok(()) uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95802024-12-19T01:09:55.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = ae81a266-fd04-42e9-a888-3142a1950a63 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
95812024-12-19T01:09:55.082ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 807c9dac-06bf-4827-8ab6-4e7d2843a439 remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439 vmm_needs_update = true
95822024-12-19T01:09:55.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 roles = RoleSet { roles: {} } uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95832024-12-19T01:09:55.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 resource = Database result = Ok(()) uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95842024-12-19T01:09:55.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 roles = RoleSet { roles: {} } uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95852024-12-19T01:09:55.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 resource = Database result = Ok(()) uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95862024-12-19T01:09:55.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 roles = RoleSet { roles: {} } uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95872024-12-19T01:09:55.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 resource = Database result = Ok(()) uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95882024-12-19T01:09:55.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 roles = RoleSet { roles: {} } uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95892024-12-19T01:09:55.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 resource = Database result = Ok(()) uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95902024-12-19T01:09:55.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 roles = RoleSet { roles: {} } uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95912024-12-19T01:09:55.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 resource = Database result = Ok(()) uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95922024-12-19T01:09:55.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 roles = RoleSet { roles: {} } uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95932024-12-19T01:09:55.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 resource = Database result = Ok(()) uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95942024-12-19T01:09:55.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95952024-12-19T01:09:55.097ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2bb141b0-74b5-460d-b8be-8fc9331a3779, lookup_type: ById(2bb141b0-74b5-460d-b8be-8fc9331a3779) }, key: 403bdcb1-ef82-4052-98e6-aed235a6917e, lookup_type: ById(403bdcb1-ef82-4052-98e6-aed235a6917e) }, key: 3351ff91-e235-41a8-aa20-009c343a2e26, lookup_type: ById(3351ff91-e235-41a8-aa20-009c343a2e26) } result = Ok(()) uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95962024-12-19T01:09:55.097ZINFOnexus (dropshot_internal): starting update saga for 3351ff91-e235-41a8-aa20-009c343a2e26 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-19T01:09:55.073992606Z }
95972024-12-19T01:09:55.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23667 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 response_code = 204 uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95982024-12-19T01:09:55.097ZDEBGnexus (dropshot_internal): preparing instance-update saga for 3351ff91-e235-41a8-aa20-009c343a2e26... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f8d829b5-d4b5-4857-9236-58f369387835 uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
95992024-12-19T01:09:55.097ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update
96002024-12-19T01:09:55.097ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"3351ff91-e235-41a8-aa20-009c343a2e26","lookup_type":{"ById":"3351ff91-e235-41a8-aa20-009c343a2e26"},"parent":{"key":"403bdcb1-ef82-4052-98e6-aed235a6917e","lookup_type":{"ById":"403bdcb1-ef82-4052-98e6-aed235a6917e"},"parent":{"key":"2bb141b0-74b5-460d-b8be-8fc9331a3779","lookup_type":{"ById":"2bb141b0-74b5-460d-b8be-8fc9331a3779"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96012024-12-19T01:09:55.097ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update
96022024-12-19T01:09:55.098ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 807c9dac-06bf-4827-8ab6-4e7d2843a439 remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 41b2ee7a-94cf-4ba3-be32-762a13f48bbd uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-19T01:09:55.073992606Z }
96032024-12-19T01:09:55.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 41b2ee7a-94cf-4ba3-be32-762a13f48bbd roles = RoleSet { roles: {} } uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
96042024-12-19T01:09:55.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 41b2ee7a-94cf-4ba3-be32-762a13f48bbd resource = Database result = Ok(()) uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
96052024-12-19T01:09:55.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29588 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 41b2ee7a-94cf-4ba3-be32-762a13f48bbd response_code = 204 uri = /vmms/807c9dac-06bf-4827-8ab6-4e7d2843a439
96062024-12-19T01:09:55.128ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update
96072024-12-19T01:09:55.128ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96082024-12-19T01:09:55.128ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96092024-12-19T01:09:55.128ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627
96102024-12-19T01:09:55.132ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96112024-12-19T01:09:55.132ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627
96122024-12-19T01:09:55.135ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96132024-12-19T01:09:55.135ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627
96142024-12-19T01:09:55.138ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96152024-12-19T01:09:55.138ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d69a5ab3-5a30-4f8d-ab85-178420afa041")) node_id = 0 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627
96162024-12-19T01:09:55.141ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96172024-12-19T01:09:55.141ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627
96182024-12-19T01:09:55.144ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update
96192024-12-19T01:09:55.144ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96202024-12-19T01:09:55.145ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96212024-12-19T01:09:55.149ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96222024-12-19T01:09:55.150ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96232024-12-19T01:09:55.151ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96242024-12-19T01:09:55.152ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96252024-12-19T01:09:55.153ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96262024-12-19T01:09:55.153ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96272024-12-19T01:09:55.154ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96282024-12-19T01:09:55.154ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96292024-12-19T01:09:55.156ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96302024-12-19T01:09:55.156ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96312024-12-19T01:09:55.157ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96322024-12-19T01:09:55.160ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2bb141b0-74b5-460d-b8be-8fc9331a3779, lookup_type: ById(2bb141b0-74b5-460d-b8be-8fc9331a3779) }, key: 403bdcb1-ef82-4052-98e6-aed235a6917e, lookup_type: ById(403bdcb1-ef82-4052-98e6-aed235a6917e) }, key: 3351ff91-e235-41a8-aa20-009c343a2e26, lookup_type: ById(3351ff91-e235-41a8-aa20-009c343a2e26) } result = Ok(()) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96332024-12-19T01:09:55.160ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance updater_id = d69a5ab3-5a30-4f8d-ab85-178420afa041
96342024-12-19T01:09:55.160ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96352024-12-19T01:09:55.160ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96362024-12-19T01:09:55.169ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance updater_id = d69a5ab3-5a30-4f8d-ab85-178420afa041
96372024-12-19T01:09:55.169ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96382024-12-19T01:09:55.169ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance
96392024-12-19T01:09:55.176ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 locked_gen = Generation(Generation(2)) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = LockInstance updater_id = d69a5ab3-5a30-4f8d-ab85-178420afa041
96402024-12-19T01:09:55.176ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96412024-12-19T01:09:55.176ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d69a5ab3-5a30-4f8d-ab85-178420afa041")}) node_id = 1 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627
96422024-12-19T01:09:55.179ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96432024-12-19T01:09:55.179ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627
96442024-12-19T01:09:55.182ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96452024-12-19T01:09:55.182ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96462024-12-19T01:09:55.184ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96472024-12-19T01:09:55.184ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96482024-12-19T01:09:55.185ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96492024-12-19T01:09:55.185ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96502024-12-19T01:09:55.186ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96512024-12-19T01:09:55.189ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2bb141b0-74b5-460d-b8be-8fc9331a3779, lookup_type: ById(2bb141b0-74b5-460d-b8be-8fc9331a3779) }, key: 403bdcb1-ef82-4052-98e6-aed235a6917e, lookup_type: ById(403bdcb1-ef82-4052-98e6-aed235a6917e) }, key: 3351ff91-e235-41a8-aa20-009c343a2e26, lookup_type: ById(3351ff91-e235-41a8-aa20-009c343a2e26) } result = Ok(()) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96522024-12-19T01:09:55.189ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96532024-12-19T01:09:55.189ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
96542024-12-19T01:09:55.200ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 807c9dac-06bf-4827-8ab6-4e7d2843a439, time_created: 2024-12-19T01:09:34.420677Z, time_deleted: None, instance_id: 3351ff91-e235-41a8-aa20-009c343a2e26, sled_id: de9bec7d-f8ce-44a0-879c-5e088768f91c, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-19T01:09:55.073992Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-19T01:09:32.320294Z, gen: Generation(Generation(3)), propolis_id: Some(807c9dac-06bf-4827-8ab6-4e7d2843a439), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(807c9dac-06bf-4827-8ab6-4e7d2843a439 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-19T01:09:55.200334092Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
96552024-12-19T01:09:55.200ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
96562024-12-19T01:09:55.203ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"3351ff91-e235-41a8-aa20-009c343a2e26","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"807c9dac-06bf-4827-8ab6-4e7d2843a439"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"3351ff91-e235-41a8-aa20-009c343a2e26","lookup_type":{"ById":"3351ff91-e235-41a8-aa20-009c343a2e26"},"parent":{"key":"403bdcb1-ef82-4052-98e6-aed235a6917e","lookup_type":{"ById":"403bdcb1-ef82-4052-98e6-aed235a6917e"},"parent":{"key":"2bb141b0-74b5-460d-b8be-8fc9331a3779","lookup_type":{"ById":"2bb141b0-74b5-460d-b8be-8fc9331a3779"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"d69a5ab3-5a30-4f8d-ab85-178420afa041"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"403bdcb1-ef82-4052-98e6-aed235a6917e","ram_diff":1073741824},"destroy_active_vmm":"807c9dac-06bf-4827-8ab6-4e7d2843a439","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-19T01:09:55.200334092Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96572024-12-19T01:09:55.203ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
96582024-12-19T01:09:55.233ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
96592024-12-19T01:09:55.233ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96602024-12-19T01:09:55.233ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96612024-12-19T01:09:55.233ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
96622024-12-19T01:09:55.236ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96632024-12-19T01:09:55.236ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
96642024-12-19T01:09:55.239ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96652024-12-19T01:09:55.239ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
96662024-12-19T01:09:55.242ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96672024-12-19T01:09:55.242ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("dcd16b6e-fc7b-4d2d-a70e-c25c4a754bc1")) node_id = 0 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
96682024-12-19T01:09:55.246ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96692024-12-19T01:09:55.246ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
96702024-12-19T01:09:55.251ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 parent_lock = UpdaterLock { updater_id: d69a5ab3-5a30-4f8d-ab85-178420afa041, locked_gen: Generation(Generation(2)) } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
96712024-12-19T01:09:55.251ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = BecomeUpdater
96722024-12-19T01:09:55.252ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = BecomeUpdater
96732024-12-19T01:09:55.262ZDEBGnexus (SagaExecutor): inherited lock from d69a5ab3-5a30-4f8d-ab85-178420afa041 to dcd16b6e-fc7b-4d2d-a70e-c25c4a754bc1 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = d69a5ab3-5a30-4f8d-ab85-178420afa041 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = BecomeUpdater updater_id = dcd16b6e-fc7b-4d2d-a70e-c25c4a754bc1
96742024-12-19T01:09:55.262ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
96752024-12-19T01:09:55.262ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96762024-12-19T01:09:55.262ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("dcd16b6e-fc7b-4d2d-a70e-c25c4a754bc1")}) node_id = 1 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
96772024-12-19T01:09:55.265ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96782024-12-19T01:09:55.265ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
96792024-12-19T01:09:55.268ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96802024-12-19T01:09:55.268ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
96812024-12-19T01:09:55.271ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
96822024-12-19T01:09:55.271ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
96832024-12-19T01:09:55.277ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
96842024-12-19T01:09:55.279ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26
96852024-12-19T01:09:55.282ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = UpdateNetworkConfig
96862024-12-19T01:09:55.282ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = UpdateNetworkConfig
96872024-12-19T01:09:55.284ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = UpdateNetworkConfig
96882024-12-19T01:09:55.284ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = UpdateNetworkConfig
96892024-12-19T01:09:55.289ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
96902024-12-19T01:09:55.289ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = UpdateNetworkConfig
96912024-12-19T01:09:55.289ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = UpdateNetworkConfig
96922024-12-19T01:09:55.291ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
96932024-12-19T01:09:55.291ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
96942024-12-19T01:09:55.291ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
96952024-12-19T01:09:55.292ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
96962024-12-19T01:09:55.294ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
96972024-12-19T01:09:55.294ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
96982024-12-19T01:09:55.294ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
96992024-12-19T01:09:55.298ZDEBGnexus: notifying dendrite of updates instance_id = Some(3351ff91-e235-41a8-aa20-009c343a2e26 (instance)) switch = switch0
97002024-12-19T01:09:55.298ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1484, tv_nsec: 141053222 } })
97012024-12-19T01:09:55.298ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
97022024-12-19T01:09:55.329ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
97032024-12-19T01:09:55.329ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97042024-12-19T01:09:55.329ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4664a6fe-0969-40ae-95e5-95693af28c4a", "content-length": "26", "date": "Thu, 19 Dec 2024 01:09:55 GMT"} })
97052024-12-19T01:09:55.329ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97062024-12-19T01:09:55.330ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97072024-12-19T01:09:55.360ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
97082024-12-19T01:09:55.360ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b7ebce5-ec4f-4419-b2a8-d6f55c792704", "content-length": "4", "date": "Thu, 19 Dec 2024 01:09:54 GMT"} })
97092024-12-19T01:09:55.362ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97102024-12-19T01:09:55.362ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97112024-12-19T01:09:55.365ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97122024-12-19T01:09:55.365ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97132024-12-19T01:09:55.369ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
97142024-12-19T01:09:55.369ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
97152024-12-19T01:09:55.381ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-19T01:09:55.372227Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, time_modified: Some(2024-12-19T01:09:55.372227Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 403bdcb1-ef82-4052-98e6-aed235a6917e, time_modified: Some(2024-12-19T01:09:55.372227Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
97162024-12-19T01:09:55.381ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97172024-12-19T01:09:55.381ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97182024-12-19T01:09:55.385ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97192024-12-19T01:09:55.385ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97202024-12-19T01:09:55.388ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
97212024-12-19T01:09:55.390ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = UnassignOximeterProducer
97222024-12-19T01:09:55.390ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = UnassignOximeterProducer
97232024-12-19T01:09:55.395ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 producer_id = 3351ff91-e235-41a8-aa20-009c343a2e26 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
97242024-12-19T01:09:55.395ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = UnassignOximeterProducer
97252024-12-19T01:09:55.395ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = UnassignOximeterProducer
97262024-12-19T01:09:55.430ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 3351ff91-e235-41a8-aa20-009c343a2e26 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
97272024-12-19T01:09:55.433ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 3351ff91-e235-41a8-aa20-009c343a2e26 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/3351ff91-e235-41a8-aa20-009c343a2e26
97282024-12-19T01:09:55.457ZDEBGnexus (SagaExecutor): client response oximeter-collector = 3351ff91-e235-41a8-aa20-009c343a2e26 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/3351ff91-e235-41a8-aa20-009c343a2e26", status: 204, headers: {"x-request-id": "b2e52408-d964-4be7-b49d-38276e7545ac", "date": "Thu, 19 Dec 2024 01:09:55 GMT"} }) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
97292024-12-19T01:09:55.457ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 producer_id = 3351ff91-e235-41a8-aa20-009c343a2e26 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
97302024-12-19T01:09:55.459ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97312024-12-19T01:09:55.459ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97322024-12-19T01:09:55.462ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97332024-12-19T01:09:55.462ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97342024-12-19T01:09:55.468ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 lock = UpdaterLock { updater_id: dcd16b6e-fc7b-4d2d-a70e-c25c4a754bc1, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-19T01:09:55.200334092Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
97352024-12-19T01:09:55.471ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = CommitInstanceUpdates
97362024-12-19T01:09:55.471ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = CommitInstanceUpdates
97372024-12-19T01:09:55.506ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 new_runtime = InstanceRuntimeState { time_updated: 2024-12-19T01:09:55.200334092Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
97382024-12-19T01:09:55.506ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97392024-12-19T01:09:55.506ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97402024-12-19T01:09:55.506ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
97412024-12-19T01:09:55.506ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
97422024-12-19T01:09:55.506ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97432024-12-19T01:09:55.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97442024-12-19T01:09:55.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97452024-12-19T01:09:55.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97462024-12-19T01:09:55.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97472024-12-19T01:09:55.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97482024-12-19T01:09:55.509ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97492024-12-19T01:09:55.509ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97502024-12-19T01:09:55.510ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97512024-12-19T01:09:55.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97522024-12-19T01:09:55.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97532024-12-19T01:09:55.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97542024-12-19T01:09:55.513ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97552024-12-19T01:09:55.513ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97562024-12-19T01:09:55.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97572024-12-19T01:09:55.513ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97582024-12-19T01:09:55.513ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("3351ff91-e235-41a8-aa20-009c343a2e26"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("807c9dac-06bf-4827-8ab6-4e7d2843a439")}) node_id = 7 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97592024-12-19T01:09:55.517ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97602024-12-19T01:09:55.517ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97612024-12-19T01:09:55.520ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97622024-12-19T01:09:55.520ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97632024-12-19T01:09:55.524ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97642024-12-19T01:09:55.524ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97652024-12-19T01:09:55.528ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 propolis_id = 807c9dac-06bf-4827-8ab6-4e7d2843a439 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
97662024-12-19T01:09:55.528ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = ReleaseSledResources
97672024-12-19T01:09:55.528ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = ReleaseSledResources
97682024-12-19T01:09:55.546ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
97692024-12-19T01:09:55.546ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
97702024-12-19T01:09:55.547ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dae9fef0-0155-4e92-a52f-49dbdff572ab", "content-length": "372", "date": "Thu, 19 Dec 2024 01:09:55 GMT"} })
97712024-12-19T01:09:55.547ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97722024-12-19T01:09:55.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97732024-12-19T01:09:55.551ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97742024-12-19T01:09:55.551ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97752024-12-19T01:09:55.554ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97762024-12-19T01:09:55.554ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97772024-12-19T01:09:55.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5690d5e7-556a-4700-93a4-ce8359d21521 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
97782024-12-19T01:09:55.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5690d5e7-556a-4700-93a4-ce8359d21521 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
97792024-12-19T01:09:55.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 5690d5e7-556a-4700-93a4-ce8359d21521 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
97802024-12-19T01:09:55.560ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 propolis_id = 807c9dac-06bf-4827-8ab6-4e7d2843a439 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
97812024-12-19T01:09:55.560ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = MarkVmmDeleted
97822024-12-19T01:09:55.560ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = MarkVmmDeleted
97832024-12-19T01:09:55.568ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97842024-12-19T01:09:55.568ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97852024-12-19T01:09:55.571ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97862024-12-19T01:09:55.571ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97872024-12-19T01:09:55.575ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97882024-12-19T01:09:55.575ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97892024-12-19T01:09:55.578ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
97902024-12-19T01:09:55.578ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
97912024-12-19T01:09:55.581ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = ChainSuccessorSaga
97922024-12-19T01:09:55.582ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = ChainSuccessorSaga
97932024-12-19T01:09:55.583ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = ChainSuccessorSaga
97942024-12-19T01:09:55.583ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = ChainSuccessorSaga
97952024-12-19T01:09:55.585ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = ChainSuccessorSaga
97962024-12-19T01:09:55.585ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = ChainSuccessorSaga
97972024-12-19T01:09:55.589ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {2aa1db5d-9b5c-4679-b0fc-a689dfdf0c13: {10.151.2.175: {4adfe2d7-5ea8-460f-955e-a23ce87027ea}, 10.151.2.176: {4adfe2d7-5ea8-460f-955e-a23ce87027ea}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
97982024-12-19T01:09:55.589ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
97992024-12-19T01:09:55.589ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "779c3879-d4f3-4a47-b312-8cba2e320831", "date": "Thu, 19 Dec 2024 01:09:55 GMT"} })
98002024-12-19T01:09:55.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98012024-12-19T01:09:55.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98022024-12-19T01:09:55.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98032024-12-19T01:09:55.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98042024-12-19T01:09:55.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98052024-12-19T01:09:55.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98062024-12-19T01:09:55.599ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98072024-12-19T01:09:55.599ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98082024-12-19T01:09:55.600ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c640d76d-7db1-4619-adb2-b45097a07cbd", "date": "Thu, 19 Dec 2024 01:09:55 GMT"} })
98092024-12-19T01:09:55.602ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 95.939013ms iteration = 26 status = {}
98102024-12-19T01:09:55.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98112024-12-19T01:09:55.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98122024-12-19T01:09:55.614ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98132024-12-19T01:09:55.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98142024-12-19T01:09:55.615ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98152024-12-19T01:09:55.617ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98162024-12-19T01:09:55.617ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98172024-12-19T01:09:55.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98182024-12-19T01:09:55.619ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98192024-12-19T01:09:55.621ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = ChainSuccessorSaga
98202024-12-19T01:09:55.621ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98212024-12-19T01:09:55.621ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98222024-12-19T01:09:55.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98232024-12-19T01:09:55.624ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 2bb141b0-74b5-460d-b8be-8fc9331a3779, lookup_type: ById(2bb141b0-74b5-460d-b8be-8fc9331a3779) }, key: 403bdcb1-ef82-4052-98e6-aed235a6917e, lookup_type: ById(403bdcb1-ef82-4052-98e6-aed235a6917e) }, key: 3351ff91-e235-41a8-aa20-009c343a2e26, lookup_type: ById(3351ff91-e235-41a8-aa20-009c343a2e26) } result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = ChainSuccessorSaga
98242024-12-19T01:09:55.624ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = ChainSuccessorSaga
98252024-12-19T01:09:55.624ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_node = ChainSuccessorSaga
98262024-12-19T01:09:55.629ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update
98272024-12-19T01:09:55.629ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
98282024-12-19T01:09:55.629ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
98292024-12-19T01:09:55.633ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
98302024-12-19T01:09:55.633ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
98312024-12-19T01:09:55.636ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
98322024-12-19T01:09:55.636ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
98332024-12-19T01:09:55.639ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
98342024-12-19T01:09:55.639ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8
98352024-12-19T01:09:55.654ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98362024-12-19T01:09:55.654ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "aeadc56e-3e06-4a70-a26c-de559e27da0d", "content-length": "691", "date": "Thu, 19 Dec 2024 01:09:55 GMT"} })
98372024-12-19T01:09:55.654ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
98382024-12-19T01:09:55.654ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
98392024-12-19T01:09:55.654ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
98402024-12-19T01:09:55.655ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 149.49709ms iteration = 25 status = {}
98412024-12-19T01:09:55.692ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
98422024-12-19T01:09:55.692ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 saga_name = instance-update saga_result = SagaResult { saga_id: 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8, saga_log: SagaLog { saga_id: 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("dcd16b6e-fc7b-4d2d-a70e-c25c4a754bc1")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("dcd16b6e-fc7b-4d2d-a70e-c25c4a754bc1")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("3351ff91-e235-41a8-aa20-009c343a2e26"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("807c9dac-06bf-4827-8ab6-4e7d2843a439")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("3351ff91-e235-41a8-aa20-009c343a2e26"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("807c9dac-06bf-4827-8ab6-4e7d2843a439")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("dcd16b6e-fc7b-4d2d-a70e-c25c4a754bc1"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("dcd16b6e-fc7b-4d2d-a70e-c25c4a754bc1")}} }) }
98432024-12-19T01:09:55.692ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 8ded6b42-eec4-4ddd-a780-38f9e3dcf2e8 instance_id = 3351ff91-e235-41a8-aa20-009c343a2e26 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update
98442024-12-19T01:09:55.692ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
98452024-12-19T01:09:55.692ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627
98462024-12-19T01:09:55.695ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
98472024-12-19T01:09:55.695ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627
98482024-12-19T01:09:55.699ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
98492024-12-19T01:09:55.699ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627
98502024-12-19T01:09:55.702ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
98512024-12-19T01:09:55.702ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627
98522024-12-19T01:09:55.708ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update sec_id = 1176f008-4a9d-4835-a5aa-1a86ec3c619c
98532024-12-19T01:09:55.709ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 4d8682e8-7e2b-41c5-ac98-a5e391fc2627 saga_name = start-instance-update saga_result = SagaResult { saga_id: 4d8682e8-7e2b-41c5-ac98-a5e391fc2627, saga_log: SagaLog { saga_id: 4d8682e8-7e2b-41c5-ac98-a5e391fc2627, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("d69a5ab3-5a30-4f8d-ab85-178420afa041")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d69a5ab3-5a30-4f8d-ab85-178420afa041")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("d69a5ab3-5a30-4f8d-ab85-178420afa041"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("d69a5ab3-5a30-4f8d-ab85-178420afa041")}} }) }
98542024-12-19T01:09:55.772ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1537 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = d232df9b-1564-4cd4-9fd8-44397f9571bb response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
98552024-12-19T01:09:56.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 44f1acd6-1ba7-49f3-9951-d00b95b1b18e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
98562024-12-19T01:09:56.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 44f1acd6-1ba7-49f3-9951-d00b95b1b18e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
98572024-12-19T01:09:56.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2541 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 44f1acd6-1ba7-49f3-9951-d00b95b1b18e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
98582024-12-19T01:09:56.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 426729f8-e972-433a-9f4e-97182fe35f2f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98592024-12-19T01:09:56.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 426729f8-e972-433a-9f4e-97182fe35f2f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98602024-12-19T01:09:56.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 426729f8-e972-433a-9f4e-97182fe35f2f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98612024-12-19T01:09:57.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 711546e3-4809-4f21-9d44-49d20d71ab9e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
98622024-12-19T01:09:57.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 711546e3-4809-4f21-9d44-49d20d71ab9e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
98632024-12-19T01:09:57.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 711546e3-4809-4f21-9d44-49d20d71ab9e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
98642024-12-19T01:09:57.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2fb61ae1-81ec-49e2-bd62-318a313f6b07 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98652024-12-19T01:09:57.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2fb61ae1-81ec-49e2-bd62-318a313f6b07 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98662024-12-19T01:09:57.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2fb61ae1-81ec-49e2-bd62-318a313f6b07 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98672024-12-19T01:09:58.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 75c5006a-f2ec-4986-bc9a-64d63db18230 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98682024-12-19T01:09:58.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 75c5006a-f2ec-4986-bc9a-64d63db18230 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98692024-12-19T01:09:58.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 75c5006a-f2ec-4986-bc9a-64d63db18230 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98702024-12-19T01:09:59.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f4b76f42-53e8-418c-9b3e-333127147bb9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98712024-12-19T01:09:59.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f4b76f42-53e8-418c-9b3e-333127147bb9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98722024-12-19T01:09:59.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f4b76f42-53e8-418c-9b3e-333127147bb9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98732024-12-19T01:10:00.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 84762aa6-c382-4907-8630-6d344c16d986 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98742024-12-19T01:10:00.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 84762aa6-c382-4907-8630-6d344c16d986 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98752024-12-19T01:10:00.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 84762aa6-c382-4907-8630-6d344c16d986 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98762024-12-19T01:10:01.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
98772024-12-19T01:10:01.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
98782024-12-19T01:10:01.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98792024-12-19T01:10:01.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98802024-12-19T01:10:01.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98812024-12-19T01:10:01.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98822024-12-19T01:10:01.377ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98832024-12-19T01:10:01.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98842024-12-19T01:10:01.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98852024-12-19T01:10:01.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98862024-12-19T01:10:01.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98872024-12-19T01:10:01.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98882024-12-19T01:10:01.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98892024-12-19T01:10:01.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98902024-12-19T01:10:01.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98912024-12-19T01:10:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
98922024-12-19T01:10:01.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98932024-12-19T01:10:01.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98942024-12-19T01:10:01.399ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
98952024-12-19T01:10:01.399ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.785353ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
98962024-12-19T01:10:01.410ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.407941ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98972024-12-19T01:10:01.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 935b0212-529b-4a88-bdc0-051b627889fe roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98982024-12-19T01:10:01.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 935b0212-529b-4a88-bdc0-051b627889fe resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
98992024-12-19T01:10:01.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 935b0212-529b-4a88-bdc0-051b627889fe response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99002024-12-19T01:10:02.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 24ac749e-84f6-4b10-9b7c-384cbc4cdc59 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99012024-12-19T01:10:02.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 24ac749e-84f6-4b10-9b7c-384cbc4cdc59 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99022024-12-19T01:10:02.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 24ac749e-84f6-4b10-9b7c-384cbc4cdc59 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99032024-12-19T01:10:03.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c500167a-4a6f-4f4f-852d-68195814b8f2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99042024-12-19T01:10:03.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c500167a-4a6f-4f4f-852d-68195814b8f2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99052024-12-19T01:10:03.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c500167a-4a6f-4f4f-852d-68195814b8f2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99062024-12-19T01:10:04.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ac8a4183-1427-407a-b9e6-f7e5dee368bb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99072024-12-19T01:10:04.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ac8a4183-1427-407a-b9e6-f7e5dee368bb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99082024-12-19T01:10:04.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ac8a4183-1427-407a-b9e6-f7e5dee368bb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99092024-12-19T01:10:05.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = fb40d984-ca93-4d61-9827-38b6fd75b544 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
99102024-12-19T01:10:05.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = fb40d984-ca93-4d61-9827-38b6fd75b544 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
99112024-12-19T01:10:05.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = fb40d984-ca93-4d61-9827-38b6fd75b544 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?sort_by=id_ascending
99122024-12-19T01:10:05.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 1d8fc077-0335-497a-a0fd-5e56b78ffb50 roles = RoleSet { roles: {} } uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
99132024-12-19T01:10:05.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 1d8fc077-0335-497a-a0fd-5e56b78ffb50 resource = Database result = Ok(()) uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
99142024-12-19T01:10:05.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:45377 req_id = 1d8fc077-0335-497a-a0fd-5e56b78ffb50 response_code = 200 uri = /metrics/collectors/b4e7d6e3-7551-4da8-8529-1286ef6ee8a3/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlMWE4M2JhNC1lYzlmLTRjYzEtYWUyOS0wYWI1ZjZiMjExZjkifX0%3D
99152024-12-19T01:10:05.772ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1541 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 4bd8d5d2-84a7-4026-b5a4-b88d169d1ca7 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
99162024-12-19T01:10:05.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 10ed85d0-2aa7-45dc-80b1-5161fbcff1d5 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99172024-12-19T01:10:05.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 10ed85d0-2aa7-45dc-80b1-5161fbcff1d5 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99182024-12-19T01:10:05.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 10ed85d0-2aa7-45dc-80b1-5161fbcff1d5 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99192024-12-19T01:10:06.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b4c99910-ccf0-4f9c-9d4a-39e988b5360e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99202024-12-19T01:10:06.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b4c99910-ccf0-4f9c-9d4a-39e988b5360e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99212024-12-19T01:10:06.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = b4c99910-ccf0-4f9c-9d4a-39e988b5360e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99222024-12-19T01:10:07.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d42d51d6-f95b-46e2-96f8-8bc364e58a67 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99232024-12-19T01:10:07.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d42d51d6-f95b-46e2-96f8-8bc364e58a67 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99242024-12-19T01:10:07.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d42d51d6-f95b-46e2-96f8-8bc364e58a67 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99252024-12-19T01:10:08.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ce8d449c-bece-4107-ad51-bcf8bc07a05b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99262024-12-19T01:10:08.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ce8d449c-bece-4107-ad51-bcf8bc07a05b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99272024-12-19T01:10:08.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ce8d449c-bece-4107-ad51-bcf8bc07a05b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99282024-12-19T01:10:09.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c79a4f25-67f0-4902-9993-c6f842f881fd roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99292024-12-19T01:10:09.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c79a4f25-67f0-4902-9993-c6f842f881fd resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99302024-12-19T01:10:09.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = c79a4f25-67f0-4902-9993-c6f842f881fd response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99312024-12-19T01:10:10.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 77fd7b3d-b342-4e34-8a65-6c16263de688 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99322024-12-19T01:10:10.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 77fd7b3d-b342-4e34-8a65-6c16263de688 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99332024-12-19T01:10:10.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 77fd7b3d-b342-4e34-8a65-6c16263de688 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99342024-12-19T01:10:11.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
99352024-12-19T01:10:11.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
99362024-12-19T01:10:11.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99372024-12-19T01:10:11.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99382024-12-19T01:10:11.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99392024-12-19T01:10:11.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99402024-12-19T01:10:11.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99412024-12-19T01:10:11.379ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99422024-12-19T01:10:11.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99432024-12-19T01:10:11.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99442024-12-19T01:10:11.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99452024-12-19T01:10:11.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99462024-12-19T01:10:11.382ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 7.232828ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99472024-12-19T01:10:11.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99482024-12-19T01:10:11.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99492024-12-19T01:10:11.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99502024-12-19T01:10:11.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
99512024-12-19T01:10:11.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99522024-12-19T01:10:11.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99532024-12-19T01:10:11.396ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
99542024-12-19T01:10:11.396ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.902854ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
99552024-12-19T01:10:11.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cc5b061c-02bf-4df8-a75e-564c04079fcf roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99562024-12-19T01:10:11.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cc5b061c-02bf-4df8-a75e-564c04079fcf resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99572024-12-19T01:10:11.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = cc5b061c-02bf-4df8-a75e-564c04079fcf response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99582024-12-19T01:10:12.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0b05c66a-9554-4ba3-93ad-9a99efa7587b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99592024-12-19T01:10:12.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0b05c66a-9554-4ba3-93ad-9a99efa7587b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99602024-12-19T01:10:12.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0b05c66a-9554-4ba3-93ad-9a99efa7587b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99612024-12-19T01:10:13.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1974c5c3-154a-4313-8974-fcce41e9e6d7 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99622024-12-19T01:10:13.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1974c5c3-154a-4313-8974-fcce41e9e6d7 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99632024-12-19T01:10:13.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1974c5c3-154a-4313-8974-fcce41e9e6d7 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99642024-12-19T01:10:14.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3b50e180-4e52-41ac-a9b7-edacdea66de5 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99652024-12-19T01:10:14.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3b50e180-4e52-41ac-a9b7-edacdea66de5 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99662024-12-19T01:10:14.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3b50e180-4e52-41ac-a9b7-edacdea66de5 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99672024-12-19T01:10:15.773ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1441 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 1e5baa1c-08c3-492f-8511-97d3b787c40a response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
99682024-12-19T01:10:15.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6ecac7d0-b9de-406a-bd09-f2af9311eed5 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99692024-12-19T01:10:15.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6ecac7d0-b9de-406a-bd09-f2af9311eed5 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99702024-12-19T01:10:15.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6ecac7d0-b9de-406a-bd09-f2af9311eed5 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99712024-12-19T01:10:17.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d7e71947-db4b-44cb-8009-c202ce16b64a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99722024-12-19T01:10:17.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d7e71947-db4b-44cb-8009-c202ce16b64a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99732024-12-19T01:10:17.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d7e71947-db4b-44cb-8009-c202ce16b64a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99742024-12-19T01:10:18.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e8c006f-ee17-4488-b694-fcb3fdada3cf roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99752024-12-19T01:10:18.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e8c006f-ee17-4488-b694-fcb3fdada3cf resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99762024-12-19T01:10:18.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 8e8c006f-ee17-4488-b694-fcb3fdada3cf response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99772024-12-19T01:10:19.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = be614524-bbe3-4d37-8de3-853a7ada06cd roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99782024-12-19T01:10:19.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = be614524-bbe3-4d37-8de3-853a7ada06cd resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99792024-12-19T01:10:19.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = be614524-bbe3-4d37-8de3-853a7ada06cd response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99802024-12-19T01:10:20.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0f830e89-e86b-47ab-a85a-d39eb1c40d5e roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99812024-12-19T01:10:20.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0f830e89-e86b-47ab-a85a-d39eb1c40d5e resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99822024-12-19T01:10:20.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0f830e89-e86b-47ab-a85a-d39eb1c40d5e response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99832024-12-19T01:10:21.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a4736420-3436-43bc-b70f-6e2d8aed2058 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99842024-12-19T01:10:21.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a4736420-3436-43bc-b70f-6e2d8aed2058 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99852024-12-19T01:10:21.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = a4736420-3436-43bc-b70f-6e2d8aed2058 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
99862024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
99872024-12-19T01:10:21.375ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
99882024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
99892024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99902024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
99912024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
99922024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
99932024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
99942024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
99952024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99962024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
99972024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
99982024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
99992024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
100002024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
100012024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100022024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100032024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
100042024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
100052024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
100062024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100072024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
100082024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100092024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
100102024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100112024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
100122024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
100132024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100142024-12-19T01:10:21.375ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a
100152024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
100162024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.68\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a"}
100172024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
100182024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100192024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
100202024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
100212024-12-19T01:10:21.375ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
100222024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
100232024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
100242024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
100252024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100262024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
100272024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
100282024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100292024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100302024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
100312024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100322024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
100332024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
100342024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
100352024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100362024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
100372024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100382024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
100392024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100402024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
100412024-12-19T01:10:21.375ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-19 01:00:21.375519972 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
100422024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
100432024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
100442024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
100452024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
100462024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
100472024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100482024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100492024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
100502024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
100512024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
100522024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100532024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100542024-12-19T01:10:21.375ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2a880a2e-2471-4fd8-9ad5-3e0c3fbde317.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("679d67b5-9925-49ac-b78d-613e816394dc.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1510, tv_nsec: 218137153 } })
100552024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100562024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100572024-12-19T01:10:21.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100582024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100592024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100602024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100612024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
100622024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100632024-12-19T01:10:21.376ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0018a454-75c0-41b1-be69-9476391f01e1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("050cdbd7-4ebc-471c-b4dc-ec1b3741f763.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("2eb2a760-6b2b-4fdd-a606-eabb932aebf9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1510, tv_nsec: 218407316 } })
100642024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100652024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100662024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100672024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100682024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100692024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
100702024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100712024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
100722024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
100732024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100742024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100752024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
100762024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100772024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100782024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100792024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100802024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
100812024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.046454ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
100822024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100832024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100842024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100852024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100862024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
100872024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.222147ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
100882024-12-19T01:10:21.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100892024-12-19T01:10:21.378ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100902024-12-19T01:10:21.379ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.259827ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
100912024-12-19T01:10:21.379ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100922024-12-19T01:10:21.380ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
100932024-12-19T01:10:21.380ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
100942024-12-19T01:10:21.380ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100952024-12-19T01:10:21.380ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
100962024-12-19T01:10:21.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100972024-12-19T01:10:21.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100982024-12-19T01:10:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100992024-12-19T01:10:21.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101002024-12-19T01:10:21.381ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101012024-12-19T01:10:21.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101022024-12-19T01:10:21.382ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101032024-12-19T01:10:21.382ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
101042024-12-19T01:10:21.382ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101052024-12-19T01:10:21.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101062024-12-19T01:10:21.382ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101072024-12-19T01:10:21.383ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.162781ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
101082024-12-19T01:10:21.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
101092024-12-19T01:10:21.383ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101102024-12-19T01:10:21.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101112024-12-19T01:10:21.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101122024-12-19T01:10:21.384ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101132024-12-19T01:10:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101142024-12-19T01:10:21.385ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101152024-12-19T01:10:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101162024-12-19T01:10:21.385ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101172024-12-19T01:10:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101182024-12-19T01:10:21.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101192024-12-19T01:10:21.386ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1510, tv_nsec: 228655935 } })
101202024-12-19T01:10:21.386ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
101212024-12-19T01:10:21.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101222024-12-19T01:10:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101232024-12-19T01:10:21.388ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101242024-12-19T01:10:21.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101252024-12-19T01:10:21.388ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101262024-12-19T01:10:21.388ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1510, tv_nsec: 231127969 } })
101272024-12-19T01:10:21.389ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
101282024-12-19T01:10:21.390ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
101292024-12-19T01:10:21.390ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
101302024-12-19T01:10:21.390ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 14.76398ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
101312024-12-19T01:10:21.390ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-19 01:00:21.375519972 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
101322024-12-19T01:10:21.390ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.240967ms iteration = 13 status = {"expiration":"2024-12-19T01:00:21.375519972Z","pruned":[]}
101332024-12-19T01:10:21.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
101342024-12-19T01:10:21.391ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
101352024-12-19T01:10:21.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
101362024-12-19T01:10:21.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 20.220944ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
101372024-12-19T01:10:21.396ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.752662ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
101382024-12-19T01:10:21.398ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101392024-12-19T01:10:21.400ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101402024-12-19T01:10:21.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
101412024-12-19T01:10:21.403ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101422024-12-19T01:10:21.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101432024-12-19T01:10:21.403ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101442024-12-19T01:10:21.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101452024-12-19T01:10:21.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101462024-12-19T01:10:21.403ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101472024-12-19T01:10:21.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101482024-12-19T01:10:21.405ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101492024-12-19T01:10:21.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101502024-12-19T01:10:21.405ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101512024-12-19T01:10:21.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101522024-12-19T01:10:21.408ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101532024-12-19T01:10:21.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101542024-12-19T01:10:21.415ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101552024-12-19T01:10:21.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101562024-12-19T01:10:21.417ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1510, tv_nsec: 259402183 } })
101572024-12-19T01:10:21.417ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
101582024-12-19T01:10:21.421ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101592024-12-19T01:10:21.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101602024-12-19T01:10:21.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 48.150684ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101612024-12-19T01:10:21.428ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101622024-12-19T01:10:21.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
101632024-12-19T01:10:21.432ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101642024-12-19T01:10:21.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101652024-12-19T01:10:21.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101662024-12-19T01:10:21.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101672024-12-19T01:10:21.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101682024-12-19T01:10:21.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101692024-12-19T01:10:21.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101702024-12-19T01:10:21.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101712024-12-19T01:10:21.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101722024-12-19T01:10:21.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
101732024-12-19T01:10:21.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101742024-12-19T01:10:21.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101752024-12-19T01:10:21.454ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101762024-12-19T01:10:21.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101772024-12-19T01:10:21.459ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101782024-12-19T01:10:21.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101792024-12-19T01:10:21.466ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 91.600704ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
101802024-12-19T01:10:21.471ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101812024-12-19T01:10:21.473ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101822024-12-19T01:10:21.477ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101832024-12-19T01:10:21.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101842024-12-19T01:10:21.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101852024-12-19T01:10:21.477ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101862024-12-19T01:10:21.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101872024-12-19T01:10:21.477ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101882024-12-19T01:10:21.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101892024-12-19T01:10:21.480ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101902024-12-19T01:10:21.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101912024-12-19T01:10:21.481ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101922024-12-19T01:10:21.481ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101932024-12-19T01:10:21.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101942024-12-19T01:10:21.481ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101952024-12-19T01:10:21.482ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
101962024-12-19T01:10:21.482ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101972024-12-19T01:10:21.482ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
101982024-12-19T01:10:21.482ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 106.967252ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
101992024-12-19T01:10:21.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102002024-12-19T01:10:21.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102012024-12-19T01:10:21.493ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
102022024-12-19T01:10:21.493ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 118.263326ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
102032024-12-19T01:10:21.495ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102042024-12-19T01:10:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102052024-12-19T01:10:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102062024-12-19T01:10:21.495ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102072024-12-19T01:10:21.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102082024-12-19T01:10:21.500ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
102092024-12-19T01:10:21.500ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
102102024-12-19T01:10:21.500ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
102112024-12-19T01:10:21.500ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102122024-12-19T01:10:21.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102132024-12-19T01:10:21.502ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102142024-12-19T01:10:21.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102152024-12-19T01:10:21.502ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
102162024-12-19T01:10:21.502ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
102172024-12-19T01:10:21.502ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 127.040745ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
102182024-12-19T01:10:21.503ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102192024-12-19T01:10:21.506ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102202024-12-19T01:10:21.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102212024-12-19T01:10:21.506ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
102222024-12-19T01:10:21.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102232024-12-19T01:10:21.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
102242024-12-19T01:10:21.514ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
102252024-12-19T01:10:21.521ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 146.122254ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102262024-12-19T01:10:21.524ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
102272024-12-19T01:10:21.525ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102282024-12-19T01:10:21.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102292024-12-19T01:10:21.533ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
102302024-12-19T01:10:21.533ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
102312024-12-19T01:10:21.533ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
102322024-12-19T01:10:21.533ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102332024-12-19T01:10:21.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102342024-12-19T01:10:21.562ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
102352024-12-19T01:10:21.562ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102362024-12-19T01:10:21.562ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44e5b8df-ae5c-410b-93de-6981b3ca0b93", "content-length": "26", "date": "Thu, 19 Dec 2024 01:10:21 GMT"} })
102372024-12-19T01:10:21.562ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102382024-12-19T01:10:21.564ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
102392024-12-19T01:10:21.567ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102402024-12-19T01:10:21.567ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102412024-12-19T01:10:21.567ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f12c585d-acdd-4336-b721-24af53e93430", "content-length": "26", "date": "Thu, 19 Dec 2024 01:10:21 GMT"} })
102422024-12-19T01:10:21.567ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102432024-12-19T01:10:21.568ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102442024-12-19T01:10:21.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102452024-12-19T01:10:21.571ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102462024-12-19T01:10:21.571ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102472024-12-19T01:10:21.571ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "62f01a2a-08b7-4620-978c-cc2323aece22", "content-length": "26", "date": "Thu, 19 Dec 2024 01:10:21 GMT"} })
102482024-12-19T01:10:21.571ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102492024-12-19T01:10:21.575ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102502024-12-19T01:10:21.577ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102512024-12-19T01:10:21.644ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102522024-12-19T01:10:21.645ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102532024-12-19T01:10:21.645ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "64180ff3-3982-4e1d-aea6-446dd3f06ec0", "content-length": "372", "date": "Thu, 19 Dec 2024 01:10:21 GMT"} })
102542024-12-19T01:10:21.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102552024-12-19T01:10:21.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102562024-12-19T01:10:21.647ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 272.642173ms iteration = 6 status = {"nsuccess":5}
102572024-12-19T01:10:21.649ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102582024-12-19T01:10:21.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102592024-12-19T01:10:21.651ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 275.777405ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
102602024-12-19T01:10:21.653ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
102612024-12-19T01:10:21.653ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102622024-12-19T01:10:21.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102632024-12-19T01:10:21.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102642024-12-19T01:10:21.655ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102652024-12-19T01:10:21.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102662024-12-19T01:10:21.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102672024-12-19T01:10:21.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102682024-12-19T01:10:21.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102692024-12-19T01:10:21.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102702024-12-19T01:10:21.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102712024-12-19T01:10:21.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102722024-12-19T01:10:21.685ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
102732024-12-19T01:10:21.686ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0333e0c2-40b2-4519-8b46-3879766faa21", "date": "Thu, 19 Dec 2024 01:10:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102742024-12-19T01:10:21.686ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102752024-12-19T01:10:21.688ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c16be403-e5fc-4f45-a57f-2dce5c195b9f", "date": "Thu, 19 Dec 2024 01:10:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102762024-12-19T01:10:21.688ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102772024-12-19T01:10:21.690ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102782024-12-19T01:10:21.690ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 314.896536ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
102792024-12-19T01:10:21.694ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102802024-12-19T01:10:21.694ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102812024-12-19T01:10:21.694ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 319.240455ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102822024-12-19T01:10:21.703ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102832024-12-19T01:10:21.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
102842024-12-19T01:10:21.707ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102852024-12-19T01:10:21.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102862024-12-19T01:10:21.709ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
102872024-12-19T01:10:21.713ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
102882024-12-19T01:10:21.713ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
102892024-12-19T01:10:21.713ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102902024-12-19T01:10:21.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102912024-12-19T01:10:21.714ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-19T00:58:19.687181Z, time_modified: 2024-12-19T00:58:19.687181Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, db_silo: Silo { identity: SiloIdentity { id: 2bb141b0-74b5-460d-b8be-8fc9331a3779, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-19T00:59:02.650327Z, time_modified: 2024-12-19T00:59:02.650327Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
102922024-12-19T01:10:21.714ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 339.025484ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]}},"default_endpoint":{"silo_id":"2bb141b0-74b5-460d-b8be-8fc9331a3779","tls_certs":["a983f7cb3f7c04032020560fe3ce9f51356d58577fb523cdaf30f7b0a66a6f61"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
102932024-12-19T01:10:21.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102942024-12-19T01:10:21.719ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 343.96222ms iteration = 25 status = 0
102952024-12-19T01:10:21.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102962024-12-19T01:10:21.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102972024-12-19T01:10:21.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102982024-12-19T01:10:21.721ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
102992024-12-19T01:10:21.721ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103002024-12-19T01:10:21.721ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f0b453e7-2895-4bd5-9e4a-8b01df1cdf78", "date": "Thu, 19 Dec 2024 01:10:21 GMT"} })
103012024-12-19T01:10:21.721ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103022024-12-19T01:10:21.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103032024-12-19T01:10:21.722ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = bc158d7c-813b-484d-8e67-63641677ff3a dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
103042024-12-19T01:10:21.722ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
103052024-12-19T01:10:21.722ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-19 00:59:01.994004 UTC dns_group = internal generation = 1
103062024-12-19T01:10:21.722ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 347.417768ms iteration = 14 status = {"generation":1}
103072024-12-19T01:10:21.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103082024-12-19T01:10:21.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103092024-12-19T01:10:21.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103102024-12-19T01:10:21.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103112024-12-19T01:10:21.729ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
103122024-12-19T01:10:21.729ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 0 version = 2
103132024-12-19T01:10:21.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103142024-12-19T01:10:21.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103152024-12-19T01:10:21.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103162024-12-19T01:10:21.732ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103172024-12-19T01:10:21.732ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103182024-12-19T01:10:21.733ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "76fac38a-cecc-49da-bdc5-64a9961402ae", "date": "Thu, 19 Dec 2024 01:10:21 GMT"} })
103192024-12-19T01:10:21.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
103202024-12-19T01:10:21.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103212024-12-19T01:10:21.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103222024-12-19T01:10:21.735ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 359.943808ms iteration = 27 status = {}
103232024-12-19T01:10:21.736ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 28f7d5e6-e7ca-4d92-9087-8b787d1657c5 dns_zone_name = oxide.test found_so_far = 1 version = 2
103242024-12-19T01:10:21.736ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
103252024-12-19T01:10:21.736ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-19 00:59:02.707744 UTC dns_group = external generation = 2
103262024-12-19T01:10:21.736ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 360.859ms iteration = 14 status = {"generation":2}
103272024-12-19T01:10:21.767ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
103282024-12-19T01:10:21.767ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 392.365857ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
103292024-12-19T01:10:21.792ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103302024-12-19T01:10:21.794ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b8eb9d7-681f-4fb2-9490-49fdd9f54e83", "content-length": "2", "date": "Thu, 19 Dec 2024 01:10:20 GMT"} })
103312024-12-19T01:10:21.796ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103322024-12-19T01:10:21.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103332024-12-19T01:10:21.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103342024-12-19T01:10:21.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103352024-12-19T01:10:21.798ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 423.265397ms iteration = 25 status = null
103362024-12-19T01:10:21.799ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 423.657353ms iteration = 29 status = {"physical_disks_added":0}
103372024-12-19T01:10:21.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103382024-12-19T01:10:21.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103392024-12-19T01:10:21.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103402024-12-19T01:10:21.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103412024-12-19T01:10:21.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103422024-12-19T01:10:21.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103432024-12-19T01:10:21.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103442024-12-19T01:10:21.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103452024-12-19T01:10:21.816ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
103462024-12-19T01:10:21.817ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "8528f6ec-10f2-4172-b5a7-bc256dce9ad2", "date": "Thu, 19 Dec 2024 01:10:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103472024-12-19T01:10:21.817ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103482024-12-19T01:10:21.819ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d7954365-4ae9-4e69-8350-acc2bca5529d", "date": "Thu, 19 Dec 2024 01:10:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103492024-12-19T01:10:21.819ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103502024-12-19T01:10:21.821ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "91b6269e-85e0-4714-82ac-c4c471caf547", "date": "Thu, 19 Dec 2024 01:10:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103512024-12-19T01:10:21.821ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103522024-12-19T01:10:21.823ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103532024-12-19T01:10:21.823ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 447.981983ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
103542024-12-19T01:10:21.825ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 450.468757ms iteration = 25 status = {}
103552024-12-19T01:10:21.849ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103562024-12-19T01:10:21.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103572024-12-19T01:10:21.852ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
103582024-12-19T01:10:21.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103592024-12-19T01:10:21.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103602024-12-19T01:10:21.862ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103612024-12-19T01:10:21.863ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "44f161ee-8d30-42f0-8c6c-37e586cb90d5", "content-length": "134", "date": "Thu, 19 Dec 2024 01:10:20 GMT"} })
103622024-12-19T01:10:21.863ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103632024-12-19T01:10:21.863ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
103642024-12-19T01:10:21.863ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103652024-12-19T01:10:21.863ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103662024-12-19T01:10:21.863ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103672024-12-19T01:10:21.863ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103682024-12-19T01:10:21.863ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103692024-12-19T01:10:21.863ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103702024-12-19T01:10:21.863ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103712024-12-19T01:10:21.863ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103722024-12-19T01:10:21.863ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
103732024-12-19T01:10:21.863ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103742024-12-19T01:10:21.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103752024-12-19T01:10:21.866ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103762024-12-19T01:10:21.866ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d535ac4-0ee3-4144-8d87-7071e7b9131b", "content-length": "2", "date": "Thu, 19 Dec 2024 01:10:20 GMT"} })
103772024-12-19T01:10:21.866ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103782024-12-19T01:10:21.866ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc37e62a-131a-479e-becd-712693ebe458", "content-length": "52", "date": "Thu, 19 Dec 2024 01:10:20 GMT"} })
103792024-12-19T01:10:21.866ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
103802024-12-19T01:10:21.866ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103812024-12-19T01:10:21.909ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103822024-12-19T01:10:21.967ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3e7701a6-77c7-4dbe-bdac-75141af49fb6", "date": "Thu, 19 Dec 2024 01:10:21 GMT"} })
103832024-12-19T01:10:21.967ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
103842024-12-19T01:10:21.967ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103852024-12-19T01:10:21.968ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff452815-30b2-41bc-ad18-fe2573d1e5ad", "content-length": "682", "date": "Thu, 19 Dec 2024 01:10:21 GMT"} })
103862024-12-19T01:10:21.968ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103872024-12-19T01:10:21.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103882024-12-19T01:10:21.968ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "15a5153b-66b0-4f29-a110-061c6900de44", "content-length": "691", "date": "Thu, 19 Dec 2024 01:10:21 GMT"} })
103892024-12-19T01:10:21.968ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
103902024-12-19T01:10:21.968ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
103912024-12-19T01:10:21.968ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
103922024-12-19T01:10:21.970ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 595.559457ms iteration = 26 status = {}
103932024-12-19T01:10:21.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103942024-12-19T01:10:21.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103952024-12-19T01:10:21.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103962024-12-19T01:10:21.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103972024-12-19T01:10:21.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103982024-12-19T01:10:21.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103992024-12-19T01:10:21.984ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 609.665239ms iteration = 25 status = {}
104002024-12-19T01:10:22.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 688ebd6c-9490-4ef6-801d-86e4d99ec08f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104012024-12-19T01:10:22.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 688ebd6c-9490-4ef6-801d-86e4d99ec08f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104022024-12-19T01:10:22.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 688ebd6c-9490-4ef6-801d-86e4d99ec08f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104032024-12-19T01:10:23.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9dbc412b-4531-4ff3-99c8-1d1775c377f1 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104042024-12-19T01:10:23.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9dbc412b-4531-4ff3-99c8-1d1775c377f1 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104052024-12-19T01:10:23.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 9dbc412b-4531-4ff3-99c8-1d1775c377f1 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104062024-12-19T01:10:24.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3e332367-86ee-4105-bda1-7cefecab2778 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104072024-12-19T01:10:24.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3e332367-86ee-4105-bda1-7cefecab2778 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104082024-12-19T01:10:24.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3e332367-86ee-4105-bda1-7cefecab2778 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104092024-12-19T01:10:25.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 97b72f46-64fe-4173-ae59-23c4cefb3d04 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104102024-12-19T01:10:25.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 97b72f46-64fe-4173-ae59-23c4cefb3d04 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104112024-12-19T01:10:25.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 97b72f46-64fe-4173-ae59-23c4cefb3d04 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104122024-12-19T01:10:25.772ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1425 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 7185f62d-b433-4ce9-a13b-16479ef0f7b1 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
104132024-12-19T01:10:26.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6c43fd56-1933-48e8-81f8-153642577a36 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104142024-12-19T01:10:26.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6c43fd56-1933-48e8-81f8-153642577a36 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104152024-12-19T01:10:26.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6c43fd56-1933-48e8-81f8-153642577a36 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104162024-12-19T01:10:27.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 45c26df2-dc06-460e-a6db-cfd782ed1d5e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
104172024-12-19T01:10:27.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 45c26df2-dc06-460e-a6db-cfd782ed1d5e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
104182024-12-19T01:10:27.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 45c26df2-dc06-460e-a6db-cfd782ed1d5e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
104192024-12-19T01:10:27.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 89acad24-945d-4269-b31d-888785b875bb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104202024-12-19T01:10:27.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 89acad24-945d-4269-b31d-888785b875bb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104212024-12-19T01:10:27.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 89acad24-945d-4269-b31d-888785b875bb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104222024-12-19T01:10:28.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 43e6202d-7411-4876-b75b-4cd1cd729bd9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104232024-12-19T01:10:28.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 43e6202d-7411-4876-b75b-4cd1cd729bd9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104242024-12-19T01:10:28.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 43e6202d-7411-4876-b75b-4cd1cd729bd9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104252024-12-19T01:10:29.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 518f175d-c737-4a57-abf4-9d49ecd8a0bb roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104262024-12-19T01:10:29.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 518f175d-c737-4a57-abf4-9d49ecd8a0bb resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104272024-12-19T01:10:29.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 518f175d-c737-4a57-abf4-9d49ecd8a0bb response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104282024-12-19T01:10:30.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7a16168a-f673-40fe-aa45-4ee4e7f07eff roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104292024-12-19T01:10:30.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7a16168a-f673-40fe-aa45-4ee4e7f07eff resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104302024-12-19T01:10:30.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7a16168a-f673-40fe-aa45-4ee4e7f07eff response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104312024-12-19T01:10:31.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 774257cb-a905-49fe-8ce8-d9f6c86ef5c2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104322024-12-19T01:10:31.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 774257cb-a905-49fe-8ce8-d9f6c86ef5c2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104332024-12-19T01:10:31.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 774257cb-a905-49fe-8ce8-d9f6c86ef5c2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104342024-12-19T01:10:31.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
104352024-12-19T01:10:31.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
104362024-12-19T01:10:31.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104372024-12-19T01:10:31.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104382024-12-19T01:10:31.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104392024-12-19T01:10:31.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104402024-12-19T01:10:31.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104412024-12-19T01:10:31.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104422024-12-19T01:10:31.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104432024-12-19T01:10:31.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104442024-12-19T01:10:31.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104452024-12-19T01:10:31.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104462024-12-19T01:10:31.405ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104472024-12-19T01:10:31.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104482024-12-19T01:10:31.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104492024-12-19T01:10:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
104502024-12-19T01:10:31.410ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104512024-12-19T01:10:31.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104522024-12-19T01:10:31.422ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
104532024-12-19T01:10:31.422ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.885167ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
104542024-12-19T01:10:31.435ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.65956ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104552024-12-19T01:10:32.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f80b82af-16e6-4b65-aba2-21b324e375a6 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104562024-12-19T01:10:32.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f80b82af-16e6-4b65-aba2-21b324e375a6 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104572024-12-19T01:10:32.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f80b82af-16e6-4b65-aba2-21b324e375a6 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104582024-12-19T01:10:33.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 909a5d3b-3307-4062-b006-825bff43ea52 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104592024-12-19T01:10:33.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 909a5d3b-3307-4062-b006-825bff43ea52 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104602024-12-19T01:10:33.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 909a5d3b-3307-4062-b006-825bff43ea52 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104612024-12-19T01:10:34.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ff057534-94f7-47cb-b3af-e4f3d3b9ab4c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104622024-12-19T01:10:34.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ff057534-94f7-47cb-b3af-e4f3d3b9ab4c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104632024-12-19T01:10:34.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = ff057534-94f7-47cb-b3af-e4f3d3b9ab4c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104642024-12-19T01:10:35.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6dd8c062-dbcd-4e43-99a7-a9cd4045605a roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104652024-12-19T01:10:35.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6dd8c062-dbcd-4e43-99a7-a9cd4045605a resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104662024-12-19T01:10:35.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 6dd8c062-dbcd-4e43-99a7-a9cd4045605a response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104672024-12-19T01:10:35.772ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1545 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 0aa4030c-9e31-4a27-8f05-3258f4b46cc5 response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
104682024-12-19T01:10:36.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 04d2c55c-8772-415d-85ad-c55c61916920 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104692024-12-19T01:10:36.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 04d2c55c-8772-415d-85ad-c55c61916920 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104702024-12-19T01:10:36.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 04d2c55c-8772-415d-85ad-c55c61916920 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104712024-12-19T01:10:37.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d4183571-5b2a-4c94-a728-209385abf98b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104722024-12-19T01:10:37.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d4183571-5b2a-4c94-a728-209385abf98b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104732024-12-19T01:10:37.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2960 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = d4183571-5b2a-4c94-a728-209385abf98b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104742024-12-19T01:10:38.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 947d35e9-e546-4a2b-b715-b10cf0677bf0 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104752024-12-19T01:10:38.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 947d35e9-e546-4a2b-b715-b10cf0677bf0 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104762024-12-19T01:10:38.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 947d35e9-e546-4a2b-b715-b10cf0677bf0 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104772024-12-19T01:10:39.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1e29f5a0-a13f-437f-94af-119bbabf4e5f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104782024-12-19T01:10:39.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1e29f5a0-a13f-437f-94af-119bbabf4e5f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104792024-12-19T01:10:39.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1e29f5a0-a13f-437f-94af-119bbabf4e5f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104802024-12-19T01:10:40.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1273a6d1-dacc-4de2-acc8-d92e1f0f5b89 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104812024-12-19T01:10:40.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1273a6d1-dacc-4de2-acc8-d92e1f0f5b89 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104822024-12-19T01:10:40.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1273a6d1-dacc-4de2-acc8-d92e1f0f5b89 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
104832024-12-19T01:10:41.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
104842024-12-19T01:10:41.375ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
104852024-12-19T01:10:41.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104862024-12-19T01:10:41.375ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104872024-12-19T01:10:41.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104882024-12-19T01:10:41.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104892024-12-19T01:10:41.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104902024-12-19T01:10:41.377ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104912024-12-19T01:10:41.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104922024-12-19T01:10:41.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104932024-12-19T01:10:41.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104942024-12-19T01:10:41.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104952024-12-19T01:10:41.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104962024-12-19T01:10:41.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104972024-12-19T01:10:41.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104982024-12-19T01:10:41.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
104992024-12-19T01:10:41.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105002024-12-19T01:10:41.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105012024-12-19T01:10:41.396ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
105022024-12-19T01:10:41.396ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.865753ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
105032024-12-19T01:10:41.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.767141ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105042024-12-19T01:10:41.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 513fb442-d4b3-4f6d-8167-45ba9ed835b6 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105052024-12-19T01:10:41.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 513fb442-d4b3-4f6d-8167-45ba9ed835b6 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105062024-12-19T01:10:41.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 513fb442-d4b3-4f6d-8167-45ba9ed835b6 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105072024-12-19T01:10:42.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f5824b22-aeb7-4540-accf-f9b996a59bed roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105082024-12-19T01:10:42.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f5824b22-aeb7-4540-accf-f9b996a59bed resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105092024-12-19T01:10:42.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = f5824b22-aeb7-4540-accf-f9b996a59bed response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105102024-12-19T01:10:43.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 12cd824c-1203-4d56-a231-dae1edbdd4cd roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105112024-12-19T01:10:43.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 12cd824c-1203-4d56-a231-dae1edbdd4cd resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105122024-12-19T01:10:43.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 12cd824c-1203-4d56-a231-dae1edbdd4cd response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105132024-12-19T01:10:44.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 46c008ac-1907-4318-85e9-993731bf83a8 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105142024-12-19T01:10:44.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 46c008ac-1907-4318-85e9-993731bf83a8 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105152024-12-19T01:10:44.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1932 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 46c008ac-1907-4318-85e9-993731bf83a8 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105162024-12-19T01:10:45.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2e24e87a-1bef-48b4-a1be-17da434f0b9f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105172024-12-19T01:10:45.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2e24e87a-1bef-48b4-a1be-17da434f0b9f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105182024-12-19T01:10:45.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 2e24e87a-1bef-48b4-a1be-17da434f0b9f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105192024-12-19T01:10:45.773ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1609 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = 0a9eb93a-d3d8-441f-be69-6baeff221cea response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
105202024-12-19T01:10:46.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3c57c040-3287-467c-8573-ae98ad71a1d2 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105212024-12-19T01:10:46.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3c57c040-3287-467c-8573-ae98ad71a1d2 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105222024-12-19T01:10:46.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 3c57c040-3287-467c-8573-ae98ad71a1d2 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105232024-12-19T01:10:47.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0a9d1a97-1be0-446d-baf6-346eb653aa52 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105242024-12-19T01:10:47.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0a9d1a97-1be0-446d-baf6-346eb653aa52 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105252024-12-19T01:10:47.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0a9d1a97-1be0-446d-baf6-346eb653aa52 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105262024-12-19T01:10:48.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 982ee97b-83be-4108-8be3-3329fc881820 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105272024-12-19T01:10:48.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 982ee97b-83be-4108-8be3-3329fc881820 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105282024-12-19T01:10:48.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 982ee97b-83be-4108-8be3-3329fc881820 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105292024-12-19T01:10:49.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 67236b5b-9448-41d3-9ba5-c0069c4d76e4 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105302024-12-19T01:10:49.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 67236b5b-9448-41d3-9ba5-c0069c4d76e4 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105312024-12-19T01:10:49.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 67236b5b-9448-41d3-9ba5-c0069c4d76e4 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105322024-12-19T01:10:50.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0acd7435-b7d6-41d7-90fb-22c0d80095ad roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105332024-12-19T01:10:50.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0acd7435-b7d6-41d7-90fb-22c0d80095ad resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105342024-12-19T01:10:50.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0acd7435-b7d6-41d7-90fb-22c0d80095ad response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
105352024-12-19T01:10:51.375ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
105362024-12-19T01:10:51.375ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
105372024-12-19T01:10:51.375ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105382024-12-19T01:10:51.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105392024-12-19T01:10:51.375ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
105402024-12-19T01:10:51.375ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
105412024-12-19T01:10:51.375ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
105422024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
105432024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105442024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
105452024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
105462024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105472024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
105482024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105492024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
105502024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
105512024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105522024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105532024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
105542024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
105552024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
105562024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105572024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
105582024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
105592024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105602024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105612024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
105622024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105632024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
105642024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105652024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
105662024-12-19T01:10:51.376ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105672024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105682024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
105692024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105702024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105712024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105722024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105732024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105742024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105752024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105762024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
105772024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105782024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105792024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105802024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105812024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105822024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105832024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105842024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
105852024-12-19T01:10:51.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105862024-12-19T01:10:51.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105872024-12-19T01:10:51.378ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.903979ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
105882024-12-19T01:10:51.379ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105892024-12-19T01:10:51.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
105902024-12-19T01:10:51.381ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105912024-12-19T01:10:51.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
105922024-12-19T01:10:51.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105932024-12-19T01:10:51.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105942024-12-19T01:10:51.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105952024-12-19T01:10:51.385ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105962024-12-19T01:10:51.386ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1540, tv_nsec: 228254176 } })
105972024-12-19T01:10:51.386ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
105982024-12-19T01:10:51.386ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1540, tv_nsec: 228885004 } })
105992024-12-19T01:10:51.386ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106002024-12-19T01:10:51.387ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
106012024-12-19T01:10:51.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106022024-12-19T01:10:51.388ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106032024-12-19T01:10:51.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106042024-12-19T01:10:51.390ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
106052024-12-19T01:10:51.390ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106062024-12-19T01:10:51.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106072024-12-19T01:10:51.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106082024-12-19T01:10:51.404ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106092024-12-19T01:10:51.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106102024-12-19T01:10:51.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106112024-12-19T01:10:51.408ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106122024-12-19T01:10:51.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106132024-12-19T01:10:51.433ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106142024-12-19T01:10:51.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106152024-12-19T01:10:51.437ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106162024-12-19T01:10:51.437ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
106172024-12-19T01:10:51.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106182024-12-19T01:10:51.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106192024-12-19T01:10:51.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.450645ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
106202024-12-19T01:10:51.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.631335ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
106212024-12-19T01:10:51.443ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106222024-12-19T01:10:51.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106232024-12-19T01:10:51.443ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
106242024-12-19T01:10:51.443ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106252024-12-19T01:10:51.444ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecfba581-99c0-4417-9cf2-9b0e7a80a217", "content-length": "26", "date": "Thu, 19 Dec 2024 01:10:51 GMT"} })
106262024-12-19T01:10:51.444ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106272024-12-19T01:10:51.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.639426ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
106282024-12-19T01:10:51.446ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106292024-12-19T01:10:51.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106302024-12-19T01:10:51.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106312024-12-19T01:10:51.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106322024-12-19T01:10:51.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106332024-12-19T01:10:51.451ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
106342024-12-19T01:10:51.451ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.13194ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
106352024-12-19T01:10:51.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106362024-12-19T01:10:51.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106372024-12-19T01:10:51.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106382024-12-19T01:10:51.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106392024-12-19T01:10:51.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106402024-12-19T01:10:51.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106412024-12-19T01:10:51.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106422024-12-19T01:10:51.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106432024-12-19T01:10:51.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106442024-12-19T01:10:51.456ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106452024-12-19T01:10:51.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106462024-12-19T01:10:51.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
106472024-12-19T01:10:51.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106482024-12-19T01:10:51.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106492024-12-19T01:10:51.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: ae290f68-8df6-449b-b34f-e1c3f319c42a, lookup_type: ById(ae290f68-8df6-449b-b34f-e1c3f319c42a) } result = Ok(())
106502024-12-19T01:10:51.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106512024-12-19T01:10:51.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106522024-12-19T01:10:51.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: de9bec7d-f8ce-44a0-879c-5e088768f91c, lookup_type: ById(de9bec7d-f8ce-44a0-879c-5e088768f91c) } result = Ok(())
106532024-12-19T01:10:51.459ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106542024-12-19T01:10:51.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106552024-12-19T01:10:51.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106562024-12-19T01:10:51.461ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-de9bec7d-f8ce-44a0-879c-5e088768f91c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1540, tv_nsec: 303906363 } })
106572024-12-19T01:10:51.461ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106582024-12-19T01:10:51.461ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106592024-12-19T01:10:51.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106602024-12-19T01:10:51.462ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
106612024-12-19T01:10:51.464ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.286259ms iteration = 26 status = 0
106622024-12-19T01:10:51.466ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
106632024-12-19T01:10:51.466ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106642024-12-19T01:10:51.467ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1771126-ba38-4fe2-8265-88c80b97cde8", "content-length": "26", "date": "Thu, 19 Dec 2024 01:10:51 GMT"} })
106652024-12-19T01:10:51.467ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106662024-12-19T01:10:51.469ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106672024-12-19T01:10:51.469ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106682024-12-19T01:10:51.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106692024-12-19T01:10:51.474ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106702024-12-19T01:10:51.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106712024-12-19T01:10:51.474ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106722024-12-19T01:10:51.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106732024-12-19T01:10:51.477ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 101.386057ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
106742024-12-19T01:10:51.481ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a original_time_created = 2024-12-19 00:58:17.822247 UTC target_id = ae290f68-8df6-449b-b34f-e1c3f319c42a time_created = 2024-12-19 00:58:17.822247 UTC
106752024-12-19T01:10:51.481ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 105.688205ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"ae290f68-8df6-449b-b34f-e1c3f319c42a","time_created":"2024-12-19T00:58:17.822247Z"}
106762024-12-19T01:10:51.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 117.246463ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106772024-12-19T01:10:51.494ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106782024-12-19T01:10:51.494ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106792024-12-19T01:10:51.494ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106802024-12-19T01:10:51.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106812024-12-19T01:10:51.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 122.95563ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106822024-12-19T01:10:51.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106832024-12-19T01:10:51.511ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 135.560761ms iteration = 30 status = {"physical_disks_added":0}
106842024-12-19T01:10:51.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106852024-12-19T01:10:51.525ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 149.161125ms iteration = 26 status = {}
106862024-12-19T01:10:51.530ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106872024-12-19T01:10:51.530ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
106882024-12-19T01:10:51.530ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 154.63318ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
106892024-12-19T01:10:51.556ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 zone_address = fd00:1122:3344:101::2
106902024-12-19T01:10:51.556ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106912024-12-19T01:10:51.556ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f69c9fa-b98a-4b37-bb9b-b0308b317289", "content-length": "26", "date": "Thu, 19 Dec 2024 01:10:51 GMT"} })
106922024-12-19T01:10:51.556ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106932024-12-19T01:10:51.557ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
106942024-12-19T01:10:51.557ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "487a88e1-bf68-4166-aaf8-c4d8e75fac4b", "content-length": "2", "date": "Thu, 19 Dec 2024 01:10:50 GMT"} })
106952024-12-19T01:10:51.558ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
106962024-12-19T01:10:51.559ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106972024-12-19T01:10:51.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106982024-12-19T01:10:51.561ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 185.839384ms iteration = 26 status = null
106992024-12-19T01:10:51.610ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
107002024-12-19T01:10:51.610ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107012024-12-19T01:10:51.611ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b09bc9d-f874-439a-9170-041c6c669318", "content-length": "372", "date": "Thu, 19 Dec 2024 01:10:51 GMT"} })
107022024-12-19T01:10:51.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107032024-12-19T01:10:51.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107042024-12-19T01:10:51.632ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107052024-12-19T01:10:51.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107062024-12-19T01:10:51.634ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107072024-12-19T01:10:51.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107082024-12-19T01:10:51.639ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107092024-12-19T01:10:51.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107102024-12-19T01:10:51.676ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107112024-12-19T01:10:51.679ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107122024-12-19T01:10:51.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107132024-12-19T01:10:51.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107142024-12-19T01:10:51.683ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
107152024-12-19T01:10:51.683ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
107162024-12-19T01:10:51.683ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ea73d515-20d4-45b1-8b06-d05a25a199a1", "date": "Thu, 19 Dec 2024 01:10:51 GMT"} })
107172024-12-19T01:10:51.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107182024-12-19T01:10:51.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107192024-12-19T01:10:51.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107202024-12-19T01:10:51.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107212024-12-19T01:10:51.729ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
107222024-12-19T01:10:51.729ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "87c33b05-264e-4011-b629-752ea53e86a5", "content-length": "691", "date": "Thu, 19 Dec 2024 01:10:51 GMT"} })
107232024-12-19T01:10:51.729ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
107242024-12-19T01:10:51.729ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
107252024-12-19T01:10:51.729ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
107262024-12-19T01:10:51.730ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 354.685216ms iteration = 27 status = {}
107272024-12-19T01:10:51.731ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107282024-12-19T01:10:51.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107292024-12-19T01:10:51.731ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 7c1624b8-d6e9-4c2d-8c2f-ed3ad28d08a1, rack_id: 6f1cca69-e82a-429e-8f71-b2c5888a42c1, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(fc6b582b-1233-4e2d-815e-b0897ebd1ba3) } rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
107302024-12-19T01:10:51.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107312024-12-19T01:10:51.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107322024-12-19T01:10:51.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107332024-12-19T01:10:51.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107342024-12-19T01:10:51.738ZINFOnexus (BackgroundTasks): VPC route manager sled de9bec7d-f8ce-44a0-879c-5e088768f91c push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
107352024-12-19T01:10:51.738ZDEBGnexus (BackgroundTasks): client request SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107362024-12-19T01:10:51.738ZDEBGnexus (BackgroundTasks): client response SledAgent = de9bec7d-f8ce-44a0-879c-5e088768f91c background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1f6fedb8-2861-43e2-988c-c38e3da1ed14", "date": "Thu, 19 Dec 2024 01:10:51 GMT"} })
107372024-12-19T01:10:51.740ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 364.56077ms iteration = 28 status = {}
107382024-12-19T01:10:51.743ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
107392024-12-19T01:10:51.743ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8e0b6af-a389-493e-b278-bb81f1dad8b6", "content-length": "134", "date": "Thu, 19 Dec 2024 01:10:50 GMT"} })
107402024-12-19T01:10:51.743ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
107412024-12-19T01:10:51.743ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = fc6b582b-1233-4e2d-815e-b0897ebd1ba3
107422024-12-19T01:10:51.743ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
107432024-12-19T01:10:51.743ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
107442024-12-19T01:10:51.743ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107452024-12-19T01:10:51.743ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107462024-12-19T01:10:51.743ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107472024-12-19T01:10:51.744ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107482024-12-19T01:10:51.744ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107492024-12-19T01:10:51.744ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107502024-12-19T01:10:51.744ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1
107512024-12-19T01:10:51.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107522024-12-19T01:10:51.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107532024-12-19T01:10:51.746ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
107542024-12-19T01:10:51.746ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5926944c-a41f-4fe9-963a-89c9719811fe", "content-length": "2", "date": "Thu, 19 Dec 2024 01:10:50 GMT"} })
107552024-12-19T01:10:51.746ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
107562024-12-19T01:10:51.746ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b9669ed-f57b-483b-86f7-ec229dbd4524", "content-length": "52", "date": "Thu, 19 Dec 2024 01:10:50 GMT"} })
107572024-12-19T01:10:51.747ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch_location = Switch0
107582024-12-19T01:10:51.747ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
107592024-12-19T01:10:51.843ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "887ab883-3223-4eff-9d11-3743de9112ae", "date": "Thu, 19 Dec 2024 01:10:51 GMT"} })
107602024-12-19T01:10:51.843ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 switch = Switch0
107612024-12-19T01:10:51.843ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
107622024-12-19T01:10:51.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 23831623-8d18-453d-84b4-f87efd12923f roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
107632024-12-19T01:10:51.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 23831623-8d18-453d-84b4-f87efd12923f resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
107642024-12-19T01:10:51.844ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6f1cca69-e82a-429e-8f71-b2c5888a42c1 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "df5c2ab0-2f35-48a9-93d4-85520c784b15", "content-length": "682", "date": "Thu, 19 Dec 2024 01:10:51 GMT"} })
107652024-12-19T01:10:51.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107662024-12-19T01:10:51.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107672024-12-19T01:10:51.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 23831623-8d18-453d-84b4-f87efd12923f response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
107682024-12-19T01:10:51.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107692024-12-19T01:10:51.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107702024-12-19T01:10:51.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107712024-12-19T01:10:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107722024-12-19T01:10:51.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107732024-12-19T01:10:51.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107742024-12-19T01:10:51.862ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 486.217572ms iteration = 26 status = {}
107752024-12-19T01:10:52.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 270aba3f-4ba9-48be-b83f-f25a33e81808 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
107762024-12-19T01:10:52.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 270aba3f-4ba9-48be-b83f-f25a33e81808 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
107772024-12-19T01:10:52.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 270aba3f-4ba9-48be-b83f-f25a33e81808 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
107782024-12-19T01:10:53.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 83482a6a-d032-4f91-a26a-9a6451676aa3 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
107792024-12-19T01:10:53.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 83482a6a-d032-4f91-a26a-9a6451676aa3 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
107802024-12-19T01:10:53.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 83482a6a-d032-4f91-a26a-9a6451676aa3 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
107812024-12-19T01:10:54.275ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:57739
107822024-12-19T01:10:54.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57739 req_id = 5ea0b5e8-7f50-4551-b079-a0e0e5eae70c roles = RoleSet { roles: {} } uri = /metrics/producers
107832024-12-19T01:10:54.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57739 req_id = 5ea0b5e8-7f50-4551-b079-a0e0e5eae70c resource = Database result = Ok(()) uri = /metrics/producers
107842024-12-19T01:10:54.310ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = de9bec7d-f8ce-44a0-879c-5e088768f91c
107852024-12-19T01:10:54.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34500 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57739 req_id = 5ea0b5e8-7f50-4551-b079-a0e0e5eae70c response_code = 201 uri = /metrics/producers
107862024-12-19T01:10:54.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dbc2468c-ae89-4095-8616-f3f6f4a0f44c roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
107872024-12-19T01:10:54.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dbc2468c-ae89-4095-8616-f3f6f4a0f44c resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
107882024-12-19T01:10:54.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = dbc2468c-ae89-4095-8616-f3f6f4a0f44c response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
107892024-12-19T01:10:55.772ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1523 local_addr = [fd00:1122:3344:101::c]:46645 method = GET remote_addr = [fd00:1122:3344:101::d]:45250 req_id = f85cc0f5-6c22-4206-b7f8-f13366a7cc1b response_code = 200 uri = /1176f008-4a9d-4835-a5aa-1a86ec3c619c
107902024-12-19T01:10:55.793ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:34670
107912024-12-19T01:10:55.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34670 req_id = 43f4cb21-a66a-43a0-83fb-68c5a2165925 roles = RoleSet { roles: {} } uri = /metrics/producers
107922024-12-19T01:10:55.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34670 req_id = 43f4cb21-a66a-43a0-83fb-68c5a2165925 resource = Database result = Ok(()) uri = /metrics/producers
107932024-12-19T01:10:55.797ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35822
107942024-12-19T01:10:55.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35822 req_id = 9af4e2a6-cf72-45b7-b185-06a2bc110fbd roles = RoleSet { roles: {} } uri = /metrics/producers
107952024-12-19T01:10:55.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35822 req_id = 9af4e2a6-cf72-45b7-b185-06a2bc110fbd resource = Database result = Ok(()) uri = /metrics/producers
107962024-12-19T01:10:55.825ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 9544d6fb-0646-44f2-8d7c-f02b0fe1f856
107972024-12-19T01:10:55.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31881 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:34670 req_id = 43f4cb21-a66a-43a0-83fb-68c5a2165925 response_code = 201 uri = /metrics/producers
107982024-12-19T01:10:55.833ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = a59c27fd-a846-41a8-8577-0c2618144732
107992024-12-19T01:10:55.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35496 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35822 req_id = 9af4e2a6-cf72-45b7-b185-06a2bc110fbd response_code = 201 uri = /metrics/producers
108002024-12-19T01:10:55.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 488fa949-ad66-427a-bc77-b5718982e0dc roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108012024-12-19T01:10:55.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 488fa949-ad66-427a-bc77-b5718982e0dc resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108022024-12-19T01:10:55.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 488fa949-ad66-427a-bc77-b5718982e0dc response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108032024-12-19T01:10:56.138ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:53427
108042024-12-19T01:10:56.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53427 req_id = ff6c5d47-d4aa-442a-a388-8572f9c94dfd roles = RoleSet { roles: {} } uri = /metrics/producers
108052024-12-19T01:10:56.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53427 req_id = ff6c5d47-d4aa-442a-a388-8572f9c94dfd resource = Database result = Ok(()) uri = /metrics/producers
108062024-12-19T01:10:56.147ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 51ab14f8-f146-4958-aacf-1a2334aec785
108072024-12-19T01:10:56.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9459 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53427 req_id = ff6c5d47-d4aa-442a-a388-8572f9c94dfd response_code = 201 uri = /metrics/producers
108082024-12-19T01:10:56.898ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:62385
108092024-12-19T01:10:56.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62385 req_id = 9534448e-2183-473d-8195-600c265aaca0 roles = RoleSet { roles: {} } uri = /metrics/producers
108102024-12-19T01:10:56.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62385 req_id = 9534448e-2183-473d-8195-600c265aaca0 resource = Database result = Ok(()) uri = /metrics/producers
108112024-12-19T01:10:56.931ZINFOnexus: assigned collector to new producer collector_id = b4e7d6e3-7551-4da8-8529-1286ef6ee8a3 file = nexus/src/app/oximeter.rs:76 producer_id = 9f4eb089-639f-444f-a6bb-061685ba22f0
108122024-12-19T01:10:56.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32717 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62385 req_id = 9534448e-2183-473d-8195-600c265aaca0 response_code = 201 uri = /metrics/producers
108132024-12-19T01:10:56.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7b907dec-05b3-4319-9e26-e4da0dacfa8b roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108142024-12-19T01:10:56.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7b907dec-05b3-4319-9e26-e4da0dacfa8b resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108152024-12-19T01:10:56.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 7b907dec-05b3-4319-9e26-e4da0dacfa8b response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108162024-12-19T01:10:57.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 31a9ef9d-8913-4a75-b0e0-5084d701fb13 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
108172024-12-19T01:10:57.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 31a9ef9d-8913-4a75-b0e0-5084d701fb13 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
108182024-12-19T01:10:57.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:54899 req_id = 31a9ef9d-8913-4a75-b0e0-5084d701fb13 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
108192024-12-19T01:10:57.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0ee5e7b9-4d32-4c32-b45d-3de9c022f1f9 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108202024-12-19T01:10:57.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0ee5e7b9-4d32-4c32-b45d-3de9c022f1f9 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108212024-12-19T01:10:57.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2594 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 0ee5e7b9-4d32-4c32-b45d-3de9c022f1f9 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108222024-12-19T01:10:58.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 97852825-556d-4df7-a7a7-b8f7ec5204fa roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108232024-12-19T01:10:58.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 97852825-556d-4df7-a7a7-b8f7ec5204fa resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108242024-12-19T01:10:59.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 97852825-556d-4df7-a7a7-b8f7ec5204fa response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108252024-12-19T01:11:00.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1a0f60ca-9416-4678-a388-d3f227516c02 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108262024-12-19T01:11:00.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1a0f60ca-9416-4678-a388-d3f227516c02 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108272024-12-19T01:11:00.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = 1a0f60ca-9416-4678-a388-d3f227516c02 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108282024-12-19T01:11:01.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fe1db777-8fc7-41e5-8e23-baa805358c60 roles = RoleSet { roles: {} } uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108292024-12-19T01:11:01.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fe1db777-8fc7-41e5-8e23-baa805358c60 resource = Database result = Ok(()) uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c
108302024-12-19T01:11:01.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:54085 req_id = fe1db777-8fc7-41e5-8e23-baa805358c60 response_code = 200 uri = /probes/de9bec7d-f8ce-44a0-879c-5e088768f91c