Max level shown:
12024-09-25T17:30:02.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d53d17e6-6466-411b-b6ec-97fc38621513 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
22024-09-25T17:30:02.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d53d17e6-6466-411b-b6ec-97fc38621513 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32024-09-25T17:30:02.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d53d17e6-6466-411b-b6ec-97fc38621513 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
42024-09-25T17:30:03.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1055a30c-d492-4c35-8c2b-0848381c0ff4 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
52024-09-25T17:30:03.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1055a30c-d492-4c35-8c2b-0848381c0ff4 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
62024-09-25T17:30:03.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1055a30c-d492-4c35-8c2b-0848381c0ff4 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
72024-09-25T17:30:04.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = acc6b18d-1bc8-4418-991a-8a572a51c0bb roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
82024-09-25T17:30:04.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = acc6b18d-1bc8-4418-991a-8a572a51c0bb resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
92024-09-25T17:30:04.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = acc6b18d-1bc8-4418-991a-8a572a51c0bb response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
102024-09-25T17:30:05.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 554c11bc-e93e-444b-8ad7-9f749b1124a2 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
112024-09-25T17:30:05.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f5a93bd2-c143-40bb-8b13-a7b2df1d97d4 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
122024-09-25T17:30:05.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f5a93bd2-c143-40bb-8b13-a7b2df1d97d4 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
132024-09-25T17:30:05.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f5a93bd2-c143-40bb-8b13-a7b2df1d97d4 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
142024-09-25T17:30:06.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9f6499fc-2c8d-4eb6-b3c7-65241e698850 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
152024-09-25T17:30:06.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9f6499fc-2c8d-4eb6-b3c7-65241e698850 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
162024-09-25T17:30:06.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9f6499fc-2c8d-4eb6-b3c7-65241e698850 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
172024-09-25T17:30:07.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cecf9249-1cd9-4e40-91a8-c86d95e43418 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
182024-09-25T17:30:07.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cecf9249-1cd9-4e40-91a8-c86d95e43418 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
192024-09-25T17:30:07.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cecf9249-1cd9-4e40-91a8-c86d95e43418 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
202024-09-25T17:30:08.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3b8c27ef-947b-4a12-821d-18c9f28f3a0d roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
212024-09-25T17:30:08.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3b8c27ef-947b-4a12-821d-18c9f28f3a0d resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
222024-09-25T17:30:08.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3b8c27ef-947b-4a12-821d-18c9f28f3a0d response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
232024-09-25T17:30:09.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1ff1e3ef-f813-4cf8-871d-8ac13ecfbb44 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
242024-09-25T17:30:09.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1ff1e3ef-f813-4cf8-871d-8ac13ecfbb44 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
252024-09-25T17:30:09.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1ff1e3ef-f813-4cf8-871d-8ac13ecfbb44 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
262024-09-25T17:30:10.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 30d869d5-1af8-4849-87f0-c7e80146d364 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
272024-09-25T17:30:10.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 30d869d5-1af8-4849-87f0-c7e80146d364 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
282024-09-25T17:30:10.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 30d869d5-1af8-4849-87f0-c7e80146d364 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
292024-09-25T17:30:11.487ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
302024-09-25T17:30:11.487ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
312024-09-25T17:30:11.487ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
322024-09-25T17:30:11.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
332024-09-25T17:30:11.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
342024-09-25T17:30:11.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
352024-09-25T17:30:11.489ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
362024-09-25T17:30:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
372024-09-25T17:30:11.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
382024-09-25T17:30:11.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.76048ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
392024-09-25T17:30:11.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
402024-09-25T17:30:11.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
412024-09-25T17:30:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
422024-09-25T17:30:11.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
432024-09-25T17:30:11.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
442024-09-25T17:30:11.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
452024-09-25T17:30:11.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
462024-09-25T17:30:11.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
472024-09-25T17:30:11.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
482024-09-25T17:30:11.504ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
492024-09-25T17:30:11.504ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.394555ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
502024-09-25T17:30:11.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f95eb2ef-29b4-4e3d-8829-5cbd45b718b8 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
512024-09-25T17:30:11.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f95eb2ef-29b4-4e3d-8829-5cbd45b718b8 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
522024-09-25T17:30:11.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f95eb2ef-29b4-4e3d-8829-5cbd45b718b8 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
532024-09-25T17:30:12.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = bcffbc21-e82f-4b6e-ab9a-b10600966e6a roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
542024-09-25T17:30:12.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = bcffbc21-e82f-4b6e-ab9a-b10600966e6a resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
552024-09-25T17:30:12.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = bcffbc21-e82f-4b6e-ab9a-b10600966e6a response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
562024-09-25T17:30:13.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6c223a00-91da-4bb3-814e-9958490cbcb2 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
572024-09-25T17:30:13.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6c223a00-91da-4bb3-814e-9958490cbcb2 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
582024-09-25T17:30:13.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6c223a00-91da-4bb3-814e-9958490cbcb2 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
592024-09-25T17:30:14.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 285f5406-8446-4814-a06c-b016f59d50f3 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
602024-09-25T17:30:14.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 285f5406-8446-4814-a06c-b016f59d50f3 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
612024-09-25T17:30:14.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 285f5406-8446-4814-a06c-b016f59d50f3 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
622024-09-25T17:30:15.284ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1393 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = e8ea7c98-6e28-4935-a143-d733e4a6823f response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
632024-09-25T17:30:15.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 878af2a8-29c6-4f3e-95d3-24e617d5adf5 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
642024-09-25T17:30:15.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 878af2a8-29c6-4f3e-95d3-24e617d5adf5 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
652024-09-25T17:30:15.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 878af2a8-29c6-4f3e-95d3-24e617d5adf5 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
662024-09-25T17:30:16.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 25b7bbec-539e-470f-ade0-5f2205e2a8ba roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
672024-09-25T17:30:16.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 25b7bbec-539e-470f-ade0-5f2205e2a8ba resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
682024-09-25T17:30:16.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 25b7bbec-539e-470f-ade0-5f2205e2a8ba response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
692024-09-25T17:30:17.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 534c5ada-9824-4630-982b-3347e3daaa3e roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
702024-09-25T17:30:17.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 534c5ada-9824-4630-982b-3347e3daaa3e resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
712024-09-25T17:30:17.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 534c5ada-9824-4630-982b-3347e3daaa3e response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
722024-09-25T17:30:18.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 14125aa8-cd0a-4a58-a251-3081785ae49c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
732024-09-25T17:30:18.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 14125aa8-cd0a-4a58-a251-3081785ae49c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
742024-09-25T17:30:18.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 14125aa8-cd0a-4a58-a251-3081785ae49c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
752024-09-25T17:30:19.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 17f8c01d-5838-4635-bcc3-5b7e9c84a41e roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
762024-09-25T17:30:19.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 17f8c01d-5838-4635-bcc3-5b7e9c84a41e resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
772024-09-25T17:30:19.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 17f8c01d-5838-4635-bcc3-5b7e9c84a41e response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
782024-09-25T17:30:20.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fe34cafe-039d-4954-8c2e-2a0eb235b3ad roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
792024-09-25T17:30:20.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fe34cafe-039d-4954-8c2e-2a0eb235b3ad resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
802024-09-25T17:30:20.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fe34cafe-039d-4954-8c2e-2a0eb235b3ad response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
812024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
822024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
832024-09-25T17:30:21.488ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
842024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
852024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
862024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
872024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
882024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
892024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
902024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
912024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
922024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
932024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
942024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
952024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
962024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
972024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
982024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
992024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
1002024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1012024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
1022024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
1032024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1042024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
1052024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1062024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1072024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
1082024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1092024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
1102024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1112024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
1122024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1132024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1142024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
1152024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
1162024-09-25T17:30:21.488ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-25 17:20:21.488832911 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1172024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1182024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
1192024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1202024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
1212024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
1222024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1232024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
1242024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1252024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
1262024-09-25T17:30:21.488ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
1272024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1282024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1292024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
1302024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1312024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1322024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
1332024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
1342024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
1352024-09-25T17:30:21.489ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
1362024-09-25T17:30:21.489ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa
1372024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
1382024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1392024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
1402024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1412024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.44\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa"}
1422024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1432024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
1442024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1452024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
1462024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1472024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1482024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1492024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1502024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
1512024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1522024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1532024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1542024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1552024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1562024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1572024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1582024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1592024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1602024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
1612024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1622024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1632024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1642024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
1652024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1662024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1672024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1682024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1692024-09-25T17:30:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
1702024-09-25T17:30:21.489ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae9bf3cd-ff12-421b-b5a2-d52b18bde4b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be8cd1d4-baa8-48cc-872f-69bc5c2df30c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be8cd1d4-baa8-48cc-872f-69bc5c2df30c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2549, tv_nsec: 605333732 } })
1712024-09-25T17:30:21.489ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("11f53a30-9163-413a-8f7f-4bf206fb8176.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("929fdd8e-9f93-4e52-8d3d-ae706bb7a130.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ddd5d4f4-1113-49a5-bb63-a018bec3753e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ddd5d4f4-1113-49a5-bb63-a018bec3753e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2549, tv_nsec: 605356632 } })
1722024-09-25T17:30:21.492ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
1732024-09-25T17:30:21.492ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.953554ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
1742024-09-25T17:30:21.493ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1752024-09-25T17:30:21.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1762024-09-25T17:30:21.494ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
1772024-09-25T17:30:21.494ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.91922ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
1782024-09-25T17:30:21.495ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.409399ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1792024-09-25T17:30:21.495ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1802024-09-25T17:30:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1812024-09-25T17:30:21.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1822024-09-25T17:30:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
1832024-09-25T17:30:21.496ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1842024-09-25T17:30:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1852024-09-25T17:30:21.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1862024-09-25T17:30:21.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1872024-09-25T17:30:21.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1882024-09-25T17:30:21.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1892024-09-25T17:30:21.499ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1902024-09-25T17:30:21.499ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1912024-09-25T17:30:21.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1922024-09-25T17:30:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1932024-09-25T17:30:21.501ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1942024-09-25T17:30:21.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1952024-09-25T17:30:21.501ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1962024-09-25T17:30:21.501ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1972024-09-25T17:30:21.502ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2549, tv_nsec: 618492696 } })
1982024-09-25T17:30:21.504ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-25 17:20:21.488832911 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1992024-09-25T17:30:21.504ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.629171ms iteration = 6 status = {"expiration":"2024-09-25T17:20:21.488832911Z","pruned":[]}
2002024-09-25T17:30:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2012024-09-25T17:30:21.504ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2022024-09-25T17:30:21.504ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
2032024-09-25T17:30:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2042024-09-25T17:30:21.505ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2052024-09-25T17:30:21.505ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2062024-09-25T17:30:21.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2072024-09-25T17:30:21.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2082024-09-25T17:30:21.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2092024-09-25T17:30:21.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2102024-09-25T17:30:21.510ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.152673ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
2112024-09-25T17:30:21.510ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
2122024-09-25T17:30:21.510ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
2132024-09-25T17:30:21.510ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 21.404157ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
2142024-09-25T17:30:21.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2152024-09-25T17:30:21.512ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2549, tv_nsec: 628088814 } })
2162024-09-25T17:30:21.512ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2172024-09-25T17:30:21.513ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2182024-09-25T17:30:21.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2192024-09-25T17:30:21.514ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2202024-09-25T17:30:21.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2212024-09-25T17:30:21.514ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
2222024-09-25T17:30:21.515ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2232024-09-25T17:30:21.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2242024-09-25T17:30:21.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2252024-09-25T17:30:21.515ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2262024-09-25T17:30:21.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2272024-09-25T17:30:21.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2282024-09-25T17:30:21.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2292024-09-25T17:30:21.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2302024-09-25T17:30:21.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2312024-09-25T17:30:21.523ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2322024-09-25T17:30:21.524ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.117781ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2332024-09-25T17:30:21.526ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2549, tv_nsec: 641679407 } })
2342024-09-25T17:30:21.526ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
2352024-09-25T17:30:21.526ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2362024-09-25T17:30:21.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2372024-09-25T17:30:21.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2382024-09-25T17:30:21.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2392024-09-25T17:30:21.532ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2402024-09-25T17:30:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2412024-09-25T17:30:21.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2422024-09-25T17:30:21.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2432024-09-25T17:30:21.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2442024-09-25T17:30:21.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2452024-09-25T17:30:21.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2462024-09-25T17:30:21.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2472024-09-25T17:30:21.542ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2482024-09-25T17:30:21.542ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2492024-09-25T17:30:21.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2502024-09-25T17:30:21.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2512024-09-25T17:30:21.542ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2522024-09-25T17:30:21.542ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 53.939432ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2532024-09-25T17:30:21.543ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2542024-09-25T17:30:21.543ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2552024-09-25T17:30:21.543ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2562024-09-25T17:30:21.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2572024-09-25T17:30:21.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2582024-09-25T17:30:21.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2592024-09-25T17:30:21.543ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2602024-09-25T17:30:21.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2612024-09-25T17:30:21.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2622024-09-25T17:30:21.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
2632024-09-25T17:30:21.547ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2642024-09-25T17:30:21.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2652024-09-25T17:30:21.556ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2662024-09-25T17:30:21.556ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2672024-09-25T17:30:21.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2682024-09-25T17:30:21.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2692024-09-25T17:30:21.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2702024-09-25T17:30:21.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2712024-09-25T17:30:21.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2722024-09-25T17:30:21.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2732024-09-25T17:30:21.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2742024-09-25T17:30:21.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2752024-09-25T17:30:21.563ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2762024-09-25T17:30:21.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2772024-09-25T17:30:21.569ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2782024-09-25T17:30:21.573ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 84.288426ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
2792024-09-25T17:30:21.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2802024-09-25T17:30:21.573ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
2812024-09-25T17:30:21.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
2822024-09-25T17:30:21.574ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2832024-09-25T17:30:21.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2842024-09-25T17:30:21.574ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2852024-09-25T17:30:21.574ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
2862024-09-25T17:30:21.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2872024-09-25T17:30:21.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2882024-09-25T17:30:21.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 87.912024ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2892024-09-25T17:30:21.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 90.866128ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
2902024-09-25T17:30:21.580ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
2912024-09-25T17:30:21.580ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4983f296-eda5-4ab7-98fb-1acc9a8bf292 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
2922024-09-25T17:30:21.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2932024-09-25T17:30:21.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2942024-09-25T17:30:21.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2952024-09-25T17:30:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2962024-09-25T17:30:21.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2972024-09-25T17:30:21.586ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
2982024-09-25T17:30:21.586ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.96022ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
2992024-09-25T17:30:21.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3002024-09-25T17:30:21.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3012024-09-25T17:30:21.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3022024-09-25T17:30:21.594ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4983f296-eda5-4ab7-98fb-1acc9a8bf292 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
3032024-09-25T17:30:21.594ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3042024-09-25T17:30:21.594ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-25 17:25:42.974009 UTC dns_group = internal generation = 1
3052024-09-25T17:30:21.594ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 105.373107ms iteration = 7 status = {"generation":1}
3062024-09-25T17:30:21.594ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
3072024-09-25T17:30:21.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
3082024-09-25T17:30:21.596ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 108.19083ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
3092024-09-25T17:30:21.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.348203ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3102024-09-25T17:30:21.598ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3112024-09-25T17:30:21.598ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3122024-09-25T17:30:21.598ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 109.791509ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3132024-09-25T17:30:21.599ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
3142024-09-25T17:30:21.599ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
3152024-09-25T17:30:21.599ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
3162024-09-25T17:30:21.599ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3172024-09-25T17:30:21.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3182024-09-25T17:30:21.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3192024-09-25T17:30:21.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3202024-09-25T17:30:21.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3212024-09-25T17:30:21.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3222024-09-25T17:30:21.613ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3232024-09-25T17:30:21.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3242024-09-25T17:30:21.620ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3252024-09-25T17:30:21.620ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3262024-09-25T17:30:21.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3272024-09-25T17:30:21.620ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9011eb2e-f736-49fd-9148-03ee7daa981e dns_zone_name = oxide.test found_so_far = 0 version = 2
3282024-09-25T17:30:21.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3292024-09-25T17:30:21.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3302024-09-25T17:30:21.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3312024-09-25T17:30:21.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3322024-09-25T17:30:21.622ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:67 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
3332024-09-25T17:30:21.622ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 134.296834ms iteration = 6 status = {"changed_state":[],"instances_found":0,"instances_reincarnated":[],"query_error":null,"restart_errors":{}}
3342024-09-25T17:30:21.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
3352024-09-25T17:30:21.625ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3362024-09-25T17:30:21.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3372024-09-25T17:30:21.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3382024-09-25T17:30:21.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3392024-09-25T17:30:21.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3402024-09-25T17:30:21.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3412024-09-25T17:30:21.629ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9011eb2e-f736-49fd-9148-03ee7daa981e dns_zone_name = oxide.test found_so_far = 1 version = 2
3422024-09-25T17:30:21.629ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3432024-09-25T17:30:21.629ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-25 17:25:43.713253 UTC dns_group = external generation = 2
3442024-09-25T17:30:21.629ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 140.280745ms iteration = 7 status = {"generation":2}
3452024-09-25T17:30:21.630ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3462024-09-25T17:30:21.630ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3472024-09-25T17:30:21.630ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3482024-09-25T17:30:21.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3492024-09-25T17:30:21.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f0d006a2-eb4a-4510-8a1c-6c144343343f, lookup_type: ById(f0d006a2-eb4a-4510-8a1c-6c144343343f) } result = Ok(())
3502024-09-25T17:30:21.636ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3512024-09-25T17:30:21.637ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3522024-09-25T17:30:21.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3532024-09-25T17:30:21.637ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3542024-09-25T17:30:21.637ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.56178ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
3552024-09-25T17:30:21.638ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3562024-09-25T17:30:21.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3572024-09-25T17:30:21.639ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 150.489185ms iteration = 11 status = 0
3582024-09-25T17:30:21.640ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3592024-09-25T17:30:21.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3602024-09-25T17:30:21.641ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3612024-09-25T17:30:21.642ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 153.798237ms iteration = 14 status = {"physical_disks_added":0}
3622024-09-25T17:30:21.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3632024-09-25T17:30:21.646ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3642024-09-25T17:30:21.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3652024-09-25T17:30:21.650ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3662024-09-25T17:30:21.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3672024-09-25T17:30:21.657ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
3682024-09-25T17:30:21.658ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3692024-09-25T17:30:21.659ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3702024-09-25T17:30:21.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3712024-09-25T17:30:21.662ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3722024-09-25T17:30:21.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3732024-09-25T17:30:21.665ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3742024-09-25T17:30:21.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3752024-09-25T17:30:21.667ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3762024-09-25T17:30:21.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3772024-09-25T17:30:21.669ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3782024-09-25T17:30:21.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3792024-09-25T17:30:21.671ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3802024-09-25T17:30:21.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3812024-09-25T17:30:21.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3822024-09-25T17:30:21.674ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3832024-09-25T17:30:21.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3842024-09-25T17:30:21.675ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3852024-09-25T17:30:21.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3862024-09-25T17:30:21.677ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3872024-09-25T17:30:21.677ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3882024-09-25T17:30:21.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3892024-09-25T17:30:21.677ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
3902024-09-25T17:30:21.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
3912024-09-25T17:30:21.681ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
3922024-09-25T17:30:21.681ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3932024-09-25T17:30:21.681ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "62a4ad17-adb6-4312-aa33-5a56a796fa17", "content-length": "26", "date": "Wed, 25 Sep 2024 17:30:21 GMT"} })
3942024-09-25T17:30:21.681ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3952024-09-25T17:30:21.683ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
3962024-09-25T17:30:21.751ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3972024-09-25T17:30:21.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3982024-09-25T17:30:21.817ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
3992024-09-25T17:30:21.817ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4002024-09-25T17:30:21.818ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2a9a039b-6ac8-4736-b5db-02b38f7d584f", "content-length": "26", "date": "Wed, 25 Sep 2024 17:30:21 GMT"} })
4012024-09-25T17:30:21.818ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4022024-09-25T17:30:21.819ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4032024-09-25T17:30:21.846ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4042024-09-25T17:30:21.847ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6c7323a4-e257-455a-8234-98cda97491cb", "content-length": "372", "date": "Wed, 25 Sep 2024 17:30:21 GMT"} })
4052024-09-25T17:30:21.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4062024-09-25T17:30:21.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4072024-09-25T17:30:21.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4082024-09-25T17:30:21.849ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4092024-09-25T17:30:21.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4102024-09-25T17:30:21.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4112024-09-25T17:30:21.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4122024-09-25T17:30:21.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4132024-09-25T17:30:21.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4142024-09-25T17:30:21.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4152024-09-25T17:30:21.852ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4162024-09-25T17:30:21.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4172024-09-25T17:30:21.853ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4182024-09-25T17:30:21.854ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4192024-09-25T17:30:21.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4202024-09-25T17:30:21.855ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4212024-09-25T17:30:21.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4222024-09-25T17:30:21.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4232024-09-25T17:30:21.855ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4242024-09-25T17:30:21.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4252024-09-25T17:30:21.856ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4262024-09-25T17:30:21.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4272024-09-25T17:30:21.857ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4282024-09-25T17:30:21.857ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4b6870a8-934f-4dd6-b67a-5cb7213cda0f", "date": "Wed, 25 Sep 2024 17:30:21 GMT"} })
4292024-09-25T17:30:21.858ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4302024-09-25T17:30:21.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4312024-09-25T17:30:21.859ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 370.4255ms iteration = 12 status = {}
4322024-09-25T17:30:21.860ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4332024-09-25T17:30:21.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
4342024-09-25T17:30:21.863ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4352024-09-25T17:30:21.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4362024-09-25T17:30:21.864ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4372024-09-25T17:30:21.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4382024-09-25T17:30:21.866ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4392024-09-25T17:30:21.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4402024-09-25T17:30:21.873ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 zone_address = fd00:1122:3344:101::2
4412024-09-25T17:30:21.873ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4422024-09-25T17:30:21.874ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2a4ce19b-64ce-474e-a615-63b2670e3e46", "content-length": "26", "date": "Wed, 25 Sep 2024 17:30:21 GMT"} })
4432024-09-25T17:30:21.874ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4442024-09-25T17:30:21.876ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
4452024-09-25T17:30:21.893ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-25T17:25:19.066517Z, time_modified: 2024-09-25T17:25:19.066517Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, db_silo: Silo { identity: SiloIdentity { id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-25T17:25:43.663371Z, time_modified: 2024-09-25T17:25:43.663371Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, db_silo: Silo { identity: SiloIdentity { id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-25T17:25:43.663371Z, time_modified: 2024-09-25T17:25:43.663371Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c" }] }) }
4462024-09-25T17:30:21.893ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 404.87725ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dcfeb960-7abf-4e10-b28d-9fa9c33e4d51","tls_certs":["4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c"]}},"default_endpoint":{"silo_id":"dcfeb960-7abf-4e10-b28d-9fa9c33e4d51","tls_certs":["4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4472024-09-25T17:30:21.909ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4482024-09-25T17:30:21.909ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bd3a885c-553d-4fb9-aef3-93bd20faa748", "date": "Wed, 25 Sep 2024 17:30:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4492024-09-25T17:30:21.909ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4502024-09-25T17:30:21.911ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5e135e15-d6d0-40e9-b597-222c974c6420", "date": "Wed, 25 Sep 2024 17:30:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4512024-09-25T17:30:21.911ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4522024-09-25T17:30:21.912ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
4532024-09-25T17:30:21.912ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 424.007545ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4542024-09-25T17:30:21.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dfbcb196-2fea-4d2c-a106-4fc2fc9d3716 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
4552024-09-25T17:30:21.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dfbcb196-2fea-4d2c-a106-4fc2fc9d3716 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
4562024-09-25T17:30:22.003ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4572024-09-25T17:30:22.022ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 533.568031ms iteration = 11 status = {}
4582024-09-25T17:30:22.062ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4592024-09-25T17:30:22.062ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd1cda4c-cb58-42b3-b6fb-7755d412591f", "content-length": "1", "date": "Wed, 25 Sep 2024 17:30:21 GMT"} })
4602024-09-25T17:30:22.064ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4612024-09-25T17:30:22.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4622024-09-25T17:30:22.085ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4632024-09-25T17:30:22.086ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "06fcde74-9cb9-4bb7-86cd-9d0a7d01d58a", "content-length": "691", "date": "Wed, 25 Sep 2024 17:30:22 GMT"} })
4642024-09-25T17:30:22.086ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
4652024-09-25T17:30:22.086ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
4662024-09-25T17:30:22.086ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
4672024-09-25T17:30:22.087ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 598.592278ms iteration = 11 status = {}
4682024-09-25T17:30:22.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 176001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dfbcb196-2fea-4d2c-a106-4fc2fc9d3716 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
4692024-09-25T17:30:22.089ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 600.082805ms iteration = 11 status = null
4702024-09-25T17:30:22.095ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4712024-09-25T17:30:22.096ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "eb9bad62-8ea6-41a5-b44e-1084138c815c", "date": "Wed, 25 Sep 2024 17:30:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4722024-09-25T17:30:22.096ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4732024-09-25T17:30:22.098ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fd5a9b6f-847c-4a81-8bf4-1bb9bd9fdcae", "date": "Wed, 25 Sep 2024 17:30:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4742024-09-25T17:30:22.098ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4752024-09-25T17:30:22.099ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "db4fff54-8c8e-48ec-83ee-b62fd1f54ce0", "date": "Wed, 25 Sep 2024 17:30:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4762024-09-25T17:30:22.099ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4772024-09-25T17:30:22.101ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
4782024-09-25T17:30:22.101ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 612.845222ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4792024-09-25T17:30:22.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4802024-09-25T17:30:22.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
4812024-09-25T17:30:22.117ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4822024-09-25T17:30:22.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4832024-09-25T17:30:22.122ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4842024-09-25T17:30:22.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4852024-09-25T17:30:22.124ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4862024-09-25T17:30:22.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4872024-09-25T17:30:22.126ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4882024-09-25T17:30:22.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4892024-09-25T17:30:22.128ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4902024-09-25T17:30:22.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4912024-09-25T17:30:22.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4922024-09-25T17:30:22.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4932024-09-25T17:30:22.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4942024-09-25T17:30:22.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4952024-09-25T17:30:22.135ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 6e5d68bf-01bc-412c-9915-3ad6fd435156, rack_id: 5c1bad99-30b8-419d-9695-a982a6249225, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5d8104c-5830-4cb9-9490-d372d8c75371) } rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
4962024-09-25T17:30:22.135ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4972024-09-25T17:30:22.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4982024-09-25T17:30:22.144ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4992024-09-25T17:30:22.144ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "634f9383-5201-4b8e-adcb-a1fe11f5bb04", "content-length": "121", "date": "Wed, 25 Sep 2024 17:30:22 GMT"} })
5002024-09-25T17:30:22.144ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
5012024-09-25T17:30:22.144ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5d8104c-5830-4cb9-9490-d372d8c75371
5022024-09-25T17:30:22.145ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5032024-09-25T17:30:22.145ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5042024-09-25T17:30:22.145ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
5052024-09-25T17:30:22.145ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
5062024-09-25T17:30:22.145ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
5072024-09-25T17:30:22.145ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5082024-09-25T17:30:22.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5092024-09-25T17:30:22.146ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
5102024-09-25T17:30:22.146ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cbb1aa8d-c410-4d28-a290-bc4cad814e36", "content-length": "2", "date": "Wed, 25 Sep 2024 17:30:22 GMT"} })
5112024-09-25T17:30:22.146ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
5122024-09-25T17:30:22.147ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ffa0062c-777a-4f19-a6ff-a6214de2944b", "content-length": "52", "date": "Wed, 25 Sep 2024 17:30:22 GMT"} })
5132024-09-25T17:30:22.147ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
5142024-09-25T17:30:22.147ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5152024-09-25T17:30:22.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5162024-09-25T17:30:22.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5172024-09-25T17:30:22.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5182024-09-25T17:30:22.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5192024-09-25T17:30:22.184ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5202024-09-25T17:30:22.188ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
5212024-09-25T17:30:22.188ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5222024-09-25T17:30:22.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5232024-09-25T17:30:22.189ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5242024-09-25T17:30:22.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5252024-09-25T17:30:22.191ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5262024-09-25T17:30:22.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5272024-09-25T17:30:22.192ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5282024-09-25T17:30:22.195ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
5292024-09-25T17:30:22.195ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5302024-09-25T17:30:22.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5312024-09-25T17:30:22.201ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 0ce0716f-f8c9-4394-83de-e3c9a307c077, kind: Service { id: be8cd1d4-baa8-48cc-872f-69bc5c2df30c }, name: Name("external-dns-be8cd1d4-baa8-48cc-872f-69bc5c2df30c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6c11a918-fc94-4079-bc26-a4214182088e, kind: Service { id: ae9bf3cd-ff12-421b-b5a2-d52b18bde4b3 }, name: Name("external-dns-ae9bf3cd-ff12-421b-b5a2-d52b18bde4b3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 63])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 29e9a065-ed81-4ab9-a046-135ca8f6fa8a, kind: Service { id: f498676d-98ca-4df7-a306-c337617f6891 }, name: Name("nexus-f498676d-98ca-4df7-a306-c337617f6891"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae338cab-a4a6-4cf1-a3ee-cbd6fa5a4190, kind: Service { id: 313e9723-c1f8-48c7-a257-702d615dcb31 }, name: Name("nexus-313e9723-c1f8-48c7-a257-702d615dcb31"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d18351e9-a721-467d-aba3-5783c5185b9d, kind: Service { id: 2fc249d5-9788-4a35-ad94-1440f36e8698 }, name: Name("nexus-2fc249d5-9788-4a35-ad94-1440f36e8698"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
5322024-09-25T17:30:22.201ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5332024-09-25T17:30:22.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5342024-09-25T17:30:22.203ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5352024-09-25T17:30:22.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
5362024-09-25T17:30:22.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5372024-09-25T17:30:22.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5382024-09-25T17:30:22.206ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
5392024-09-25T17:30:22.206ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0ce0716f-f8c9-4394-83de-e3c9a307c077, kind: Service { id: be8cd1d4-baa8-48cc-872f-69bc5c2df30c }, name: Name("external-dns-be8cd1d4-baa8-48cc-872f-69bc5c2df30c"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 142])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6c11a918-fc94-4079-bc26-a4214182088e, kind: Service { id: ae9bf3cd-ff12-421b-b5a2-d52b18bde4b3 }, name: Name("external-dns-ae9bf3cd-ff12-421b-b5a2-d52b18bde4b3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 63])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 29e9a065-ed81-4ab9-a046-135ca8f6fa8a, kind: Service { id: f498676d-98ca-4df7-a306-c337617f6891 }, name: Name("nexus-f498676d-98ca-4df7-a306-c337617f6891"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 186, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ae338cab-a4a6-4cf1-a3ee-cbd6fa5a4190, kind: Service { id: 313e9723-c1f8-48c7-a257-702d615dcb31 }, name: Name("nexus-313e9723-c1f8-48c7-a257-702d615dcb31"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 232])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d18351e9-a721-467d-aba3-5783c5185b9d, kind: Service { id: 2fc249d5-9788-4a35-ad94-1440f36e8698 }, name: Name("nexus-2fc249d5-9788-4a35-ad94-1440f36e8698"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 215])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
5402024-09-25T17:30:22.206ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
5412024-09-25T17:30:22.261ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: f0d006a2-eb4a-4510-8a1c-6c144343343f, time_created: 2024-09-25T17:25:39.350977Z, time_modified: 2024-09-25T17:25:39.350977Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5c1bad99-30b8-419d-9695-a982a6249225, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
5422024-09-25T17:30:22.261ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
5432024-09-25T17:30:22.261ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5442024-09-25T17:30:22.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5452024-09-25T17:30:22.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5462024-09-25T17:30:22.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5472024-09-25T17:30:22.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5482024-09-25T17:30:22.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: f0d006a2-eb4a-4510-8a1c-6c144343343f, lookup_type: ById(f0d006a2-eb4a-4510-8a1c-6c144343343f) } result = Ok(())
5492024-09-25T17:30:22.279ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cb77ac8c-e76d-4cbe-948b-b6f4e41233f8", "date": "Wed, 25 Sep 2024 17:30:21 GMT"} })
5502024-09-25T17:30:22.279ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch = Switch0
5512024-09-25T17:30:22.279ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5522024-09-25T17:30:22.279ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "405d3c56-940e-471e-af2c-9cc80435000b", "content-length": "667", "date": "Wed, 25 Sep 2024 17:30:22 GMT"} })
5532024-09-25T17:30:22.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5542024-09-25T17:30:22.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5552024-09-25T17:30:22.283ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5562024-09-25T17:30:22.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5572024-09-25T17:30:22.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5582024-09-25T17:30:22.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5592024-09-25T17:30:22.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5602024-09-25T17:30:22.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5612024-09-25T17:30:22.297ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 809.113978ms iteration = 11 status = {}
5622024-09-25T17:30:22.299ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
5632024-09-25T17:30:22.299ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ddbf6f72-9d64-4803-ab8b-7ab1564a4773", "date": "Wed, 25 Sep 2024 17:30:21 GMT"} })
5642024-09-25T17:30:22.301ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
5652024-09-25T17:30:22.301ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 812.559032ms
5662024-09-25T17:30:22.301ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 812.566652ms iteration = 2 status = {}
5672024-09-25T17:30:23.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 082c8e89-c79b-4616-8258-db6e4b295b80 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
5682024-09-25T17:30:23.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 082c8e89-c79b-4616-8258-db6e4b295b80 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
5692024-09-25T17:30:23.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 082c8e89-c79b-4616-8258-db6e4b295b80 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
5702024-09-25T17:30:23.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5dc2de65-c46b-4034-9023-aa751c77c4df roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
5712024-09-25T17:30:23.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5dc2de65-c46b-4034-9023-aa751c77c4df resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
5722024-09-25T17:30:23.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5dc2de65-c46b-4034-9023-aa751c77c4df response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
5732024-09-25T17:30:24.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1028d510-44f5-4ea9-8c2e-b7f8aaef6e2b roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
5742024-09-25T17:30:24.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1028d510-44f5-4ea9-8c2e-b7f8aaef6e2b resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
5752024-09-25T17:30:24.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1028d510-44f5-4ea9-8c2e-b7f8aaef6e2b response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
5762024-09-25T17:30:25.142ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:41063
5772024-09-25T17:30:25.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41063 req_id = 79b8fd32-a561-4f73-83f1-f186b1dab1de roles = RoleSet { roles: {} } uri = /metrics/producers
5782024-09-25T17:30:25.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41063 req_id = 79b8fd32-a561-4f73-83f1-f186b1dab1de resource = Database result = Ok(()) uri = /metrics/producers
5792024-09-25T17:30:25.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 60dc3215-d56a-48d0-a7d0-e062944bac79 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
5802024-09-25T17:30:25.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 60dc3215-d56a-48d0-a7d0-e062944bac79 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
5812024-09-25T17:30:25.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 60dc3215-d56a-48d0-a7d0-e062944bac79 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
5822024-09-25T17:30:25.169ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:57004
5832024-09-25T17:30:25.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57004 req_id = 9d28a4f4-4314-4ec9-a60f-813666fc78bf roles = RoleSet { roles: {} } uri = /metrics/producers
5842024-09-25T17:30:25.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57004 req_id = 9d28a4f4-4314-4ec9-a60f-813666fc78bf resource = Database result = Ok(()) uri = /metrics/producers
5852024-09-25T17:30:25.181ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
5862024-09-25T17:30:25.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41063 req_id = 79b8fd32-a561-4f73-83f1-f186b1dab1de roles = RoleSet { roles: {} } uri = /metrics/producers
5872024-09-25T17:30:25.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41063 req_id = 79b8fd32-a561-4f73-83f1-f186b1dab1de resource = Database result = Ok(()) uri = /metrics/producers
5882024-09-25T17:30:25.207ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
5892024-09-25T17:30:25.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57004 req_id = 9d28a4f4-4314-4ec9-a60f-813666fc78bf roles = RoleSet { roles: {} } uri = /metrics/producers
5902024-09-25T17:30:25.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57004 req_id = 9d28a4f4-4314-4ec9-a60f-813666fc78bf resource = Database result = Ok(()) uri = /metrics/producers
5912024-09-25T17:30:25.217ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
5922024-09-25T17:30:25.218ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "60f9ba5f-91eb-44a4-a81b-a771cec2fbcf", "date": "Wed, 25 Sep 2024 17:30:25 GMT"} })
5932024-09-25T17:30:25.218ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = fd342822-d2f0-4be0-8561-e7a748d52087
5942024-09-25T17:30:25.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 77648 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41063 req_id = 79b8fd32-a561-4f73-83f1-f186b1dab1de response_code = 201 uri = /metrics/producers
5952024-09-25T17:30:25.237ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
5962024-09-25T17:30:25.237ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6bba357f-99df-4a80-947a-2020ebfe972b", "date": "Wed, 25 Sep 2024 17:30:25 GMT"} })
5972024-09-25T17:30:25.237ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = ac63bbf5-a00d-448f-b231-397bfcb31b7d
5982024-09-25T17:30:25.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 70351 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57004 req_id = 9d28a4f4-4314-4ec9-a60f-813666fc78bf response_code = 201 uri = /metrics/producers
5992024-09-25T17:30:25.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1536 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 57bfbe8e-4898-4c20-8001-138e446d11c6 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
6002024-09-25T17:30:26.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0e106de7-e47a-46ee-807e-99d020e0d13f roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6012024-09-25T17:30:26.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0e106de7-e47a-46ee-807e-99d020e0d13f resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6022024-09-25T17:30:26.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0e106de7-e47a-46ee-807e-99d020e0d13f response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6032024-09-25T17:30:27.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ba0ae89f-d10d-4564-aed5-eb6034ac61f9 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6042024-09-25T17:30:27.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ba0ae89f-d10d-4564-aed5-eb6034ac61f9 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6052024-09-25T17:30:27.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ba0ae89f-d10d-4564-aed5-eb6034ac61f9 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6062024-09-25T17:30:28.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d1f3466f-61ef-4266-86d9-bcf4e4eb6b53 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6072024-09-25T17:30:28.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d1f3466f-61ef-4266-86d9-bcf4e4eb6b53 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6082024-09-25T17:30:28.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d1f3466f-61ef-4266-86d9-bcf4e4eb6b53 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6092024-09-25T17:30:29.167ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:36827
6102024-09-25T17:30:29.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36827 req_id = 5588783e-8253-4017-83de-28808d1515e8 roles = RoleSet { roles: {} } uri = /metrics/producers
6112024-09-25T17:30:29.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36827 req_id = 5588783e-8253-4017-83de-28808d1515e8 resource = Database result = Ok(()) uri = /metrics/producers
6122024-09-25T17:30:29.200ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
6132024-09-25T17:30:29.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36827 req_id = 5588783e-8253-4017-83de-28808d1515e8 roles = RoleSet { roles: {} } uri = /metrics/producers
6142024-09-25T17:30:29.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36827 req_id = 5588783e-8253-4017-83de-28808d1515e8 resource = Database result = Ok(()) uri = /metrics/producers
6152024-09-25T17:30:29.210ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
6162024-09-25T17:30:29.210ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d5aff164-4c2f-473b-8f69-0ea841a41e39", "date": "Wed, 25 Sep 2024 17:30:29 GMT"} })
6172024-09-25T17:30:29.210ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = 4251ad8b-dbc2-403a-ad95-0a1062ebfb52
6182024-09-25T17:30:29.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 43429 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36827 req_id = 5588783e-8253-4017-83de-28808d1515e8 response_code = 201 uri = /metrics/producers
6192024-09-25T17:30:29.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f86edfe8-eae5-4877-8b10-d5b373214c3c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6202024-09-25T17:30:29.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f86edfe8-eae5-4877-8b10-d5b373214c3c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6212024-09-25T17:30:29.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f86edfe8-eae5-4877-8b10-d5b373214c3c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6222024-09-25T17:30:30.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 992d357d-7478-4d9d-84ed-1627a7fe775e roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6232024-09-25T17:30:30.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 992d357d-7478-4d9d-84ed-1627a7fe775e resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6242024-09-25T17:30:30.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 992d357d-7478-4d9d-84ed-1627a7fe775e response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6252024-09-25T17:30:30.693ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:59874
6262024-09-25T17:30:30.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59874 req_id = 80166ffa-4186-44c2-8d3b-03103513e16a roles = RoleSet { roles: {} } uri = /metrics/producers
6272024-09-25T17:30:30.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59874 req_id = 80166ffa-4186-44c2-8d3b-03103513e16a resource = Database result = Ok(()) uri = /metrics/producers
6282024-09-25T17:30:30.726ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
6292024-09-25T17:30:30.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59874 req_id = 80166ffa-4186-44c2-8d3b-03103513e16a roles = RoleSet { roles: {} } uri = /metrics/producers
6302024-09-25T17:30:30.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59874 req_id = 80166ffa-4186-44c2-8d3b-03103513e16a resource = Database result = Ok(()) uri = /metrics/producers
6312024-09-25T17:30:30.733ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
6322024-09-25T17:30:30.733ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3be731ea-3d53-4fd8-aa30-9180b9ad6e3a", "date": "Wed, 25 Sep 2024 17:30:30 GMT"} })
6332024-09-25T17:30:30.733ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = a18a8a51-3215-4e6c-86bc-50d6d9f8b136
6342024-09-25T17:30:30.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42100 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59874 req_id = 80166ffa-4186-44c2-8d3b-03103513e16a response_code = 201 uri = /metrics/producers
6352024-09-25T17:30:31.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 357aeeea-23bc-443e-a25a-e410948486dd roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6362024-09-25T17:30:31.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 357aeeea-23bc-443e-a25a-e410948486dd resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6372024-09-25T17:30:31.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 357aeeea-23bc-443e-a25a-e410948486dd response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6382024-09-25T17:30:31.487ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
6392024-09-25T17:30:31.487ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6402024-09-25T17:30:31.487ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
6412024-09-25T17:30:31.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6422024-09-25T17:30:31.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6432024-09-25T17:30:31.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6442024-09-25T17:30:31.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6452024-09-25T17:30:31.492ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:59821
6462024-09-25T17:30:31.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59821 req_id = 7b9eee9e-028f-4919-bc69-19e2d95fdc37 roles = RoleSet { roles: {} } uri = /metrics/producers
6472024-09-25T17:30:31.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59821 req_id = 7b9eee9e-028f-4919-bc69-19e2d95fdc37 resource = Database result = Ok(()) uri = /metrics/producers
6482024-09-25T17:30:31.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6492024-09-25T17:30:31.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6502024-09-25T17:30:31.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6512024-09-25T17:30:31.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6522024-09-25T17:30:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6532024-09-25T17:30:31.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6542024-09-25T17:30:31.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
6552024-09-25T17:30:31.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6562024-09-25T17:30:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6572024-09-25T17:30:31.508ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
6582024-09-25T17:30:31.508ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.533801ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
6592024-09-25T17:30:31.515ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6602024-09-25T17:30:31.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6612024-09-25T17:30:31.538ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
6622024-09-25T17:30:31.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59821 req_id = 7b9eee9e-028f-4919-bc69-19e2d95fdc37 roles = RoleSet { roles: {} } uri = /metrics/producers
6632024-09-25T17:30:31.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59821 req_id = 7b9eee9e-028f-4919-bc69-19e2d95fdc37 resource = Database result = Ok(()) uri = /metrics/producers
6642024-09-25T17:30:31.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.147927ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6652024-09-25T17:30:31.577ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
6662024-09-25T17:30:31.578ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "59265eda-4bd9-48e0-a39e-42dc6bbc7ab7", "date": "Wed, 25 Sep 2024 17:30:30 GMT"} })
6672024-09-25T17:30:31.578ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = f0d006a2-eb4a-4510-8a1c-6c144343343f
6682024-09-25T17:30:31.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 87120 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59821 req_id = 7b9eee9e-028f-4919-bc69-19e2d95fdc37 response_code = 201 uri = /metrics/producers
6692024-09-25T17:30:32.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9af52564-1a01-4ce8-9207-6c54ad5e8c90 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6702024-09-25T17:30:32.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9af52564-1a01-4ce8-9207-6c54ad5e8c90 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6712024-09-25T17:30:32.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9af52564-1a01-4ce8-9207-6c54ad5e8c90 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6722024-09-25T17:30:33.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a6e37fe0-59dc-47e9-ab97-0b161e59582c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6732024-09-25T17:30:33.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a6e37fe0-59dc-47e9-ab97-0b161e59582c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6742024-09-25T17:30:33.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a6e37fe0-59dc-47e9-ab97-0b161e59582c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6752024-09-25T17:30:34.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 011bcc9b-fa3d-4f54-861a-b2718fe0a3fa roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6762024-09-25T17:30:34.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 011bcc9b-fa3d-4f54-861a-b2718fe0a3fa resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6772024-09-25T17:30:34.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 011bcc9b-fa3d-4f54-861a-b2718fe0a3fa response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6782024-09-25T17:30:35.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1354 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = b065590d-8269-4b51-8b80-0959adf500d6 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
6792024-09-25T17:30:35.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1b662f19-4b0d-49da-9a25-b02a9bd6520d roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6802024-09-25T17:30:35.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1b662f19-4b0d-49da-9a25-b02a9bd6520d resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6812024-09-25T17:30:35.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1b662f19-4b0d-49da-9a25-b02a9bd6520d response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6822024-09-25T17:30:36.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3feb364f-2c71-4f5d-bbc8-d5db8c7bf800 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6832024-09-25T17:30:36.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3feb364f-2c71-4f5d-bbc8-d5db8c7bf800 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6842024-09-25T17:30:36.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3feb364f-2c71-4f5d-bbc8-d5db8c7bf800 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6852024-09-25T17:30:37.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dfd4b2e9-301a-4058-9373-8f6c776b660e roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6862024-09-25T17:30:37.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dfd4b2e9-301a-4058-9373-8f6c776b660e resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6872024-09-25T17:30:37.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2602 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dfd4b2e9-301a-4058-9373-8f6c776b660e response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6882024-09-25T17:30:38.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a19955f4-9ae4-47b1-8191-c3baade047e1 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6892024-09-25T17:30:38.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a19955f4-9ae4-47b1-8191-c3baade047e1 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6902024-09-25T17:30:38.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a19955f4-9ae4-47b1-8191-c3baade047e1 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6912024-09-25T17:30:39.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 81c16127-dd73-408d-9680-71ffb7f48ee7 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6922024-09-25T17:30:39.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 81c16127-dd73-408d-9680-71ffb7f48ee7 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6932024-09-25T17:30:39.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 81c16127-dd73-408d-9680-71ffb7f48ee7 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6942024-09-25T17:30:40.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a79fbb28-6342-4b21-9d50-67f91f30bafd roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6952024-09-25T17:30:40.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a79fbb28-6342-4b21-9d50-67f91f30bafd resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6962024-09-25T17:30:40.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a79fbb28-6342-4b21-9d50-67f91f30bafd response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
6972024-09-25T17:30:41.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
6982024-09-25T17:30:41.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
6992024-09-25T17:30:41.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7002024-09-25T17:30:41.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7012024-09-25T17:30:41.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7022024-09-25T17:30:41.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7032024-09-25T17:30:41.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7042024-09-25T17:30:41.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7052024-09-25T17:30:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7062024-09-25T17:30:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7072024-09-25T17:30:41.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7082024-09-25T17:30:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7092024-09-25T17:30:41.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7102024-09-25T17:30:41.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7112024-09-25T17:30:41.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7122024-09-25T17:30:41.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
7132024-09-25T17:30:41.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7142024-09-25T17:30:41.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7152024-09-25T17:30:41.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9ceb2aa8-12ae-4432-b176-9158d5e762ce roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7162024-09-25T17:30:41.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9ceb2aa8-12ae-4432-b176-9158d5e762ce resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7172024-09-25T17:30:41.504ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
7182024-09-25T17:30:41.504ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.225312ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
7192024-09-25T17:30:41.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9ceb2aa8-12ae-4432-b176-9158d5e762ce response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7202024-09-25T17:30:41.523ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.230934ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7212024-09-25T17:30:42.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7ba716f1-bbb3-414f-9c84-edc9016c8437 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7222024-09-25T17:30:42.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7ba716f1-bbb3-414f-9c84-edc9016c8437 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7232024-09-25T17:30:42.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7ba716f1-bbb3-414f-9c84-edc9016c8437 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7242024-09-25T17:30:43.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5857d87f-8454-477d-9681-3b93818c165d roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7252024-09-25T17:30:43.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5857d87f-8454-477d-9681-3b93818c165d resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7262024-09-25T17:30:43.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5857d87f-8454-477d-9681-3b93818c165d response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7272024-09-25T17:30:44.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3eea2539-903a-43fd-bf6e-26b69a8bffe9 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7282024-09-25T17:30:44.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3eea2539-903a-43fd-bf6e-26b69a8bffe9 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7292024-09-25T17:30:44.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3eea2539-903a-43fd-bf6e-26b69a8bffe9 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7302024-09-25T17:30:44.972ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:63137
7312024-09-25T17:30:44.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63137 req_id = 453b5e51-10d4-4c59-b96a-ba36b9f65009 roles = RoleSet { roles: {} } uri = /metrics/producers
7322024-09-25T17:30:44.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63137 req_id = 453b5e51-10d4-4c59-b96a-ba36b9f65009 resource = Database result = Ok(()) uri = /metrics/producers
7332024-09-25T17:30:45.006ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
7342024-09-25T17:30:45.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63137 req_id = 453b5e51-10d4-4c59-b96a-ba36b9f65009 roles = RoleSet { roles: {} } uri = /metrics/producers
7352024-09-25T17:30:45.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63137 req_id = 453b5e51-10d4-4c59-b96a-ba36b9f65009 resource = Database result = Ok(()) uri = /metrics/producers
7362024-09-25T17:30:45.044ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
7372024-09-25T17:30:45.044ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a11044fb-0721-446a-9703-db4a49fcb262", "date": "Wed, 25 Sep 2024 17:30:45 GMT"} })
7382024-09-25T17:30:45.044ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = c811776d-391a-4536-8874-314f94386d41
7392024-09-25T17:30:45.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 72793 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63137 req_id = 453b5e51-10d4-4c59-b96a-ba36b9f65009 response_code = 201 uri = /metrics/producers
7402024-09-25T17:30:45.285ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = c0a35611-361e-4f09-b6c1-e525db31c1ed response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
7412024-09-25T17:30:45.286ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
7422024-09-25T17:30:45.286ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
7432024-09-25T17:30:45.316ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
7442024-09-25T17:30:45.316ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:49748
7452024-09-25T17:30:45.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49748 req_id = dd71d18a-10f8-471d-a15d-af1cc631a828 roles = RoleSet { roles: {} } uri = /metrics/producers
7462024-09-25T17:30:45.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49748 req_id = dd71d18a-10f8-471d-a15d-af1cc631a828 resource = Database result = Ok(()) uri = /metrics/producers
7472024-09-25T17:30:45.351ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
7482024-09-25T17:30:45.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49748 req_id = dd71d18a-10f8-471d-a15d-af1cc631a828 roles = RoleSet { roles: {} } uri = /metrics/producers
7492024-09-25T17:30:45.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49748 req_id = dd71d18a-10f8-471d-a15d-af1cc631a828 resource = Database result = Ok(()) uri = /metrics/producers
7502024-09-25T17:30:45.384ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
7512024-09-25T17:30:45.384ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c87f3915-6a5c-4c6e-84da-065c4e15e236", "date": "Wed, 25 Sep 2024 17:30:45 GMT"} })
7522024-09-25T17:30:45.384ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
7532024-09-25T17:30:45.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 70073 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:49748 req_id = dd71d18a-10f8-471d-a15d-af1cc631a828 response_code = 201 uri = /metrics/producers
7542024-09-25T17:30:45.386ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "dd71d18a-10f8-471d-a15d-af1cc631a828", "content-length": "41", "date": "Wed, 25 Sep 2024 17:30:44 GMT"} })
7552024-09-25T17:30:45.387ZDEBGnexus (producer-registration-task): registered with nexus successfully
7562024-09-25T17:30:45.387ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
7572024-09-25T17:30:45.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4c6ceb13-bb3f-4a46-8e66-8d7eaf2ddc13 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7582024-09-25T17:30:45.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4c6ceb13-bb3f-4a46-8e66-8d7eaf2ddc13 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7592024-09-25T17:30:45.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4c6ceb13-bb3f-4a46-8e66-8d7eaf2ddc13 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7602024-09-25T17:30:46.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d7db7742-57b1-4b78-80cc-6166b4feef8d roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7612024-09-25T17:30:46.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d7db7742-57b1-4b78-80cc-6166b4feef8d resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7622024-09-25T17:30:46.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d7db7742-57b1-4b78-80cc-6166b4feef8d response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7632024-09-25T17:30:47.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0fe0edd8-803f-4f68-b883-f12c11812c8b roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7642024-09-25T17:30:47.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0fe0edd8-803f-4f68-b883-f12c11812c8b resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7652024-09-25T17:30:47.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0fe0edd8-803f-4f68-b883-f12c11812c8b response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7662024-09-25T17:30:48.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 43c5dc71-6267-431c-8912-cdd27d11644a roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7672024-09-25T17:30:48.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 43c5dc71-6267-431c-8912-cdd27d11644a resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7682024-09-25T17:30:48.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 43c5dc71-6267-431c-8912-cdd27d11644a response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7692024-09-25T17:30:49.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1c082b8c-84f3-42fa-9d54-029ad39f27ad roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7702024-09-25T17:30:49.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1c082b8c-84f3-42fa-9d54-029ad39f27ad resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7712024-09-25T17:30:49.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1813 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1c082b8c-84f3-42fa-9d54-029ad39f27ad response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7722024-09-25T17:30:50.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b843ece6-8982-407d-880b-3714fa783cfe roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7732024-09-25T17:30:50.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b843ece6-8982-407d-880b-3714fa783cfe resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7742024-09-25T17:30:50.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b843ece6-8982-407d-880b-3714fa783cfe response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
7752024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
7762024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
7772024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7782024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
7792024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
7802024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
7812024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
7822024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7832024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
7842024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7852024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7862024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
7872024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
7882024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
7892024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
7902024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
7912024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7922024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
7932024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7942024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7952024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
7962024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
7972024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7982024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7992024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
8002024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8012024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
8022024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
8032024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
8042024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8052024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
8062024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8072024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
8082024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8092024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
8102024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8112024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8122024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8132024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8142024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8152024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8162024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8172024-09-25T17:30:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8182024-09-25T17:30:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
8192024-09-25T17:30:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8202024-09-25T17:30:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8212024-09-25T17:30:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8222024-09-25T17:30:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
8232024-09-25T17:30:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8242024-09-25T17:30:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8252024-09-25T17:30:51.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8262024-09-25T17:30:51.492ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2579, tv_nsec: 607928519 } })
8272024-09-25T17:30:51.492ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.33052ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
8282024-09-25T17:30:51.493ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
8292024-09-25T17:30:51.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8302024-09-25T17:30:51.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
8312024-09-25T17:30:51.495ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8322024-09-25T17:30:51.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8332024-09-25T17:30:51.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
8342024-09-25T17:30:51.496ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8352024-09-25T17:30:51.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8362024-09-25T17:30:51.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8372024-09-25T17:30:51.499ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2579, tv_nsec: 614948020 } })
8382024-09-25T17:30:51.500ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
8392024-09-25T17:30:51.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8402024-09-25T17:30:51.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8412024-09-25T17:30:51.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8422024-09-25T17:30:51.506ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8432024-09-25T17:30:51.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8442024-09-25T17:30:51.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8452024-09-25T17:30:51.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8462024-09-25T17:30:51.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8472024-09-25T17:30:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
8482024-09-25T17:30:51.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8492024-09-25T17:30:51.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8502024-09-25T17:30:51.541ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2579, tv_nsec: 657266826 } })
8512024-09-25T17:30:51.542ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.419511ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
8522024-09-25T17:30:51.544ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
8532024-09-25T17:30:51.548ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8542024-09-25T17:30:51.548ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
8552024-09-25T17:30:51.548ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8562024-09-25T17:30:51.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8572024-09-25T17:30:51.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8582024-09-25T17:30:51.553ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8592024-09-25T17:30:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8602024-09-25T17:30:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8612024-09-25T17:30:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8622024-09-25T17:30:51.555ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8632024-09-25T17:30:51.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8642024-09-25T17:30:51.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8652024-09-25T17:30:51.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8662024-09-25T17:30:51.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8672024-09-25T17:30:51.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8682024-09-25T17:30:51.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8692024-09-25T17:30:51.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.892993ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
8702024-09-25T17:30:51.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8712024-09-25T17:30:51.566ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8722024-09-25T17:30:51.566ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.831006ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8732024-09-25T17:30:51.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8742024-09-25T17:30:51.569ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8752024-09-25T17:30:51.569ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8762024-09-25T17:30:51.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8772024-09-25T17:30:51.571ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8782024-09-25T17:30:51.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8792024-09-25T17:30:51.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8802024-09-25T17:30:51.572ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8812024-09-25T17:30:51.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8822024-09-25T17:30:51.578ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
8832024-09-25T17:30:51.578ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8842024-09-25T17:30:51.578ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8beec97a-dc9f-4c45-91f6-6211a7d1a12f", "content-length": "26", "date": "Wed, 25 Sep 2024 17:30:50 GMT"} })
8852024-09-25T17:30:51.578ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8862024-09-25T17:30:51.580ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
8872024-09-25T17:30:51.580ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8882024-09-25T17:30:51.581ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8892024-09-25T17:30:51.581ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8679b362-ac58-4ed5-abd7-ab452a94c854", "content-length": "26", "date": "Wed, 25 Sep 2024 17:30:50 GMT"} })
8902024-09-25T17:30:51.581ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8912024-09-25T17:30:51.583ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8922024-09-25T17:30:51.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8932024-09-25T17:30:51.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
8942024-09-25T17:30:51.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8952024-09-25T17:30:51.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8962024-09-25T17:30:51.591ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.181966ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
8972024-09-25T17:30:51.600ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8982024-09-25T17:30:51.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8992024-09-25T17:30:51.601ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9002024-09-25T17:30:51.601ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
9012024-09-25T17:30:51.601ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9022024-09-25T17:30:51.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9032024-09-25T17:30:51.644ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9042024-09-25T17:30:51.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9052024-09-25T17:30:51.646ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 zone_address = fd00:1122:3344:101::2
9062024-09-25T17:30:51.646ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9072024-09-25T17:30:51.647ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5fc0808b-1444-44ea-a9df-4a250c0f568b", "content-length": "26", "date": "Wed, 25 Sep 2024 17:30:50 GMT"} })
9082024-09-25T17:30:51.647ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9092024-09-25T17:30:51.648ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
9102024-09-25T17:30:51.673ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9112024-09-25T17:30:51.673ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5e57cbbd-66fa-437c-a4e0-16214410bb74", "content-length": "372", "date": "Wed, 25 Sep 2024 17:30:51 GMT"} })
9122024-09-25T17:30:51.673ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9132024-09-25T17:30:51.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9142024-09-25T17:30:51.675ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9152024-09-25T17:30:51.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9162024-09-25T17:30:51.676ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9172024-09-25T17:30:51.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9182024-09-25T17:30:51.678ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9192024-09-25T17:30:51.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9202024-09-25T17:30:51.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9212024-09-25T17:30:51.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f0d006a2-eb4a-4510-8a1c-6c144343343f, lookup_type: ById(f0d006a2-eb4a-4510-8a1c-6c144343343f) } result = Ok(())
9222024-09-25T17:30:51.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9232024-09-25T17:30:51.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9242024-09-25T17:30:51.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9252024-09-25T17:30:51.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9262024-09-25T17:30:51.683ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 194.827349ms iteration = 12 status = 0
9272024-09-25T17:30:51.683ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
9282024-09-25T17:30:51.683ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 195.322328ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
9292024-09-25T17:30:51.685ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9302024-09-25T17:30:51.685ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5f312017-e28c-4a3c-8824-7e3679f04049", "date": "Wed, 25 Sep 2024 17:30:51 GMT"} })
9312024-09-25T17:30:51.687ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 198.711411ms iteration = 13 status = {}
9322024-09-25T17:30:51.697ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 209.328088ms iteration = 12 status = {}
9332024-09-25T17:30:51.697ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
9342024-09-25T17:30:51.698ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f178e13f-a31d-482e-b742-6eb7b291f20c", "content-length": "1", "date": "Wed, 25 Sep 2024 17:30:51 GMT"} })
9352024-09-25T17:30:51.699ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9362024-09-25T17:30:51.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9372024-09-25T17:30:51.702ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 213.833382ms iteration = 12 status = null
9382024-09-25T17:30:51.707ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9392024-09-25T17:30:51.708ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 220.337452ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9402024-09-25T17:30:51.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9412024-09-25T17:30:51.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9422024-09-25T17:30:51.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9432024-09-25T17:30:51.710ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9442024-09-25T17:30:51.710ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
9452024-09-25T17:30:51.710ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 222.330949ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
9462024-09-25T17:30:51.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c1b8f809-b4ed-4f91-932f-6ee9e5b8af5f roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
9472024-09-25T17:30:51.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c1b8f809-b4ed-4f91-932f-6ee9e5b8af5f resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
9482024-09-25T17:30:51.719ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 230.803916ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
9492024-09-25T17:30:51.719ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c1b8f809-b4ed-4f91-932f-6ee9e5b8af5f response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
9502024-09-25T17:30:51.719ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 231.48872ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
9512024-09-25T17:30:51.769ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9522024-09-25T17:30:51.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9532024-09-25T17:30:51.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9542024-09-25T17:30:51.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9552024-09-25T17:30:51.779ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 6e5d68bf-01bc-412c-9915-3ad6fd435156, rack_id: 5c1bad99-30b8-419d-9695-a982a6249225, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5d8104c-5830-4cb9-9490-d372d8c75371) } rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
9562024-09-25T17:30:51.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9572024-09-25T17:30:51.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9582024-09-25T17:30:51.789ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
9592024-09-25T17:30:51.789ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8873ca3a-8bda-45c9-9de9-8143a45149e2", "content-length": "121", "date": "Wed, 25 Sep 2024 17:30:51 GMT"} })
9602024-09-25T17:30:51.789ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
9612024-09-25T17:30:51.789ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5d8104c-5830-4cb9-9490-d372d8c75371
9622024-09-25T17:30:51.789ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9632024-09-25T17:30:51.789ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9642024-09-25T17:30:51.789ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
9652024-09-25T17:30:51.789ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
9662024-09-25T17:30:51.789ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
9672024-09-25T17:30:51.789ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9682024-09-25T17:30:51.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9692024-09-25T17:30:51.791ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
9702024-09-25T17:30:51.792ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "63010693-eef4-4505-a961-33ca2527cd4f", "content-length": "2", "date": "Wed, 25 Sep 2024 17:30:51 GMT"} })
9712024-09-25T17:30:51.792ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
9722024-09-25T17:30:51.794ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b39caea6-584b-470a-916e-4665a5b3b7e4", "content-length": "52", "date": "Wed, 25 Sep 2024 17:30:51 GMT"} })
9732024-09-25T17:30:51.794ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
9742024-09-25T17:30:51.794ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9752024-09-25T17:30:51.797ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 308.876967ms iteration = 15 status = {"physical_disks_added":0}
9762024-09-25T17:30:51.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9772024-09-25T17:30:51.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9782024-09-25T17:30:51.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9792024-09-25T17:30:51.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9802024-09-25T17:30:51.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9812024-09-25T17:30:51.835ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9822024-09-25T17:30:51.835ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9832024-09-25T17:30:51.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9842024-09-25T17:30:51.870ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9852024-09-25T17:30:51.891ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "63d866d7-196a-4488-a6e9-e7eefea9ff6d", "date": "Wed, 25 Sep 2024 17:30:51 GMT"} })
9862024-09-25T17:30:51.891ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch = Switch0
9872024-09-25T17:30:51.891ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9882024-09-25T17:30:51.892ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6ef3f984-57d9-481b-8b1d-3e78faa4c0e4", "content-length": "691", "date": "Wed, 25 Sep 2024 17:30:51 GMT"} })
9892024-09-25T17:30:51.892ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
9902024-09-25T17:30:51.892ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
9912024-09-25T17:30:51.892ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
9922024-09-25T17:30:51.892ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0128f357-9b84-4dbd-8bb9-6508950d76db", "content-length": "667", "date": "Wed, 25 Sep 2024 17:30:51 GMT"} })
9932024-09-25T17:30:51.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9942024-09-25T17:30:51.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9952024-09-25T17:30:51.893ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 404.964221ms iteration = 12 status = {}
9962024-09-25T17:30:51.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9972024-09-25T17:30:51.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9982024-09-25T17:30:51.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9992024-09-25T17:30:51.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10002024-09-25T17:30:51.902ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10012024-09-25T17:30:51.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10022024-09-25T17:30:51.908ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 420.433529ms iteration = 12 status = {}
10032024-09-25T17:30:52.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ee18b9b4-41fc-4a56-b5cc-4f6ef8129b48 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10042024-09-25T17:30:52.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ee18b9b4-41fc-4a56-b5cc-4f6ef8129b48 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10052024-09-25T17:30:52.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ee18b9b4-41fc-4a56-b5cc-4f6ef8129b48 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10062024-09-25T17:30:53.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = db2558f0-e8bf-4441-b60a-414e6c165728 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
10072024-09-25T17:30:53.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = db2558f0-e8bf-4441-b60a-414e6c165728 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
10082024-09-25T17:30:53.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3495 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = db2558f0-e8bf-4441-b60a-414e6c165728 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
10092024-09-25T17:30:53.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1faf42b7-8ca2-41b6-8b98-bb925297998a roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10102024-09-25T17:30:53.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1faf42b7-8ca2-41b6-8b98-bb925297998a resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10112024-09-25T17:30:53.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1faf42b7-8ca2-41b6-8b98-bb925297998a response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10122024-09-25T17:30:54.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f726dbae-8782-4435-b5c0-5b2ce139f9ac roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10132024-09-25T17:30:54.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f726dbae-8782-4435-b5c0-5b2ce139f9ac resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10142024-09-25T17:30:54.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f726dbae-8782-4435-b5c0-5b2ce139f9ac response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10152024-09-25T17:30:55.387ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1385 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = dbd888cd-9aff-4ea0-a4f0-c03461f8ac55 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
10162024-09-25T17:30:55.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 56d3f4fa-85a7-4f0f-9a1d-86c7b98fa560 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10172024-09-25T17:30:55.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 56d3f4fa-85a7-4f0f-9a1d-86c7b98fa560 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10182024-09-25T17:30:55.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2535 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 56d3f4fa-85a7-4f0f-9a1d-86c7b98fa560 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10192024-09-25T17:30:56.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4fba4ee9-7c56-484f-8078-6d2e81383f21 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10202024-09-25T17:30:56.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4fba4ee9-7c56-484f-8078-6d2e81383f21 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10212024-09-25T17:30:56.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4fba4ee9-7c56-484f-8078-6d2e81383f21 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10222024-09-25T17:30:57.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1188083c-a612-4525-bb9a-22280ed8e755 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10232024-09-25T17:30:57.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1188083c-a612-4525-bb9a-22280ed8e755 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10242024-09-25T17:30:57.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1188083c-a612-4525-bb9a-22280ed8e755 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10252024-09-25T17:30:58.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9f6111d1-9dce-4a88-b0fd-3f40b68eca55 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10262024-09-25T17:30:58.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9f6111d1-9dce-4a88-b0fd-3f40b68eca55 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10272024-09-25T17:30:58.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9f6111d1-9dce-4a88-b0fd-3f40b68eca55 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10282024-09-25T17:30:59.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5aa1bd88-1cee-468a-ba57-07c49c65dccc roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10292024-09-25T17:30:59.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5aa1bd88-1cee-468a-ba57-07c49c65dccc resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10302024-09-25T17:30:59.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5aa1bd88-1cee-468a-ba57-07c49c65dccc response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10312024-09-25T17:31:00.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f6efd98f-b74d-425b-8be0-94e53ba1e595 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10322024-09-25T17:31:00.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f6efd98f-b74d-425b-8be0-94e53ba1e595 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10332024-09-25T17:31:00.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f6efd98f-b74d-425b-8be0-94e53ba1e595 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10342024-09-25T17:31:01.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
10352024-09-25T17:31:01.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10362024-09-25T17:31:01.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
10372024-09-25T17:31:01.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10382024-09-25T17:31:01.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10392024-09-25T17:31:01.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10402024-09-25T17:31:01.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10412024-09-25T17:31:01.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10422024-09-25T17:31:01.521ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.726906ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10432024-09-25T17:31:01.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10442024-09-25T17:31:01.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10452024-09-25T17:31:01.524ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10462024-09-25T17:31:01.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10472024-09-25T17:31:01.526ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10482024-09-25T17:31:01.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10492024-09-25T17:31:01.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10502024-09-25T17:31:01.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
10512024-09-25T17:31:01.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10522024-09-25T17:31:01.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10532024-09-25T17:31:01.567ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
10542024-09-25T17:31:01.567ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.66702ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
10552024-09-25T17:31:01.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9befcd7b-fa70-4e31-9f69-4dea877cd562 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10562024-09-25T17:31:01.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9befcd7b-fa70-4e31-9f69-4dea877cd562 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10572024-09-25T17:31:01.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9befcd7b-fa70-4e31-9f69-4dea877cd562 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10582024-09-25T17:31:02.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 48769ac4-0d53-4aff-947a-0d51d1810fe7 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10592024-09-25T17:31:02.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 48769ac4-0d53-4aff-947a-0d51d1810fe7 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10602024-09-25T17:31:02.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 48769ac4-0d53-4aff-947a-0d51d1810fe7 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10612024-09-25T17:31:03.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9290bc39-d227-46f9-9e93-9e97cf3cd515 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10622024-09-25T17:31:03.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9290bc39-d227-46f9-9e93-9e97cf3cd515 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10632024-09-25T17:31:03.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9290bc39-d227-46f9-9e93-9e97cf3cd515 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10642024-09-25T17:31:05.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e846e116-9814-4796-ad9b-4cdb612b0111 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10652024-09-25T17:31:05.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e846e116-9814-4796-ad9b-4cdb612b0111 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10662024-09-25T17:31:05.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e846e116-9814-4796-ad9b-4cdb612b0111 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10672024-09-25T17:31:05.386ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1391 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = d32b38b6-b953-43fb-857b-c2266998a63c response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
10682024-09-25T17:31:06.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ec3b54b8-f204-4bb9-89c0-42bfbbb8fe06 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10692024-09-25T17:31:06.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ec3b54b8-f204-4bb9-89c0-42bfbbb8fe06 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10702024-09-25T17:31:06.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ec3b54b8-f204-4bb9-89c0-42bfbbb8fe06 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10712024-09-25T17:31:07.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9cf9a38d-069e-41ae-bc37-5d364d89866e roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10722024-09-25T17:31:07.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9cf9a38d-069e-41ae-bc37-5d364d89866e resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10732024-09-25T17:31:07.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9cf9a38d-069e-41ae-bc37-5d364d89866e response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10742024-09-25T17:31:08.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 400688a5-5e50-495d-a377-4ff92587e186 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10752024-09-25T17:31:08.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 400688a5-5e50-495d-a377-4ff92587e186 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10762024-09-25T17:31:08.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 400688a5-5e50-495d-a377-4ff92587e186 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10772024-09-25T17:31:09.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a368fafc-a3cf-4f6d-bc9f-5e5280f222e4 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10782024-09-25T17:31:09.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a368fafc-a3cf-4f6d-bc9f-5e5280f222e4 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10792024-09-25T17:31:09.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2251 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a368fafc-a3cf-4f6d-bc9f-5e5280f222e4 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10802024-09-25T17:31:10.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0f4ad152-60c2-4a3e-aa66-32bcbc28308f roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10812024-09-25T17:31:10.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0f4ad152-60c2-4a3e-aa66-32bcbc28308f resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10822024-09-25T17:31:10.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0f4ad152-60c2-4a3e-aa66-32bcbc28308f response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10832024-09-25T17:31:11.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 689e2133-0e58-4a29-bf80-34af3dcb4953 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10842024-09-25T17:31:11.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 689e2133-0e58-4a29-bf80-34af3dcb4953 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10852024-09-25T17:31:11.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 689e2133-0e58-4a29-bf80-34af3dcb4953 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
10862024-09-25T17:31:11.487ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
10872024-09-25T17:31:11.487ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10882024-09-25T17:31:11.487ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
10892024-09-25T17:31:11.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10902024-09-25T17:31:11.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10912024-09-25T17:31:11.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10922024-09-25T17:31:11.520ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10932024-09-25T17:31:11.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10942024-09-25T17:31:11.522ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.793426ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10952024-09-25T17:31:11.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10962024-09-25T17:31:11.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10972024-09-25T17:31:11.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10982024-09-25T17:31:11.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10992024-09-25T17:31:11.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11002024-09-25T17:31:11.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11012024-09-25T17:31:11.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11022024-09-25T17:31:11.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
11032024-09-25T17:31:11.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11042024-09-25T17:31:11.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11052024-09-25T17:31:11.566ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
11062024-09-25T17:31:11.566ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.218762ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
11072024-09-25T17:31:12.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8d1556ac-7418-40bc-a223-50f7d21b0812 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11082024-09-25T17:31:12.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8d1556ac-7418-40bc-a223-50f7d21b0812 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11092024-09-25T17:31:12.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8d1556ac-7418-40bc-a223-50f7d21b0812 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11102024-09-25T17:31:13.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1e5a5c15-c508-4cb1-a7b7-8fce4323821c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11112024-09-25T17:31:13.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1e5a5c15-c508-4cb1-a7b7-8fce4323821c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11122024-09-25T17:31:13.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1e5a5c15-c508-4cb1-a7b7-8fce4323821c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11132024-09-25T17:31:14.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d6135681-f8ce-4136-8eef-4c4feab5dbb0 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11142024-09-25T17:31:14.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d6135681-f8ce-4136-8eef-4c4feab5dbb0 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11152024-09-25T17:31:14.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d6135681-f8ce-4136-8eef-4c4feab5dbb0 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11162024-09-25T17:31:15.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 98943e0c-bc7d-440e-91dc-8ca15ca6e9bb roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11172024-09-25T17:31:15.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 98943e0c-bc7d-440e-91dc-8ca15ca6e9bb resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11182024-09-25T17:31:15.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 98943e0c-bc7d-440e-91dc-8ca15ca6e9bb response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11192024-09-25T17:31:15.387ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1388 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 94dae3cf-b8fd-4be1-927f-73dbec2f91ff response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
11202024-09-25T17:31:16.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3c451bb9-0241-403c-ae4d-b88a9d123207 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11212024-09-25T17:31:16.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3c451bb9-0241-403c-ae4d-b88a9d123207 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11222024-09-25T17:31:16.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3c451bb9-0241-403c-ae4d-b88a9d123207 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11232024-09-25T17:31:17.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e384abd8-1339-4cf5-813f-736536af44ff roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11242024-09-25T17:31:17.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e384abd8-1339-4cf5-813f-736536af44ff resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11252024-09-25T17:31:17.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2738 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e384abd8-1339-4cf5-813f-736536af44ff response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11262024-09-25T17:31:18.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cc8142ad-633e-4447-a22f-88438d71cc1b roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11272024-09-25T17:31:18.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cc8142ad-633e-4447-a22f-88438d71cc1b resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11282024-09-25T17:31:18.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cc8142ad-633e-4447-a22f-88438d71cc1b response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11292024-09-25T17:31:19.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8d9fb985-85ef-42fe-a4eb-b2a5e80a6d2c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11302024-09-25T17:31:19.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8d9fb985-85ef-42fe-a4eb-b2a5e80a6d2c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11312024-09-25T17:31:19.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8d9fb985-85ef-42fe-a4eb-b2a5e80a6d2c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11322024-09-25T17:31:20.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 75afb9d0-c145-4f58-95a7-eaa2b37c0b2e roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11332024-09-25T17:31:20.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 75afb9d0-c145-4f58-95a7-eaa2b37c0b2e resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11342024-09-25T17:31:20.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 75afb9d0-c145-4f58-95a7-eaa2b37c0b2e response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11352024-09-25T17:31:21.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = da3c454b-1cc5-4cdd-8a10-131efcfbc3eb roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11362024-09-25T17:31:21.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = da3c454b-1cc5-4cdd-8a10-131efcfbc3eb resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11372024-09-25T17:31:21.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = da3c454b-1cc5-4cdd-8a10-131efcfbc3eb response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
11382024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
11392024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
11402024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11412024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
11422024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
11432024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
11442024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
11452024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11462024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11472024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
11482024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11492024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
11502024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
11512024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11522024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
11532024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
11542024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
11552024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
11562024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
11572024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11582024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
11592024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11602024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
11612024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
11622024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
11632024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11642024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
11652024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11662024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
11672024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11682024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
11692024-09-25T17:31:21.488ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
11702024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11712024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
11722024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
11732024-09-25T17:31:21.488ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa
11742024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11752024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 23.19\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa"}
11762024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
11772024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
11782024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
11792024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
11802024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11812024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11822024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11832024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
11842024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
11852024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
11862024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
11872024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
11882024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
11892024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11902024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
11912024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
11922024-09-25T17:31:21.488ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-25 17:21:21.488654635 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
11932024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
11942024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
11952024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
11962024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
11972024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
11982024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
11992024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12002024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
12012024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12022024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12032024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12042024-09-25T17:31:21.488ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12052024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12062024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
12072024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
12082024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12092024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12102024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12112024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12122024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12132024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12142024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12152024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12162024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
12172024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12182024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
12192024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12202024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12212024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12222024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12232024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
12242024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
12252024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
12262024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12272024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12282024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12292024-09-25T17:31:21.489ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae9bf3cd-ff12-421b-b5a2-d52b18bde4b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be8cd1d4-baa8-48cc-872f-69bc5c2df30c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be8cd1d4-baa8-48cc-872f-69bc5c2df30c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2609, tv_nsec: 604887672 } })
12302024-09-25T17:31:21.489ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("11f53a30-9163-413a-8f7f-4bf206fb8176.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("929fdd8e-9f93-4e52-8d3d-ae706bb7a130.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ddd5d4f4-1113-49a5-bb63-a018bec3753e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ddd5d4f4-1113-49a5-bb63-a018bec3753e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2609, tv_nsec: 604904602 } })
12312024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12322024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12332024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12342024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12352024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12362024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12372024-09-25T17:31:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12382024-09-25T17:31:21.490ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
12392024-09-25T17:31:21.490ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.925155ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
12402024-09-25T17:31:21.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12412024-09-25T17:31:21.491ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12422024-09-25T17:31:21.492ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
12432024-09-25T17:31:21.492ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.987144ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
12442024-09-25T17:31:21.492ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.553465ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
12452024-09-25T17:31:21.494ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2609, tv_nsec: 609781972 } })
12462024-09-25T17:31:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
12472024-09-25T17:31:21.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12482024-09-25T17:31:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12492024-09-25T17:31:21.495ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
12502024-09-25T17:31:21.495ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2609, tv_nsec: 610831982 } })
12512024-09-25T17:31:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12522024-09-25T17:31:21.495ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12532024-09-25T17:31:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12542024-09-25T17:31:21.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12552024-09-25T17:31:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12562024-09-25T17:31:21.496ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
12572024-09-25T17:31:21.497ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12582024-09-25T17:31:21.499ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12592024-09-25T17:31:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12602024-09-25T17:31:21.500ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12612024-09-25T17:31:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12622024-09-25T17:31:21.501ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12632024-09-25T17:31:21.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
12642024-09-25T17:31:21.501ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
12652024-09-25T17:31:21.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
12662024-09-25T17:31:21.502ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12672024-09-25T17:31:21.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12682024-09-25T17:31:21.502ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.244474ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
12692024-09-25T17:31:21.504ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.399846ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
12702024-09-25T17:31:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
12712024-09-25T17:31:21.504ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12722024-09-25T17:31:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12732024-09-25T17:31:21.504ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12742024-09-25T17:31:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12752024-09-25T17:31:21.505ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12762024-09-25T17:31:21.508ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12772024-09-25T17:31:21.508ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12782024-09-25T17:31:21.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12792024-09-25T17:31:21.512ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-25 17:21:21.488654635 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
12802024-09-25T17:31:21.512ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 23.780552ms iteration = 7 status = {"expiration":"2024-09-25T17:21:21.488654635Z","pruned":[]}
12812024-09-25T17:31:21.512ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12822024-09-25T17:31:21.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12832024-09-25T17:31:21.515ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12842024-09-25T17:31:21.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12852024-09-25T17:31:21.516ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
12862024-09-25T17:31:21.516ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12872024-09-25T17:31:21.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
12882024-09-25T17:31:21.519ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12892024-09-25T17:31:21.521ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2609, tv_nsec: 637134640 } })
12902024-09-25T17:31:21.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12912024-09-25T17:31:21.523ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
12922024-09-25T17:31:21.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12932024-09-25T17:31:21.526ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12942024-09-25T17:31:21.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12952024-09-25T17:31:21.542ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12962024-09-25T17:31:21.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12972024-09-25T17:31:21.544ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.900309ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
12982024-09-25T17:31:21.552ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12992024-09-25T17:31:21.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13002024-09-25T17:31:21.560ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 71.936316ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13012024-09-25T17:31:21.563ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13022024-09-25T17:31:21.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13032024-09-25T17:31:21.565ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13042024-09-25T17:31:21.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13052024-09-25T17:31:21.567ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13062024-09-25T17:31:21.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13072024-09-25T17:31:21.567ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13082024-09-25T17:31:21.567ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13092024-09-25T17:31:21.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13102024-09-25T17:31:21.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13112024-09-25T17:31:21.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13122024-09-25T17:31:21.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
13132024-09-25T17:31:21.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13142024-09-25T17:31:21.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13152024-09-25T17:31:21.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13162024-09-25T17:31:21.571ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13172024-09-25T17:31:21.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13182024-09-25T17:31:21.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13192024-09-25T17:31:21.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13202024-09-25T17:31:21.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13212024-09-25T17:31:21.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13222024-09-25T17:31:21.574ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13232024-09-25T17:31:21.574ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
13242024-09-25T17:31:21.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13252024-09-25T17:31:21.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13262024-09-25T17:31:21.575ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13272024-09-25T17:31:21.575ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
13282024-09-25T17:31:21.575ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
13292024-09-25T17:31:21.575ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
13302024-09-25T17:31:21.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13312024-09-25T17:31:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13322024-09-25T17:31:21.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13332024-09-25T17:31:21.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13342024-09-25T17:31:21.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13352024-09-25T17:31:21.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13362024-09-25T17:31:21.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13372024-09-25T17:31:21.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13382024-09-25T17:31:21.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13392024-09-25T17:31:21.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13402024-09-25T17:31:21.582ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
13412024-09-25T17:31:21.582ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
13422024-09-25T17:31:21.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13432024-09-25T17:31:21.582ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 93.396575ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
13442024-09-25T17:31:21.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13452024-09-25T17:31:21.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13462024-09-25T17:31:21.586ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13472024-09-25T17:31:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13482024-09-25T17:31:21.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
13492024-09-25T17:31:21.587ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
13502024-09-25T17:31:21.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
13512024-09-25T17:31:21.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
13522024-09-25T17:31:21.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13532024-09-25T17:31:21.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13542024-09-25T17:31:21.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13552024-09-25T17:31:21.590ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13562024-09-25T17:31:21.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13572024-09-25T17:31:21.596ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13582024-09-25T17:31:21.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13592024-09-25T17:31:21.600ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13602024-09-25T17:31:21.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13612024-09-25T17:31:21.602ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 113.940247ms iteration = 4 status = {"nsuccess":5}
13622024-09-25T17:31:21.604ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
13632024-09-25T17:31:21.604ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
13642024-09-25T17:31:21.604ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
13652024-09-25T17:31:21.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13662024-09-25T17:31:21.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13672024-09-25T17:31:21.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13682024-09-25T17:31:21.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13692024-09-25T17:31:21.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13702024-09-25T17:31:21.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13712024-09-25T17:31:21.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13722024-09-25T17:31:21.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
13732024-09-25T17:31:21.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
13742024-09-25T17:31:21.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
13752024-09-25T17:31:21.613ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
13762024-09-25T17:31:21.613ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
13772024-09-25T17:31:21.613ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 124.987912ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
13782024-09-25T17:31:21.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 125.712335ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
13792024-09-25T17:31:21.616ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
13802024-09-25T17:31:21.616ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 127.675342ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
13812024-09-25T17:31:21.618ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
13822024-09-25T17:31:21.618ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13832024-09-25T17:31:21.619ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13842024-09-25T17:31:21.619ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9ea04d19-9bb5-4401-a570-3c7bd9e5bc8d", "content-length": "26", "date": "Wed, 25 Sep 2024 17:31:20 GMT"} })
13852024-09-25T17:31:21.619ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13862024-09-25T17:31:21.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13872024-09-25T17:31:21.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 133.516299ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13882024-09-25T17:31:21.623ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13892024-09-25T17:31:21.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
13902024-09-25T17:31:21.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 135.67581ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
13912024-09-25T17:31:21.625ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:67 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
13922024-09-25T17:31:21.625ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 136.601977ms iteration = 7 status = {"changed_state":[],"instances_found":0,"instances_reincarnated":[],"query_error":null,"restart_errors":{}}
13932024-09-25T17:31:21.631ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13942024-09-25T17:31:21.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
13952024-09-25T17:31:21.632ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
13962024-09-25T17:31:21.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13972024-09-25T17:31:21.636ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
13982024-09-25T17:31:21.636ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13992024-09-25T17:31:21.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14002024-09-25T17:31:21.638ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14012024-09-25T17:31:21.638ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14022024-09-25T17:31:21.638ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14032024-09-25T17:31:21.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14042024-09-25T17:31:21.640ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
14052024-09-25T17:31:21.640ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14062024-09-25T17:31:21.642ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9cb5ee33-b05d-4ce4-94ad-38b4d2923362", "content-length": "26", "date": "Wed, 25 Sep 2024 17:31:20 GMT"} })
14072024-09-25T17:31:21.642ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14082024-09-25T17:31:21.644ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14092024-09-25T17:31:21.645ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 zone_address = fd00:1122:3344:101::2
14102024-09-25T17:31:21.645ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14112024-09-25T17:31:21.645ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "26417d94-deaf-4e93-9230-e9e067bb8c66", "content-length": "26", "date": "Wed, 25 Sep 2024 17:31:20 GMT"} })
14122024-09-25T17:31:21.645ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14132024-09-25T17:31:21.648ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
14142024-09-25T17:31:21.648ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4983f296-eda5-4ab7-98fb-1acc9a8bf292 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
14152024-09-25T17:31:21.648ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14162024-09-25T17:31:21.648ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
14172024-09-25T17:31:21.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14182024-09-25T17:31:21.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14192024-09-25T17:31:21.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
14202024-09-25T17:31:21.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14212024-09-25T17:31:21.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14222024-09-25T17:31:21.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14232024-09-25T17:31:21.657ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4983f296-eda5-4ab7-98fb-1acc9a8bf292 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
14242024-09-25T17:31:21.657ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
14252024-09-25T17:31:21.657ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-25 17:25:42.974009 UTC dns_group = internal generation = 1
14262024-09-25T17:31:21.657ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 169.362826ms iteration = 8 status = {"generation":1}
14272024-09-25T17:31:21.660ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
14282024-09-25T17:31:21.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f0d006a2-eb4a-4510-8a1c-6c144343343f, lookup_type: ById(f0d006a2-eb4a-4510-8a1c-6c144343343f) } result = Ok(())
14292024-09-25T17:31:21.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14302024-09-25T17:31:21.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14312024-09-25T17:31:21.663ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
14322024-09-25T17:31:21.663ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9011eb2e-f736-49fd-9148-03ee7daa981e dns_zone_name = oxide.test found_so_far = 0 version = 2
14332024-09-25T17:31:21.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14342024-09-25T17:31:21.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14352024-09-25T17:31:21.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 176.916726ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
14362024-09-25T17:31:21.667ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 179.160508ms iteration = 13 status = 0
14372024-09-25T17:31:21.670ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14382024-09-25T17:31:21.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14392024-09-25T17:31:21.688ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14402024-09-25T17:31:21.688ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14412024-09-25T17:31:21.688ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 200.342171ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14422024-09-25T17:31:21.699ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-25T17:25:19.066517Z, time_modified: 2024-09-25T17:25:19.066517Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, db_silo: Silo { identity: SiloIdentity { id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-25T17:25:43.663371Z, time_modified: 2024-09-25T17:25:43.663371Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, db_silo: Silo { identity: SiloIdentity { id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-25T17:25:43.663371Z, time_modified: 2024-09-25T17:25:43.663371Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c" }] }) }
14432024-09-25T17:31:21.699ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 211.121361ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dcfeb960-7abf-4e10-b28d-9fa9c33e4d51","tls_certs":["4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c"]}},"default_endpoint":{"silo_id":"dcfeb960-7abf-4e10-b28d-9fa9c33e4d51","tls_certs":["4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
14442024-09-25T17:31:21.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14452024-09-25T17:31:21.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
14462024-09-25T17:31:21.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14472024-09-25T17:31:21.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14482024-09-25T17:31:21.714ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9011eb2e-f736-49fd-9148-03ee7daa981e dns_zone_name = oxide.test found_so_far = 1 version = 2
14492024-09-25T17:31:21.714ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
14502024-09-25T17:31:21.714ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-25 17:25:43.713253 UTC dns_group = external generation = 2
14512024-09-25T17:31:21.714ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 225.861835ms iteration = 8 status = {"generation":2}
14522024-09-25T17:31:21.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14532024-09-25T17:31:21.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14542024-09-25T17:31:21.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14552024-09-25T17:31:21.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14562024-09-25T17:31:21.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14572024-09-25T17:31:21.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14582024-09-25T17:31:21.726ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14592024-09-25T17:31:21.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
14602024-09-25T17:31:21.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14612024-09-25T17:31:21.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14622024-09-25T17:31:21.736ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 248.22701ms iteration = 16 status = {"physical_disks_added":0}
14632024-09-25T17:31:21.774ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
14642024-09-25T17:31:21.795ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 306.792319ms iteration = 13 status = {}
14652024-09-25T17:31:21.834ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
14662024-09-25T17:31:21.834ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "522d0f42-116e-4192-a38b-f69fa1879599", "content-length": "1", "date": "Wed, 25 Sep 2024 17:31:21 GMT"} })
14672024-09-25T17:31:21.836ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14682024-09-25T17:31:21.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14692024-09-25T17:31:21.847ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
14702024-09-25T17:31:21.848ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b4f528c7-b5e0-4f4d-9b3c-0b5eaec672dd", "date": "Wed, 25 Sep 2024 17:31:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14712024-09-25T17:31:21.848ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14722024-09-25T17:31:21.850ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "74cfe335-bd28-4088-813c-893423e14bbd", "date": "Wed, 25 Sep 2024 17:31:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14732024-09-25T17:31:21.850ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14742024-09-25T17:31:21.852ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
14752024-09-25T17:31:21.853ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 364.421739ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
14762024-09-25T17:31:21.864ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
14772024-09-25T17:31:21.865ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ab176edc-7dd3-44a4-bd34-40ab752099b0", "content-length": "691", "date": "Wed, 25 Sep 2024 17:31:21 GMT"} })
14782024-09-25T17:31:21.865ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
14792024-09-25T17:31:21.865ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
14802024-09-25T17:31:21.865ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
14812024-09-25T17:31:21.866ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14822024-09-25T17:31:21.867ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 378.915787ms iteration = 13 status = {}
14832024-09-25T17:31:21.868ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0603ded7-7906-4ef3-a65c-7d0e75458d44", "content-length": "372", "date": "Wed, 25 Sep 2024 17:31:21 GMT"} })
14842024-09-25T17:31:21.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14852024-09-25T17:31:21.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14862024-09-25T17:31:21.870ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 382.291729ms iteration = 13 status = null
14872024-09-25T17:31:21.873ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14882024-09-25T17:31:21.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14892024-09-25T17:31:21.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14902024-09-25T17:31:21.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14912024-09-25T17:31:21.880ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14922024-09-25T17:31:21.880ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "af3ecdc4-ab7e-4543-adc3-fe4e356bb1d5", "date": "Wed, 25 Sep 2024 17:31:21 GMT"} })
14932024-09-25T17:31:21.883ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 394.781692ms iteration = 14 status = {}
14942024-09-25T17:31:21.886ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
14952024-09-25T17:31:21.886ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f5497c26-9ede-4004-a9f3-eb0539c148da", "date": "Wed, 25 Sep 2024 17:31:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
14962024-09-25T17:31:21.886ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
14972024-09-25T17:31:21.889ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bedff540-3fd5-4cfd-8f00-b522bfb9f86c", "date": "Wed, 25 Sep 2024 17:31:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
14982024-09-25T17:31:21.889ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
14992024-09-25T17:31:21.891ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "19d01067-eaf1-4331-bc5f-09967a561731", "date": "Wed, 25 Sep 2024 17:31:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15002024-09-25T17:31:21.891ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15012024-09-25T17:31:21.894ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
15022024-09-25T17:31:21.894ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 405.949979ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
15032024-09-25T17:31:21.931ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15042024-09-25T17:31:21.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15052024-09-25T17:31:21.933ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 6e5d68bf-01bc-412c-9915-3ad6fd435156, rack_id: 5c1bad99-30b8-419d-9695-a982a6249225, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5d8104c-5830-4cb9-9490-d372d8c75371) } rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
15062024-09-25T17:31:21.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15072024-09-25T17:31:21.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15082024-09-25T17:31:21.941ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
15092024-09-25T17:31:21.942ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9591319d-13c0-4307-91c5-a0c1e32445ec", "content-length": "121", "date": "Wed, 25 Sep 2024 17:31:21 GMT"} })
15102024-09-25T17:31:21.942ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
15112024-09-25T17:31:21.942ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5d8104c-5830-4cb9-9490-d372d8c75371
15122024-09-25T17:31:21.942ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15132024-09-25T17:31:21.942ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15142024-09-25T17:31:21.942ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
15152024-09-25T17:31:21.942ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
15162024-09-25T17:31:21.942ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
15172024-09-25T17:31:21.942ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15182024-09-25T17:31:21.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15192024-09-25T17:31:21.944ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
15202024-09-25T17:31:21.944ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bd782989-31ef-43de-910c-0a572dbb0110", "content-length": "2", "date": "Wed, 25 Sep 2024 17:31:21 GMT"} })
15212024-09-25T17:31:21.944ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
15222024-09-25T17:31:21.945ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b230599e-79f9-4ed7-9276-da6cbb5d2b1e", "content-length": "52", "date": "Wed, 25 Sep 2024 17:31:21 GMT"} })
15232024-09-25T17:31:21.945ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
15242024-09-25T17:31:21.945ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15252024-09-25T17:31:22.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9face525-59ca-45cb-8639-9f0b782b20bd", "date": "Wed, 25 Sep 2024 17:31:21 GMT"} })
15262024-09-25T17:31:22.037ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch = Switch0
15272024-09-25T17:31:22.037ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15282024-09-25T17:31:22.042ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7bd12ce5-c965-4654-bfa2-f90ba792aa9f", "content-length": "667", "date": "Wed, 25 Sep 2024 17:31:22 GMT"} })
15292024-09-25T17:31:22.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15302024-09-25T17:31:22.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15312024-09-25T17:31:22.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15322024-09-25T17:31:22.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15332024-09-25T17:31:22.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15342024-09-25T17:31:22.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15352024-09-25T17:31:22.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15362024-09-25T17:31:22.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15372024-09-25T17:31:22.064ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 576.246502ms iteration = 13 status = {}
15382024-09-25T17:31:22.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 0be3069e-2be0-4eb2-afef-d11958a8e769 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
15392024-09-25T17:31:22.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 0be3069e-2be0-4eb2-afef-d11958a8e769 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
15402024-09-25T17:31:22.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3688 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 0be3069e-2be0-4eb2-afef-d11958a8e769 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
15412024-09-25T17:31:22.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 92a25c57-cfd3-458d-83b7-1e69880cfa5a roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15422024-09-25T17:31:22.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 92a25c57-cfd3-458d-83b7-1e69880cfa5a resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15432024-09-25T17:31:22.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 92a25c57-cfd3-458d-83b7-1e69880cfa5a response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15442024-09-25T17:31:23.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 86ce9c9c-008f-4501-850d-115b97f3cbde roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15452024-09-25T17:31:23.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 86ce9c9c-008f-4501-850d-115b97f3cbde resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15462024-09-25T17:31:23.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 86ce9c9c-008f-4501-850d-115b97f3cbde response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15472024-09-25T17:31:24.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2b2d8231-5f98-43ba-aaca-0d6bd264b29f roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15482024-09-25T17:31:24.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2b2d8231-5f98-43ba-aaca-0d6bd264b29f resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15492024-09-25T17:31:24.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1981 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2b2d8231-5f98-43ba-aaca-0d6bd264b29f response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15502024-09-25T17:31:25.387ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1579 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 1f9661bb-2b27-432b-93ae-564f39655675 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
15512024-09-25T17:31:25.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a659aefc-9cd8-4ec1-81db-68f5b17bc8d3 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15522024-09-25T17:31:25.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a659aefc-9cd8-4ec1-81db-68f5b17bc8d3 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15532024-09-25T17:31:25.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a659aefc-9cd8-4ec1-81db-68f5b17bc8d3 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15542024-09-25T17:31:26.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7300f342-a50b-4842-a6ca-511b760dd2f6 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15552024-09-25T17:31:26.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7300f342-a50b-4842-a6ca-511b760dd2f6 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15562024-09-25T17:31:26.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7300f342-a50b-4842-a6ca-511b760dd2f6 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15572024-09-25T17:31:27.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5a2ab29c-f12a-4cc2-a1b4-59ae2c1f16a3 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15582024-09-25T17:31:27.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5a2ab29c-f12a-4cc2-a1b4-59ae2c1f16a3 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15592024-09-25T17:31:27.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5a2ab29c-f12a-4cc2-a1b4-59ae2c1f16a3 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15602024-09-25T17:31:28.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6de5c5da-c0ed-49b9-8729-41c72212952e roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15612024-09-25T17:31:28.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6de5c5da-c0ed-49b9-8729-41c72212952e resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15622024-09-25T17:31:28.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6de5c5da-c0ed-49b9-8729-41c72212952e response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15632024-09-25T17:31:29.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4b1fb0d9-53c3-401a-ba3b-f9c17bf0a373 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15642024-09-25T17:31:29.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4b1fb0d9-53c3-401a-ba3b-f9c17bf0a373 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15652024-09-25T17:31:29.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4b1fb0d9-53c3-401a-ba3b-f9c17bf0a373 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15662024-09-25T17:31:30.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cb5659d8-58ec-4b9a-91bd-fc18f9dbf76b roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15672024-09-25T17:31:30.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cb5659d8-58ec-4b9a-91bd-fc18f9dbf76b resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15682024-09-25T17:31:30.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2548 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cb5659d8-58ec-4b9a-91bd-fc18f9dbf76b response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15692024-09-25T17:31:31.487ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
15702024-09-25T17:31:31.487ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15712024-09-25T17:31:31.487ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
15722024-09-25T17:31:31.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15732024-09-25T17:31:31.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15742024-09-25T17:31:31.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15752024-09-25T17:31:31.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15762024-09-25T17:31:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15772024-09-25T17:31:31.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15782024-09-25T17:31:31.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.115055ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15792024-09-25T17:31:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15802024-09-25T17:31:31.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15812024-09-25T17:31:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15822024-09-25T17:31:31.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15832024-09-25T17:31:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15842024-09-25T17:31:31.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15852024-09-25T17:31:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
15862024-09-25T17:31:31.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15872024-09-25T17:31:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15882024-09-25T17:31:31.506ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
15892024-09-25T17:31:31.506ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.437933ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
15902024-09-25T17:31:31.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2e29105c-426e-4159-977f-99efe7ef8a1c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15912024-09-25T17:31:31.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2e29105c-426e-4159-977f-99efe7ef8a1c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15922024-09-25T17:31:31.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2e29105c-426e-4159-977f-99efe7ef8a1c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15932024-09-25T17:31:32.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8a61f61a-c297-4f2d-b63d-d2058cb28e31 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15942024-09-25T17:31:32.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8a61f61a-c297-4f2d-b63d-d2058cb28e31 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15952024-09-25T17:31:32.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8a61f61a-c297-4f2d-b63d-d2058cb28e31 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15962024-09-25T17:31:33.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 41f04163-8833-435e-9e88-4c8dc90092e8 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15972024-09-25T17:31:33.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 41f04163-8833-435e-9e88-4c8dc90092e8 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15982024-09-25T17:31:33.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 41f04163-8833-435e-9e88-4c8dc90092e8 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
15992024-09-25T17:31:34.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c90c26a0-1924-42ff-a26a-9f10983ce4bb roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16002024-09-25T17:31:34.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c90c26a0-1924-42ff-a26a-9f10983ce4bb resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16012024-09-25T17:31:34.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c90c26a0-1924-42ff-a26a-9f10983ce4bb response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16022024-09-25T17:31:35.387ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1477 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 62d74f30-06a5-49ee-b64f-0edbd5b47658 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
16032024-09-25T17:31:35.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7c38a172-a190-41e2-a914-967f44997df6 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16042024-09-25T17:31:35.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7c38a172-a190-41e2-a914-967f44997df6 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16052024-09-25T17:31:35.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7c38a172-a190-41e2-a914-967f44997df6 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16062024-09-25T17:31:36.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7e31983c-a584-4fcd-8722-66fc30e98866 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16072024-09-25T17:31:36.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7e31983c-a584-4fcd-8722-66fc30e98866 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16082024-09-25T17:31:36.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7e31983c-a584-4fcd-8722-66fc30e98866 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16092024-09-25T17:31:37.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 01a10438-a1ea-4794-b109-19738ef9a078 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16102024-09-25T17:31:37.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 01a10438-a1ea-4794-b109-19738ef9a078 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16112024-09-25T17:31:37.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 01a10438-a1ea-4794-b109-19738ef9a078 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16122024-09-25T17:31:38.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 34084b0f-15fa-4021-a414-b138ed9cf73f roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16132024-09-25T17:31:38.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 34084b0f-15fa-4021-a414-b138ed9cf73f resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16142024-09-25T17:31:38.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 34084b0f-15fa-4021-a414-b138ed9cf73f response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16152024-09-25T17:31:39.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1e76a6a9-224e-4632-bb7a-559000ba2db6 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16162024-09-25T17:31:39.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1e76a6a9-224e-4632-bb7a-559000ba2db6 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16172024-09-25T17:31:39.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1e76a6a9-224e-4632-bb7a-559000ba2db6 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16182024-09-25T17:31:40.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 64af7d6e-dbc6-42ee-9ae3-f544001bb101 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16192024-09-25T17:31:40.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 64af7d6e-dbc6-42ee-9ae3-f544001bb101 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16202024-09-25T17:31:40.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 64af7d6e-dbc6-42ee-9ae3-f544001bb101 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16212024-09-25T17:31:41.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 65753161-3681-4cd1-87f8-04a1ef3689ec roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
16222024-09-25T17:31:41.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 65753161-3681-4cd1-87f8-04a1ef3689ec resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
16232024-09-25T17:31:41.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 65753161-3681-4cd1-87f8-04a1ef3689ec response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
16242024-09-25T17:31:41.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 5d53886a-b770-4b15-82e1-8cb2e76a3739 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
16252024-09-25T17:31:41.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 5d53886a-b770-4b15-82e1-8cb2e76a3739 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
16262024-09-25T17:31:41.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 5d53886a-b770-4b15-82e1-8cb2e76a3739 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
16272024-09-25T17:31:41.487ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
16282024-09-25T17:31:41.487ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16292024-09-25T17:31:41.487ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
16302024-09-25T17:31:41.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16312024-09-25T17:31:41.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16322024-09-25T17:31:41.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16332024-09-25T17:31:41.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16342024-09-25T17:31:41.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16352024-09-25T17:31:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16362024-09-25T17:31:41.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.960233ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16372024-09-25T17:31:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16382024-09-25T17:31:41.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16392024-09-25T17:31:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16402024-09-25T17:31:41.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16412024-09-25T17:31:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16422024-09-25T17:31:41.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16432024-09-25T17:31:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
16442024-09-25T17:31:41.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16452024-09-25T17:31:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16462024-09-25T17:31:41.504ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
16472024-09-25T17:31:41.504ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.891094ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
16482024-09-25T17:31:41.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 40fc5175-66e2-4ce9-84f5-0a42a69b5627 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16492024-09-25T17:31:41.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 40fc5175-66e2-4ce9-84f5-0a42a69b5627 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16502024-09-25T17:31:41.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 40fc5175-66e2-4ce9-84f5-0a42a69b5627 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16512024-09-25T17:31:42.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 00cf3779-dac6-4d5a-8aec-9ab34d655bad roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16522024-09-25T17:31:42.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 00cf3779-dac6-4d5a-8aec-9ab34d655bad resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16532024-09-25T17:31:42.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3692 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 00cf3779-dac6-4d5a-8aec-9ab34d655bad response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16542024-09-25T17:31:43.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dd6c7c51-4ea5-4a81-9b88-9c20582845cb roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16552024-09-25T17:31:43.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dd6c7c51-4ea5-4a81-9b88-9c20582845cb resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16562024-09-25T17:31:43.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dd6c7c51-4ea5-4a81-9b88-9c20582845cb response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16572024-09-25T17:31:44.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dd537126-f252-4d46-ab7a-95b834abf4d1 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16582024-09-25T17:31:44.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dd537126-f252-4d46-ab7a-95b834abf4d1 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16592024-09-25T17:31:44.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dd537126-f252-4d46-ab7a-95b834abf4d1 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16602024-09-25T17:31:45.387ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 2567aa77-a25a-430c-b20e-4d8cb9cf37de response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
16612024-09-25T17:31:45.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 569fbbb0-111b-47e1-8cb8-bc34475caf39 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16622024-09-25T17:31:45.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 569fbbb0-111b-47e1-8cb8-bc34475caf39 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16632024-09-25T17:31:45.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 569fbbb0-111b-47e1-8cb8-bc34475caf39 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16642024-09-25T17:31:46.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 140f1f68-df4c-4edb-9084-8ac19ed3e3f9 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16652024-09-25T17:31:46.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 140f1f68-df4c-4edb-9084-8ac19ed3e3f9 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16662024-09-25T17:31:46.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 140f1f68-df4c-4edb-9084-8ac19ed3e3f9 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16672024-09-25T17:31:47.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 36ac3548-2976-404c-b840-c915d0e2a309 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16682024-09-25T17:31:47.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 36ac3548-2976-404c-b840-c915d0e2a309 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16692024-09-25T17:31:47.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 36ac3548-2976-404c-b840-c915d0e2a309 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16702024-09-25T17:31:48.542ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2043 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 03a4abe3-47b1-4832-8d19-9f5cbc4bd12f remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 00dc576f-b719-4669-9f6c-1b7e90ae2206 uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-09-25T17:31:48.536247798Z }
16712024-09-25T17:31:48.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 00dc576f-b719-4669-9f6c-1b7e90ae2206 roles = RoleSet { roles: {} } uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
16722024-09-25T17:31:48.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 00dc576f-b719-4669-9f6c-1b7e90ae2206 resource = Database result = Ok(()) uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
16732024-09-25T17:31:48.577ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:36128
16742024-09-25T17:31:48.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:36128 req_id = 69332683-a2d6-4d24-9b58-5e2fd4827a2b roles = RoleSet { roles: {} } uri = /metrics/producers
16752024-09-25T17:31:48.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:36128 req_id = 69332683-a2d6-4d24-9b58-5e2fd4827a2b resource = Database result = Ok(()) uri = /metrics/producers
16762024-09-25T17:31:48.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 50371 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 00dc576f-b719-4669-9f6c-1b7e90ae2206 response_code = 204 uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
16772024-09-25T17:31:48.587ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2043 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 03a4abe3-47b1-4832-8d19-9f5cbc4bd12f remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5646676d-96f3-42c0-b2f6-02f19245d9a3 uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-25T17:31:48.587709514Z }
16782024-09-25T17:31:48.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5646676d-96f3-42c0-b2f6-02f19245d9a3 roles = RoleSet { roles: {} } uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
16792024-09-25T17:31:48.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5646676d-96f3-42c0-b2f6-02f19245d9a3 resource = Database result = Ok(()) uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
16802024-09-25T17:31:48.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7269 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5646676d-96f3-42c0-b2f6-02f19245d9a3 response_code = 204 uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
16812024-09-25T17:31:48.611ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
16822024-09-25T17:31:48.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:36128 req_id = 69332683-a2d6-4d24-9b58-5e2fd4827a2b roles = RoleSet { roles: {} } uri = /metrics/producers
16832024-09-25T17:31:48.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:36128 req_id = 69332683-a2d6-4d24-9b58-5e2fd4827a2b resource = Database result = Ok(()) uri = /metrics/producers
16842024-09-25T17:31:48.646ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
16852024-09-25T17:31:48.647ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "084a87b7-04fd-40d0-8f53-2fce2c1c2ec8", "date": "Wed, 25 Sep 2024 17:31:48 GMT"} })
16862024-09-25T17:31:48.647ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4
16872024-09-25T17:31:48.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 71448 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:36128 req_id = 69332683-a2d6-4d24-9b58-5e2fd4827a2b response_code = 201 uri = /metrics/producers
16882024-09-25T17:31:48.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 71d8a835-915b-439a-88cb-0bf6eb495243 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16892024-09-25T17:31:48.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 71d8a835-915b-439a-88cb-0bf6eb495243 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16902024-09-25T17:31:48.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 71d8a835-915b-439a-88cb-0bf6eb495243 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16912024-09-25T17:31:49.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e1c520c9-1eeb-4fee-bdb3-9489dd140703 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16922024-09-25T17:31:49.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e1c520c9-1eeb-4fee-bdb3-9489dd140703 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16932024-09-25T17:31:49.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e1c520c9-1eeb-4fee-bdb3-9489dd140703 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16942024-09-25T17:31:51.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 620f1bdd-1461-4c84-850b-c23ae61cd2a5 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16952024-09-25T17:31:51.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 620f1bdd-1461-4c84-850b-c23ae61cd2a5 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16962024-09-25T17:31:51.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 620f1bdd-1461-4c84-850b-c23ae61cd2a5 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
16972024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
16982024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
16992024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17002024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
17012024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17022024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
17032024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17042024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17052024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
17062024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17072024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
17082024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17092024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
17102024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17112024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
17122024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17132024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17142024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
17152024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17162024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
17172024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17182024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
17192024-09-25T17:31:51.487ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17202024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
17212024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
17222024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17232024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17242024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
17252024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
17262024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17272024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
17282024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17292024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
17302024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17312024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17322024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17332024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17342024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17352024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17362024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17372024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17382024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17392024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17402024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17412024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17422024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17432024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17442024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17452024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17462024-09-25T17:31:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17472024-09-25T17:31:51.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17482024-09-25T17:31:51.491ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.972493ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17492024-09-25T17:31:51.492ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2639, tv_nsec: 608024939 } })
17502024-09-25T17:31:51.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17512024-09-25T17:31:51.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17522024-09-25T17:31:51.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17532024-09-25T17:31:51.493ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
17542024-09-25T17:31:51.493ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17552024-09-25T17:31:51.493ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17562024-09-25T17:31:51.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17572024-09-25T17:31:51.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17582024-09-25T17:31:51.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17592024-09-25T17:31:51.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17602024-09-25T17:31:51.495ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17612024-09-25T17:31:51.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.485648ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
17622024-09-25T17:31:51.496ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2639, tv_nsec: 612379890 } })
17632024-09-25T17:31:51.498ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
17642024-09-25T17:31:51.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17652024-09-25T17:31:51.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17662024-09-25T17:31:51.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
17672024-09-25T17:31:51.498ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17682024-09-25T17:31:51.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17692024-09-25T17:31:51.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17702024-09-25T17:31:51.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17712024-09-25T17:31:51.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17722024-09-25T17:31:51.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17732024-09-25T17:31:51.500ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17742024-09-25T17:31:51.501ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17752024-09-25T17:31:51.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17762024-09-25T17:31:51.502ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17772024-09-25T17:31:51.503ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17782024-09-25T17:31:51.503ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17792024-09-25T17:31:51.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17802024-09-25T17:31:51.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17812024-09-25T17:31:51.504ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17822024-09-25T17:31:51.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17832024-09-25T17:31:51.505ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17842024-09-25T17:31:51.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17852024-09-25T17:31:51.507ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17862024-09-25T17:31:51.507ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2639, tv_nsec: 623186030 } })
17872024-09-25T17:31:51.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17882024-09-25T17:31:51.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17892024-09-25T17:31:51.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17902024-09-25T17:31:51.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17912024-09-25T17:31:51.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17922024-09-25T17:31:51.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17932024-09-25T17:31:51.509ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
17942024-09-25T17:31:51.510ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17952024-09-25T17:31:51.512ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17962024-09-25T17:31:51.512ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17972024-09-25T17:31:51.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17982024-09-25T17:31:51.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
17992024-09-25T17:31:51.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18002024-09-25T17:31:51.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18012024-09-25T17:31:51.517ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 29.659361ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
18022024-09-25T17:31:51.519ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18032024-09-25T17:31:51.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18042024-09-25T17:31:51.521ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18052024-09-25T17:31:51.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18062024-09-25T17:31:51.524ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18072024-09-25T17:31:51.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18082024-09-25T17:31:51.530ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
18092024-09-25T17:31:51.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.925238ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
18102024-09-25T17:31:51.542ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18112024-09-25T17:31:51.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18122024-09-25T17:31:51.545ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18132024-09-25T17:31:51.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.554729ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18142024-09-25T17:31:51.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18152024-09-25T17:31:51.546ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.987455ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
18162024-09-25T17:31:51.547ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.20692ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18172024-09-25T17:31:51.552ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18182024-09-25T17:31:51.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18192024-09-25T17:31:51.568ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18202024-09-25T17:31:51.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18212024-09-25T17:31:51.570ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18222024-09-25T17:31:51.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18232024-09-25T17:31:51.572ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18242024-09-25T17:31:51.572ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18252024-09-25T17:31:51.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18262024-09-25T17:31:51.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18272024-09-25T17:31:51.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18282024-09-25T17:31:51.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f0d006a2-eb4a-4510-8a1c-6c144343343f, lookup_type: ById(f0d006a2-eb4a-4510-8a1c-6c144343343f) } result = Ok(())
18292024-09-25T17:31:51.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18302024-09-25T17:31:51.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18312024-09-25T17:31:51.604ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
18322024-09-25T17:31:51.604ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18332024-09-25T17:31:51.604ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9b403b30-9930-4660-9ace-fb924ec04fa8", "content-length": "26", "date": "Wed, 25 Sep 2024 17:31:50 GMT"} })
18342024-09-25T17:31:51.604ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18352024-09-25T17:31:51.606ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18362024-09-25T17:31:51.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 121.910194ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
18372024-09-25T17:31:51.651ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18382024-09-25T17:31:51.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18392024-09-25T17:31:51.653ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 165.555435ms iteration = 17 status = {"physical_disks_added":0}
18402024-09-25T17:31:51.667ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 zone_address = fd00:1122:3344:101::2
18412024-09-25T17:31:51.667ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18422024-09-25T17:31:51.667ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8e871907-c27f-4d7b-b8dc-2a1da6609a0a", "content-length": "26", "date": "Wed, 25 Sep 2024 17:31:50 GMT"} })
18432024-09-25T17:31:51.667ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18442024-09-25T17:31:51.669ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
18452024-09-25T17:31:51.679ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
18462024-09-25T17:31:51.679ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18472024-09-25T17:31:51.680ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "55d6d42a-74e6-4e1d-b1de-b0d6b51d0b49", "content-length": "26", "date": "Wed, 25 Sep 2024 17:31:50 GMT"} })
18482024-09-25T17:31:51.680ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18492024-09-25T17:31:51.681ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18502024-09-25T17:31:51.739ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f/state
18512024-09-25T17:31:51.741ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "650467f5-5731-4d07-a2c1-cbdac79728f1", "content-length": "130", "date": "Wed, 25 Sep 2024 17:31:51 GMT"} })
18522024-09-25T17:31:51.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18532024-09-25T17:31:51.742ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 254.770202ms iteration = 14 status = 0
18542024-09-25T17:31:51.743ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 sled_id = f0d006a2-eb4a-4510-8a1c-6c144343343f state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-25T17:31:48.587709514Z }, migration_in: None, migration_out: None } vmm_id = 03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
18552024-09-25T17:31:51.743ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2043 instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 03a4abe3-47b1-4832-8d19-9f5cbc4bd12f sled_id = f0d006a2-eb4a-4510-8a1c-6c144343343f vmm_id = 03a4abe3-47b1-4832-8d19-9f5cbc4bd12f vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-09-25T17:31:48.587709514Z }
18562024-09-25T17:31:51.743ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 roles = RoleSet { roles: {} } sled_id = f0d006a2-eb4a-4510-8a1c-6c144343343f vmm_id = 03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
18572024-09-25T17:31:51.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 resource = Database result = Ok(()) sled_id = f0d006a2-eb4a-4510-8a1c-6c144343343f vmm_id = 03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
18582024-09-25T17:31:51.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18592024-09-25T17:31:51.744ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18602024-09-25T17:31:51.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18612024-09-25T17:31:51.746ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18622024-09-25T17:31:51.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18632024-09-25T17:31:51.748ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18642024-09-25T17:31:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18652024-09-25T17:31:51.752ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 265.127755ms iteration = 14 status = {}
18662024-09-25T17:31:51.776ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18672024-09-25T17:31:51.776ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a41a9378-80ee-4adb-a725-6a39c8569af6", "content-length": "523", "date": "Wed, 25 Sep 2024 17:31:51 GMT"} })
18682024-09-25T17:31:51.776ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18692024-09-25T17:31:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18702024-09-25T17:31:51.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18712024-09-25T17:31:51.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18722024-09-25T17:31:51.780ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18732024-09-25T17:31:51.780ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
18742024-09-25T17:31:51.780ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 292.237978ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
18752024-09-25T17:31:51.782ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
18762024-09-25T17:31:51.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18772024-09-25T17:31:51.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18782024-09-25T17:31:51.784ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 296.476187ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
18792024-09-25T17:31:51.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18802024-09-25T17:31:51.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18812024-09-25T17:31:51.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18822024-09-25T17:31:51.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18832024-09-25T17:31:51.795ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
18842024-09-25T17:31:51.795ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "df0abad3-6ea0-416e-8f98-f57fcedf47b7", "content-length": "1", "date": "Wed, 25 Sep 2024 17:31:51 GMT"} })
18852024-09-25T17:31:51.797ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18862024-09-25T17:31:51.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18872024-09-25T17:31:51.823ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18882024-09-25T17:31:51.824ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "14e5994c-e8b1-435b-9a49-433dec4c238e", "content-length": "810", "date": "Wed, 25 Sep 2024 17:31:51 GMT"} })
18892024-09-25T17:31:51.824ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(6632601) }} sled = sock
18902024-09-25T17:31:51.824ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18912024-09-25T17:31:51.824ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18922024-09-25T17:31:51.825ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 337.191173ms iteration = 14 status = {}
18932024-09-25T17:31:51.826ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 338.234901ms iteration = 14 status = null
18942024-09-25T17:31:51.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18952024-09-25T17:31:51.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18962024-09-25T17:31:51.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18972024-09-25T17:31:51.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18982024-09-25T17:31:51.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18992024-09-25T17:31:51.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19002024-09-25T17:31:51.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19012024-09-25T17:31:51.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19022024-09-25T17:31:51.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19032024-09-25T17:31:51.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19042024-09-25T17:31:51.839ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19052024-09-25T17:31:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19062024-09-25T17:31:51.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19072024-09-25T17:31:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19082024-09-25T17:31:51.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19092024-09-25T17:31:51.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19102024-09-25T17:31:51.844ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19112024-09-25T17:31:51.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, lookup_type: ById(dcfeb960-7abf-4e10-b28d-9fa9c33e4d51) }, key: 2be16c74-48fd-4bd5-bff6-41cb162cf48d, lookup_type: ById(2be16c74-48fd-4bd5-bff6-41cb162cf48d) }, key: a4d26af0-d2ac-4b72-b8fe-d770e1f523f8, lookup_type: ById(a4d26af0-d2ac-4b72-b8fe-d770e1f523f8) }, key: 6bad5f08-4b02-4067-931e-5021d7539e87, lookup_type: ById(6bad5f08-4b02-4067-931e-5021d7539e87) } result = Ok(())
19122024-09-25T17:31:51.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19132024-09-25T17:31:51.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19142024-09-25T17:31:51.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19152024-09-25T17:31:51.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19162024-09-25T17:31:51.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19172024-09-25T17:31:51.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19182024-09-25T17:31:51.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19192024-09-25T17:31:51.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, lookup_type: ById(dcfeb960-7abf-4e10-b28d-9fa9c33e4d51) }, key: 2be16c74-48fd-4bd5-bff6-41cb162cf48d, lookup_type: ById(2be16c74-48fd-4bd5-bff6-41cb162cf48d) }, key: a4d26af0-d2ac-4b72-b8fe-d770e1f523f8, lookup_type: ById(a4d26af0-d2ac-4b72-b8fe-d770e1f523f8) }, key: 6bad5f08-4b02-4067-931e-5021d7539e87, lookup_type: ById(6bad5f08-4b02-4067-931e-5021d7539e87) } result = Ok(())
19202024-09-25T17:31:51.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19212024-09-25T17:31:51.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19222024-09-25T17:31:51.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19232024-09-25T17:31:51.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19242024-09-25T17:31:51.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19252024-09-25T17:31:51.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19262024-09-25T17:31:51.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19272024-09-25T17:31:51.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19282024-09-25T17:31:51.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19292024-09-25T17:31:51.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19302024-09-25T17:31:51.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19312024-09-25T17:31:51.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19322024-09-25T17:31:51.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19332024-09-25T17:31:51.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19342024-09-25T17:31:51.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19352024-09-25T17:31:51.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19362024-09-25T17:31:51.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19372024-09-25T17:31:51.873ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, lookup_type: ById(dcfeb960-7abf-4e10-b28d-9fa9c33e4d51) }, key: 2be16c74-48fd-4bd5-bff6-41cb162cf48d, lookup_type: ById(2be16c74-48fd-4bd5-bff6-41cb162cf48d) }, key: a4d26af0-d2ac-4b72-b8fe-d770e1f523f8, lookup_type: ById(a4d26af0-d2ac-4b72-b8fe-d770e1f523f8) }, key: c927cc34-768e-4b83-a214-b48f20faae73, lookup_type: ByName("default") } result = Ok(())
19382024-09-25T17:31:51.873ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19392024-09-25T17:31:51.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19402024-09-25T17:31:51.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19412024-09-25T17:31:51.889ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 6e5d68bf-01bc-412c-9915-3ad6fd435156, rack_id: 5c1bad99-30b8-419d-9695-a982a6249225, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5d8104c-5830-4cb9-9490-d372d8c75371) } rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
19422024-09-25T17:31:51.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19432024-09-25T17:31:51.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19442024-09-25T17:31:51.899ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
19452024-09-25T17:31:51.899ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d57ea694-a959-4d52-895a-9353cde770e5", "content-length": "121", "date": "Wed, 25 Sep 2024 17:31:51 GMT"} })
19462024-09-25T17:31:51.899ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
19472024-09-25T17:31:51.899ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5d8104c-5830-4cb9-9490-d372d8c75371
19482024-09-25T17:31:51.899ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
19492024-09-25T17:31:51.899ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
19502024-09-25T17:31:51.899ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
19512024-09-25T17:31:51.899ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
19522024-09-25T17:31:51.899ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
19532024-09-25T17:31:51.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19542024-09-25T17:31:51.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19552024-09-25T17:31:51.902ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
19562024-09-25T17:31:51.903ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1fa2153a-0d8a-47d2-b0a1-6701ea75304f", "content-length": "2", "date": "Wed, 25 Sep 2024 17:31:51 GMT"} })
19572024-09-25T17:31:51.903ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
19582024-09-25T17:31:51.903ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "44bd4600-ef3c-4011-b4cb-0b9bf2e62a60", "content-length": "52", "date": "Wed, 25 Sep 2024 17:31:51 GMT"} })
19592024-09-25T17:31:51.903ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
19602024-09-25T17:31:51.903ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
19612024-09-25T17:31:51.979ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "60735731-a147-4dc2-af88-573611577316", "date": "Wed, 25 Sep 2024 17:31:51 GMT"} })
19622024-09-25T17:31:51.981ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 493.692509ms iteration = 15 status = {}
19632024-09-25T17:31:52.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = db32ef18-2c50-4003-afb3-b454ac1134b0 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19642024-09-25T17:31:52.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = db32ef18-2c50-4003-afb3-b454ac1134b0 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19652024-09-25T17:31:52.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = db32ef18-2c50-4003-afb3-b454ac1134b0 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19662024-09-25T17:31:52.082ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "aff1cde3-d9a7-4422-aee1-481f976a8bf5", "date": "Wed, 25 Sep 2024 17:31:51 GMT"} })
19672024-09-25T17:31:52.082ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch = Switch0
19682024-09-25T17:31:52.082ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
19692024-09-25T17:31:52.086ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8d81aa4b-12a5-45bd-8e68-e973a34b477a", "content-length": "667", "date": "Wed, 25 Sep 2024 17:31:51 GMT"} })
19702024-09-25T17:31:52.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19712024-09-25T17:31:52.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19722024-09-25T17:31:52.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19732024-09-25T17:31:52.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19742024-09-25T17:31:52.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19752024-09-25T17:31:52.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19762024-09-25T17:31:52.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19772024-09-25T17:31:52.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19782024-09-25T17:31:52.102ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 614.976362ms iteration = 14 status = {}
19792024-09-25T17:31:53.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4af3b1b0-0fcf-4f0e-85ec-f4394ae4fc06 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19802024-09-25T17:31:53.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4af3b1b0-0fcf-4f0e-85ec-f4394ae4fc06 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19812024-09-25T17:31:53.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4af3b1b0-0fcf-4f0e-85ec-f4394ae4fc06 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19822024-09-25T17:31:54.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b99efc6f-da26-46c6-997b-185e4d9b3113 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19832024-09-25T17:31:54.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b99efc6f-da26-46c6-997b-185e4d9b3113 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19842024-09-25T17:31:54.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b99efc6f-da26-46c6-997b-185e4d9b3113 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19852024-09-25T17:31:55.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 977a95f3-a298-4d7b-8636-7761baa8bfc5 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19862024-09-25T17:31:55.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 977a95f3-a298-4d7b-8636-7761baa8bfc5 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19872024-09-25T17:31:55.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 977a95f3-a298-4d7b-8636-7761baa8bfc5 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19882024-09-25T17:31:55.394ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8987 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = d7f22fbd-0588-4435-b3e0-5d89ae14229c response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
19892024-09-25T17:31:56.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c6592672-ec03-4ee8-997f-aad7724b7ca7 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19902024-09-25T17:31:56.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c6592672-ec03-4ee8-997f-aad7724b7ca7 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19912024-09-25T17:31:56.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c6592672-ec03-4ee8-997f-aad7724b7ca7 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19922024-09-25T17:31:57.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0a151698-6dea-410a-ba2f-0040e00a9029 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19932024-09-25T17:31:57.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0a151698-6dea-410a-ba2f-0040e00a9029 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19942024-09-25T17:31:57.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0a151698-6dea-410a-ba2f-0040e00a9029 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19952024-09-25T17:31:58.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = bbf89ea6-3a4a-40f0-be17-70dfd0a39de1 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19962024-09-25T17:31:58.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = bbf89ea6-3a4a-40f0-be17-70dfd0a39de1 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19972024-09-25T17:31:58.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = bbf89ea6-3a4a-40f0-be17-70dfd0a39de1 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
19982024-09-25T17:31:58.243ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2043 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 03a4abe3-47b1-4832-8d19-9f5cbc4bd12f remote_addr = [fd00:1122:3344:101::1]:39232 req_id = de6cddd0-0389-4f5c-8888-2f8402ee052a uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-09-25T17:31:58.243628005Z }
19992024-09-25T17:31:58.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = de6cddd0-0389-4f5c-8888-2f8402ee052a roles = RoleSet { roles: {} } uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20002024-09-25T17:31:58.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = de6cddd0-0389-4f5c-8888-2f8402ee052a resource = Database result = Ok(()) uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20012024-09-25T17:31:58.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 50319 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = de6cddd0-0389-4f5c-8888-2f8402ee052a response_code = 204 uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20022024-09-25T17:31:59.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 6dd0ab14-2a34-4bf4-9232-85c9661f73cf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
20032024-09-25T17:31:59.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 6dd0ab14-2a34-4bf4-9232-85c9661f73cf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
20042024-09-25T17:31:59.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 6dd0ab14-2a34-4bf4-9232-85c9661f73cf response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
20052024-09-25T17:31:59.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 326f5f33-8063-4264-a4ba-83b4cda2e46c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
20062024-09-25T17:31:59.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 326f5f33-8063-4264-a4ba-83b4cda2e46c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
20072024-09-25T17:31:59.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 326f5f33-8063-4264-a4ba-83b4cda2e46c response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
20082024-09-25T17:31:59.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 169043cc-bafb-4c15-afb3-07954898082a roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
20092024-09-25T17:31:59.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 169043cc-bafb-4c15-afb3-07954898082a resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
20102024-09-25T17:31:59.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 169043cc-bafb-4c15-afb3-07954898082a response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
20112024-09-25T17:32:00.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 0978a4d1-124d-43a6-ad91-7063e249b5b3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
20122024-09-25T17:32:00.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 0978a4d1-124d-43a6-ad91-7063e249b5b3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
20132024-09-25T17:32:00.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 0978a4d1-124d-43a6-ad91-7063e249b5b3 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
20142024-09-25T17:32:00.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ac6ca489-09ea-4a35-8acb-ac834026cf37 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
20152024-09-25T17:32:00.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ac6ca489-09ea-4a35-8acb-ac834026cf37 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
20162024-09-25T17:32:00.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ac6ca489-09ea-4a35-8acb-ac834026cf37 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
20172024-09-25T17:32:00.789ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2043 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 03a4abe3-47b1-4832-8d19-9f5cbc4bd12f remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-25T17:32:00.789267826Z }
20182024-09-25T17:32:00.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 roles = RoleSet { roles: {} } uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20192024-09-25T17:32:00.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 resource = Database result = Ok(()) uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20202024-09-25T17:32:00.821ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 03a4abe3-47b1-4832-8d19-9f5cbc4bd12f remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f vmm_needs_update = true
20212024-09-25T17:32:00.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 roles = RoleSet { roles: {} } uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20222024-09-25T17:32:00.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 resource = Database result = Ok(()) uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20232024-09-25T17:32:00.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 roles = RoleSet { roles: {} } uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20242024-09-25T17:32:00.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 resource = Database result = Ok(()) uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20252024-09-25T17:32:00.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 roles = RoleSet { roles: {} } uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20262024-09-25T17:32:00.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 resource = Database result = Ok(()) uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20272024-09-25T17:32:00.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 roles = RoleSet { roles: {} } uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20282024-09-25T17:32:00.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 resource = Database result = Ok(()) uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20292024-09-25T17:32:00.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 roles = RoleSet { roles: {} } uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20302024-09-25T17:32:00.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 resource = Database result = Ok(()) uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20312024-09-25T17:32:00.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 roles = RoleSet { roles: {} } uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20322024-09-25T17:32:00.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 resource = Database result = Ok(()) uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20332024-09-25T17:32:00.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20342024-09-25T17:32:00.836ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, lookup_type: ById(dcfeb960-7abf-4e10-b28d-9fa9c33e4d51) }, key: 2be16c74-48fd-4bd5-bff6-41cb162cf48d, lookup_type: ById(2be16c74-48fd-4bd5-bff6-41cb162cf48d) }, key: eb0db515-0d3a-4991-8ede-f0a4b1006dc4, lookup_type: ById(eb0db515-0d3a-4991-8ede-f0a4b1006dc4) } result = Ok(()) uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20352024-09-25T17:32:00.836ZINFOnexus (dropshot_internal): starting update saga for eb0db515-0d3a-4991-8ede-f0a4b1006dc4 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1518 instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-25T17:32:00.789267826Z }
20362024-09-25T17:32:00.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 46714 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 response_code = 204 uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20372024-09-25T17:32:00.836ZDEBGnexus (dropshot_internal): preparing instance-update saga for eb0db515-0d3a-4991-8ede-f0a4b1006dc4... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 598a6117-ee86-48bf-bd14-0d2d2a2a9a52 uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20382024-09-25T17:32:00.836ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2043 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 03a4abe3-47b1-4832-8d19-9f5cbc4bd12f remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e926a680-ea31-4412-ad0c-edef88d9db39 uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-09-25T17:32:00.789267826Z }
20392024-09-25T17:32:00.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e926a680-ea31-4412-ad0c-edef88d9db39 roles = RoleSet { roles: {} } uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20402024-09-25T17:32:00.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e926a680-ea31-4412-ad0c-edef88d9db39 resource = Database result = Ok(()) uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20412024-09-25T17:32:00.838ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update
20422024-09-25T17:32:00.838ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"eb0db515-0d3a-4991-8ede-f0a4b1006dc4","lookup_type":{"ById":"eb0db515-0d3a-4991-8ede-f0a4b1006dc4"},"parent":{"key":"2be16c74-48fd-4bd5-bff6-41cb162cf48d","lookup_type":{"ById":"2be16c74-48fd-4bd5-bff6-41cb162cf48d"},"parent":{"key":"dcfeb960-7abf-4e10-b28d-9fa9c33e4d51","lookup_type":{"ById":"dcfeb960-7abf-4e10-b28d-9fa9c33e4d51"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
20432024-09-25T17:32:00.838ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update
20442024-09-25T17:32:00.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3596 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e926a680-ea31-4412-ad0c-edef88d9db39 response_code = 204 uri = /vmms/03a4abe3-47b1-4832-8d19-9f5cbc4bd12f
20452024-09-25T17:32:00.880ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update
20462024-09-25T17:32:00.880ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
20472024-09-25T17:32:00.880ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
20482024-09-25T17:32:00.880ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1
20492024-09-25T17:32:00.892ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
20502024-09-25T17:32:00.892ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1
20512024-09-25T17:32:00.902ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
20522024-09-25T17:32:00.902ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1
20532024-09-25T17:32:00.915ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
20542024-09-25T17:32:00.915ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d198d0d9-3634-4149-a049-4a44a7057943")) node_id = 0 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1
20552024-09-25T17:32:00.925ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
20562024-09-25T17:32:00.925ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1
20572024-09-25T17:32:00.948ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update
20582024-09-25T17:32:00.948ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20592024-09-25T17:32:00.949ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20602024-09-25T17:32:00.950ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20612024-09-25T17:32:00.950ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20622024-09-25T17:32:00.952ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20632024-09-25T17:32:00.952ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20642024-09-25T17:32:00.954ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20652024-09-25T17:32:00.954ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20662024-09-25T17:32:00.955ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20672024-09-25T17:32:00.955ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20682024-09-25T17:32:00.957ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20692024-09-25T17:32:00.957ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20702024-09-25T17:32:00.958ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20712024-09-25T17:32:00.960ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, lookup_type: ById(dcfeb960-7abf-4e10-b28d-9fa9c33e4d51) }, key: 2be16c74-48fd-4bd5-bff6-41cb162cf48d, lookup_type: ById(2be16c74-48fd-4bd5-bff6-41cb162cf48d) }, key: eb0db515-0d3a-4991-8ede-f0a4b1006dc4, lookup_type: ById(eb0db515-0d3a-4991-8ede-f0a4b1006dc4) } result = Ok(()) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20722024-09-25T17:32:00.960ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance updater_id = d198d0d9-3634-4149-a049-4a44a7057943
20732024-09-25T17:32:00.961ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20742024-09-25T17:32:00.961ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20752024-09-25T17:32:00.980ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance updater_id = d198d0d9-3634-4149-a049-4a44a7057943
20762024-09-25T17:32:00.980ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20772024-09-25T17:32:00.980ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance
20782024-09-25T17:32:00.985ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 locked_gen = Generation(Generation(2)) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = LockInstance updater_id = d198d0d9-3634-4149-a049-4a44a7057943
20792024-09-25T17:32:00.993ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
20802024-09-25T17:32:00.993ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d198d0d9-3634-4149-a049-4a44a7057943")}) node_id = 1 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1
20812024-09-25T17:32:01.000ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
20822024-09-25T17:32:01.000ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1
20832024-09-25T17:32:01.010ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20842024-09-25T17:32:01.010ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20852024-09-25T17:32:01.022ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20862024-09-25T17:32:01.022ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20872024-09-25T17:32:01.024ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20882024-09-25T17:32:01.024ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20892024-09-25T17:32:01.025ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20902024-09-25T17:32:01.028ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, lookup_type: ById(dcfeb960-7abf-4e10-b28d-9fa9c33e4d51) }, key: 2be16c74-48fd-4bd5-bff6-41cb162cf48d, lookup_type: ById(2be16c74-48fd-4bd5-bff6-41cb162cf48d) }, key: eb0db515-0d3a-4991-8ede-f0a4b1006dc4, lookup_type: ById(eb0db515-0d3a-4991-8ede-f0a4b1006dc4) } result = Ok(()) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20912024-09-25T17:32:01.028ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20922024-09-25T17:32:01.028ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
20932024-09-25T17:32:01.035ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 03a4abe3-47b1-4832-8d19-9f5cbc4bd12f, time_created: 2024-09-25T17:31:40.242462Z, time_deleted: None, instance_id: eb0db515-0d3a-4991-8ede-f0a4b1006dc4, sled_id: f0d006a2-eb4a-4510-8a1c-6c144343343f, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-09-25T17:32:00.789267Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-09-25T17:31:37.995036Z, gen: Generation(Generation(3)), propolis_id: Some(03a4abe3-47b1-4832-8d19-9f5cbc4bd12f), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(03a4abe3-47b1-4832-8d19-9f5cbc4bd12f (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-09-25T17:32:01.035213174Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
20942024-09-25T17:32:01.039ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
20952024-09-25T17:32:01.041ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"eb0db515-0d3a-4991-8ede-f0a4b1006dc4","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"03a4abe3-47b1-4832-8d19-9f5cbc4bd12f"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"eb0db515-0d3a-4991-8ede-f0a4b1006dc4","lookup_type":{"ById":"eb0db515-0d3a-4991-8ede-f0a4b1006dc4"},"parent":{"key":"2be16c74-48fd-4bd5-bff6-41cb162cf48d","lookup_type":{"ById":"2be16c74-48fd-4bd5-bff6-41cb162cf48d"},"parent":{"key":"dcfeb960-7abf-4e10-b28d-9fa9c33e4d51","lookup_type":{"ById":"dcfeb960-7abf-4e10-b28d-9fa9c33e4d51"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"d198d0d9-3634-4149-a049-4a44a7057943"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"2be16c74-48fd-4bd5-bff6-41cb162cf48d","ram_diff":1073741824},"destroy_active_vmm":"03a4abe3-47b1-4832-8d19-9f5cbc4bd12f","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-09-25T17:32:01.035213174Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
20962024-09-25T17:32:01.041ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
20972024-09-25T17:32:01.058ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
20982024-09-25T17:32:01.058ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
20992024-09-25T17:32:01.058ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21002024-09-25T17:32:01.058ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21012024-09-25T17:32:01.071ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21022024-09-25T17:32:01.071ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21032024-09-25T17:32:01.081ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21042024-09-25T17:32:01.081ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21052024-09-25T17:32:01.106ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21062024-09-25T17:32:01.106ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a7e3a0e4-677a-4b4d-bae3-8f401b037b9c")) node_id = 0 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21072024-09-25T17:32:01.122ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21082024-09-25T17:32:01.122ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21092024-09-25T17:32:01.145ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 parent_lock = UpdaterLock { updater_id: d198d0d9-3634-4149-a049-4a44a7057943, locked_gen: Generation(Generation(2)) } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
21102024-09-25T17:32:01.145ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = BecomeUpdater
21112024-09-25T17:32:01.146ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = BecomeUpdater
21122024-09-25T17:32:01.171ZDEBGnexus (SagaExecutor): inherited lock from d198d0d9-3634-4149-a049-4a44a7057943 to a7e3a0e4-677a-4b4d-bae3-8f401b037b9c actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = d198d0d9-3634-4149-a049-4a44a7057943 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = BecomeUpdater updater_id = a7e3a0e4-677a-4b4d-bae3-8f401b037b9c
21132024-09-25T17:32:01.171ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:965 instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
21142024-09-25T17:32:01.172ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21152024-09-25T17:32:01.172ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a7e3a0e4-677a-4b4d-bae3-8f401b037b9c")}) node_id = 1 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21162024-09-25T17:32:01.185ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21172024-09-25T17:32:01.185ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21182024-09-25T17:32:01.196ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21192024-09-25T17:32:01.196ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21202024-09-25T17:32:01.200ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21212024-09-25T17:32:01.200ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21222024-09-25T17:32:01.209ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1018 instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
21232024-09-25T17:32:01.211ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4
21242024-09-25T17:32:01.214ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = UpdateNetworkConfig
21252024-09-25T17:32:01.214ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = UpdateNetworkConfig
21262024-09-25T17:32:01.219ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = UpdateNetworkConfig
21272024-09-25T17:32:01.220ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = UpdateNetworkConfig
21282024-09-25T17:32:01.222ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
21292024-09-25T17:32:01.222ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = UpdateNetworkConfig
21302024-09-25T17:32:01.222ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = UpdateNetworkConfig
21312024-09-25T17:32:01.224ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
21322024-09-25T17:32:01.224ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
21332024-09-25T17:32:01.224ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
21342024-09-25T17:32:01.225ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
21352024-09-25T17:32:01.226ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
21362024-09-25T17:32:01.226ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
21372024-09-25T17:32:01.227ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
21382024-09-25T17:32:01.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 70a0601e-3386-4e1c-9b1b-f8508216ddef roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
21392024-09-25T17:32:01.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 70a0601e-3386-4e1c-9b1b-f8508216ddef resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
21402024-09-25T17:32:01.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 70a0601e-3386-4e1c-9b1b-f8508216ddef response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
21412024-09-25T17:32:01.235ZDEBGnexus: notifying dendrite of updates instance_id = Some(eb0db515-0d3a-4991-8ede-f0a4b1006dc4 (instance)) switch = switch0
21422024-09-25T17:32:01.236ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2649, tv_nsec: 351652039 } })
21432024-09-25T17:32:01.236ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1051
21442024-09-25T17:32:01.267ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
21452024-09-25T17:32:01.267ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21462024-09-25T17:32:01.267ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bb69989d-ad1b-4f2d-a302-6cae1671b9d4", "content-length": "26", "date": "Wed, 25 Sep 2024 17:32:00 GMT"} })
21472024-09-25T17:32:01.267ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21482024-09-25T17:32:01.268ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21492024-09-25T17:32:01.297ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
21502024-09-25T17:32:01.298ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "07e848fe-d157-492a-8f68-68fd823ef9bd", "content-length": "4", "date": "Wed, 25 Sep 2024 17:32:00 GMT"} })
21512024-09-25T17:32:01.300ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21522024-09-25T17:32:01.300ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21532024-09-25T17:32:01.391ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21542024-09-25T17:32:01.391ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21552024-09-25T17:32:01.407ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
21562024-09-25T17:32:01.407ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
21572024-09-25T17:32:01.475ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1093 instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-09-25T17:32:01.409972Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 2be16c74-48fd-4bd5-bff6-41cb162cf48d, time_modified: Some(2024-09-25T17:32:01.409972Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, time_modified: Some(2024-09-25T17:32:01.409972Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
21582024-09-25T17:32:01.475ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21592024-09-25T17:32:01.475ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21602024-09-25T17:32:01.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
21612024-09-25T17:32:01.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
21622024-09-25T17:32:01.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21632024-09-25T17:32:01.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21642024-09-25T17:32:01.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21652024-09-25T17:32:01.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21662024-09-25T17:32:01.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21672024-09-25T17:32:01.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21682024-09-25T17:32:01.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21692024-09-25T17:32:01.490ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21702024-09-25T17:32:01.490ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21712024-09-25T17:32:01.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.823891ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21722024-09-25T17:32:01.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21732024-09-25T17:32:01.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21742024-09-25T17:32:01.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21752024-09-25T17:32:01.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21762024-09-25T17:32:01.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21772024-09-25T17:32:01.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21782024-09-25T17:32:01.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
21792024-09-25T17:32:01.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21802024-09-25T17:32:01.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21812024-09-25T17:32:01.503ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
21822024-09-25T17:32:01.503ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.809453ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
21832024-09-25T17:32:01.519ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1128 instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
21842024-09-25T17:32:01.519ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = UnassignOximeterProducer
21852024-09-25T17:32:01.519ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = UnassignOximeterProducer
21862024-09-25T17:32:01.556ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 producer_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
21872024-09-25T17:32:01.556ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = UnassignOximeterProducer
21882024-09-25T17:32:01.556ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = UnassignOximeterProducer
21892024-09-25T17:32:01.588ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
21902024-09-25T17:32:01.588ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/eb0db515-0d3a-4991-8ede-f0a4b1006dc4
21912024-09-25T17:32:01.589ZDEBGnexus (SagaExecutor): client response oximeter-collector = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/eb0db515-0d3a-4991-8ede-f0a4b1006dc4", query: None, fragment: None }, status: 204, headers: {"x-request-id": "857f3b97-5f90-4a61-99bf-59f542204b96", "date": "Wed, 25 Sep 2024 17:32:01 GMT"} }) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
21922024-09-25T17:32:01.589ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 producer_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
21932024-09-25T17:32:01.591ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21942024-09-25T17:32:01.591ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21952024-09-25T17:32:01.628ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
21962024-09-25T17:32:01.628ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
21972024-09-25T17:32:01.640ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 lock = UpdaterLock { updater_id: a7e3a0e4-677a-4b4d-bae3-8f401b037b9c, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-09-25T17:32:01.035213174Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
21982024-09-25T17:32:01.640ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = CommitInstanceUpdates
21992024-09-25T17:32:01.640ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = CommitInstanceUpdates
22002024-09-25T17:32:01.766ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1177 instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 new_runtime = InstanceRuntimeState { time_updated: 2024-09-25T17:32:01.035213174Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
22012024-09-25T17:32:01.766ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22022024-09-25T17:32:01.766ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22032024-09-25T17:32:01.766ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Signaled
22042024-09-25T17:32:01.766ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Signaled
22052024-09-25T17:32:01.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22062024-09-25T17:32:01.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22072024-09-25T17:32:01.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22082024-09-25T17:32:01.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22092024-09-25T17:32:01.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22102024-09-25T17:32:01.770ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22112024-09-25T17:32:01.770ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22122024-09-25T17:32:01.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22132024-09-25T17:32:01.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22142024-09-25T17:32:01.773ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22152024-09-25T17:32:01.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22162024-09-25T17:32:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22172024-09-25T17:32:01.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22182024-09-25T17:32:01.791ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22192024-09-25T17:32:01.791ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22202024-09-25T17:32:01.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22212024-09-25T17:32:01.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22222024-09-25T17:32:01.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22232024-09-25T17:32:01.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22242024-09-25T17:32:01.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22252024-09-25T17:32:01.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22262024-09-25T17:32:01.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22272024-09-25T17:32:01.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22282024-09-25T17:32:01.804ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22292024-09-25T17:32:01.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22302024-09-25T17:32:01.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22312024-09-25T17:32:01.807ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22322024-09-25T17:32:01.808ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2db9042f-cc22-411e-9f45-0b836c467905", "content-length": "372", "date": "Wed, 25 Sep 2024 17:32:01 GMT"} })
22332024-09-25T17:32:01.808ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22342024-09-25T17:32:01.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22352024-09-25T17:32:01.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22362024-09-25T17:32:01.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22372024-09-25T17:32:01.813ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22382024-09-25T17:32:01.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22392024-09-25T17:32:01.815ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22402024-09-25T17:32:01.815ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("eb0db515-0d3a-4991-8ede-f0a4b1006dc4"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("03a4abe3-47b1-4832-8d19-9f5cbc4bd12f")}) node_id = 7 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22412024-09-25T17:32:01.815ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22422024-09-25T17:32:01.816ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3444f427-4a0e-4817-a609-ce6ae9a8c524", "date": "Wed, 25 Sep 2024 17:32:01 GMT"} })
22432024-09-25T17:32:01.817ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 50.665261ms iteration = 16 status = {}
22442024-09-25T17:32:01.840ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22452024-09-25T17:32:01.840ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a211fc1c-480b-4a84-9b82-ac212bae694e", "content-length": "691", "date": "Wed, 25 Sep 2024 17:32:01 GMT"} })
22462024-09-25T17:32:01.840ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
22472024-09-25T17:32:01.841ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
22482024-09-25T17:32:01.841ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
22492024-09-25T17:32:01.841ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22502024-09-25T17:32:01.841ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22512024-09-25T17:32:01.843ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 76.45928ms iteration = 15 status = {}
22522024-09-25T17:32:01.852ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22532024-09-25T17:32:01.852ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22542024-09-25T17:32:01.873ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22552024-09-25T17:32:01.873ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22562024-09-25T17:32:01.900ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 propolis_id = 03a4abe3-47b1-4832-8d19-9f5cbc4bd12f saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
22572024-09-25T17:32:01.900ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = ReleaseSledResources
22582024-09-25T17:32:01.900ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = ReleaseSledResources
22592024-09-25T17:32:01.964ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22602024-09-25T17:32:01.964ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22612024-09-25T17:32:01.970ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22622024-09-25T17:32:01.970ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22632024-09-25T17:32:01.984ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 propolis_id = 03a4abe3-47b1-4832-8d19-9f5cbc4bd12f saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update
22642024-09-25T17:32:01.984ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = MarkVmmDeleted
22652024-09-25T17:32:01.984ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = MarkVmmDeleted
22662024-09-25T17:32:02.041ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22672024-09-25T17:32:02.041ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22682024-09-25T17:32:02.048ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22692024-09-25T17:32:02.048ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22702024-09-25T17:32:02.059ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22712024-09-25T17:32:02.059ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22722024-09-25T17:32:02.070ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22732024-09-25T17:32:02.070ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22742024-09-25T17:32:02.077ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = ChainSuccessorSaga
22752024-09-25T17:32:02.078ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = ChainSuccessorSaga
22762024-09-25T17:32:02.079ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = ChainSuccessorSaga
22772024-09-25T17:32:02.079ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = ChainSuccessorSaga
22782024-09-25T17:32:02.081ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = ChainSuccessorSaga
22792024-09-25T17:32:02.081ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = ChainSuccessorSaga
22802024-09-25T17:32:02.083ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = ChainSuccessorSaga
22812024-09-25T17:32:02.086ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, lookup_type: ById(dcfeb960-7abf-4e10-b28d-9fa9c33e4d51) }, key: 2be16c74-48fd-4bd5-bff6-41cb162cf48d, lookup_type: ById(2be16c74-48fd-4bd5-bff6-41cb162cf48d) }, key: eb0db515-0d3a-4991-8ede-f0a4b1006dc4, lookup_type: ById(eb0db515-0d3a-4991-8ede-f0a4b1006dc4) } result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = ChainSuccessorSaga
22822024-09-25T17:32:02.086ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = ChainSuccessorSaga
22832024-09-25T17:32:02.086ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_node = ChainSuccessorSaga
22842024-09-25T17:32:02.090ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22852024-09-25T17:32:02.090ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22862024-09-25T17:32:02.094ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22872024-09-25T17:32:02.094ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22882024-09-25T17:32:02.100ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22892024-09-25T17:32:02.100ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22902024-09-25T17:32:02.135ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22912024-09-25T17:32:02.135ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2
22922024-09-25T17:32:02.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = db0d243b-6731-43e4-ae52-fed00eb0528a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
22932024-09-25T17:32:02.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = db0d243b-6731-43e4-ae52-fed00eb0528a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
22942024-09-25T17:32:02.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = db0d243b-6731-43e4-ae52-fed00eb0528a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
22952024-09-25T17:32:02.202ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22962024-09-25T17:32:02.203ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 saga_name = instance-update saga_result = SagaResult { saga_id: 9f30b7d4-4496-43e2-a4ac-983b15d06ca2, saga_log: SagaLog { saga_id: 9f30b7d4-4496-43e2-a4ac-983b15d06ca2, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("a7e3a0e4-677a-4b4d-bae3-8f401b037b9c")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a7e3a0e4-677a-4b4d-bae3-8f401b037b9c")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("eb0db515-0d3a-4991-8ede-f0a4b1006dc4"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("03a4abe3-47b1-4832-8d19-9f5cbc4bd12f")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("eb0db515-0d3a-4991-8ede-f0a4b1006dc4"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("03a4abe3-47b1-4832-8d19-9f5cbc4bd12f")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("a7e3a0e4-677a-4b4d-bae3-8f401b037b9c"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("a7e3a0e4-677a-4b4d-bae3-8f401b037b9c")}} }) }
22972024-09-25T17:32:02.203ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 9f30b7d4-4496-43e2-a4ac-983b15d06ca2 instance_id = eb0db515-0d3a-4991-8ede-f0a4b1006dc4 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update
22982024-09-25T17:32:02.203ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
22992024-09-25T17:32:02.203ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1
23002024-09-25T17:32:02.215ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
23012024-09-25T17:32:02.215ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1
23022024-09-25T17:32:02.238ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
23032024-09-25T17:32:02.238ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1
23042024-09-25T17:32:02.247ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
23052024-09-25T17:32:02.247ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1
23062024-09-25T17:32:02.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d3fdaa3d-65d4-45fe-b1c4-93470c308ef0 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23072024-09-25T17:32:02.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d3fdaa3d-65d4-45fe-b1c4-93470c308ef0 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23082024-09-25T17:32:02.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d3fdaa3d-65d4-45fe-b1c4-93470c308ef0 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23092024-09-25T17:32:02.283ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update sec_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
23102024-09-25T17:32:02.283ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = b936ca51-2651-4d1e-94f9-5c115eb672f1 saga_name = start-instance-update saga_result = SagaResult { saga_id: b936ca51-2651-4d1e-94f9-5c115eb672f1, saga_log: SagaLog { saga_id: b936ca51-2651-4d1e-94f9-5c115eb672f1, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("d198d0d9-3634-4149-a049-4a44a7057943")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d198d0d9-3634-4149-a049-4a44a7057943")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("d198d0d9-3634-4149-a049-4a44a7057943"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("d198d0d9-3634-4149-a049-4a44a7057943")}} }) }
23112024-09-25T17:32:03.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 0525f44b-83b4-48e4-afb7-5dcf4b5152a6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
23122024-09-25T17:32:03.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 0525f44b-83b4-48e4-afb7-5dcf4b5152a6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
23132024-09-25T17:32:03.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 0525f44b-83b4-48e4-afb7-5dcf4b5152a6 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
23142024-09-25T17:32:03.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d2622fb0-3eac-49fe-9164-22622b113aa6 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23152024-09-25T17:32:03.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d2622fb0-3eac-49fe-9164-22622b113aa6 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23162024-09-25T17:32:03.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d2622fb0-3eac-49fe-9164-22622b113aa6 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23172024-09-25T17:32:04.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1677c107-1a03-47be-a906-d1ee8140bc59 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23182024-09-25T17:32:04.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1677c107-1a03-47be-a906-d1ee8140bc59 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23192024-09-25T17:32:04.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1677c107-1a03-47be-a906-d1ee8140bc59 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23202024-09-25T17:32:05.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2dafc0f8-8e49-4260-b694-c1e639fcb916 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23212024-09-25T17:32:05.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2dafc0f8-8e49-4260-b694-c1e639fcb916 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23222024-09-25T17:32:05.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2dafc0f8-8e49-4260-b694-c1e639fcb916 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23232024-09-25T17:32:05.387ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1796 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = f3305d3f-1084-4e5c-b8ac-cc3aac7d4ddf response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
23242024-09-25T17:32:06.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e344392d-d220-4ccb-95fd-ac9993c333bb roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23252024-09-25T17:32:06.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e344392d-d220-4ccb-95fd-ac9993c333bb resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23262024-09-25T17:32:06.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3067 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e344392d-d220-4ccb-95fd-ac9993c333bb response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23272024-09-25T17:32:07.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6d05dff9-71c7-49ad-a42b-2c1f5ac11bce roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23282024-09-25T17:32:07.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6d05dff9-71c7-49ad-a42b-2c1f5ac11bce resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23292024-09-25T17:32:07.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6d05dff9-71c7-49ad-a42b-2c1f5ac11bce response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23302024-09-25T17:32:08.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 75fe4542-4db5-4702-953f-46f9c16f66fa roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23312024-09-25T17:32:08.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 75fe4542-4db5-4702-953f-46f9c16f66fa resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23322024-09-25T17:32:08.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 75fe4542-4db5-4702-953f-46f9c16f66fa response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23332024-09-25T17:32:09.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d5d4f876-1731-4e8f-b4c9-a8de9a1273d2 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23342024-09-25T17:32:09.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d5d4f876-1731-4e8f-b4c9-a8de9a1273d2 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23352024-09-25T17:32:09.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2755 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d5d4f876-1731-4e8f-b4c9-a8de9a1273d2 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23362024-09-25T17:32:10.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8470b5fe-9944-46bf-91e1-bbcabf282f37 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23372024-09-25T17:32:10.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8470b5fe-9944-46bf-91e1-bbcabf282f37 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23382024-09-25T17:32:10.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2078 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8470b5fe-9944-46bf-91e1-bbcabf282f37 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23392024-09-25T17:32:11.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2649631e-abc7-4c0c-acdb-c3f56201ccdd roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23402024-09-25T17:32:11.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2649631e-abc7-4c0c-acdb-c3f56201ccdd resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23412024-09-25T17:32:11.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2649631e-abc7-4c0c-acdb-c3f56201ccdd response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23422024-09-25T17:32:11.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
23432024-09-25T17:32:11.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
23442024-09-25T17:32:11.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23452024-09-25T17:32:11.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23462024-09-25T17:32:11.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23472024-09-25T17:32:11.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23482024-09-25T17:32:11.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23492024-09-25T17:32:11.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23502024-09-25T17:32:11.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23512024-09-25T17:32:11.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.900412ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23522024-09-25T17:32:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23532024-09-25T17:32:11.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23542024-09-25T17:32:11.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23552024-09-25T17:32:11.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23562024-09-25T17:32:11.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23572024-09-25T17:32:11.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23582024-09-25T17:32:11.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
23592024-09-25T17:32:11.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23602024-09-25T17:32:11.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23612024-09-25T17:32:11.505ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
23622024-09-25T17:32:11.505ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.22518ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
23632024-09-25T17:32:12.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e5705d8e-6829-4f9c-9b38-17a0fc052fcd roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23642024-09-25T17:32:12.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e5705d8e-6829-4f9c-9b38-17a0fc052fcd resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23652024-09-25T17:32:12.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e5705d8e-6829-4f9c-9b38-17a0fc052fcd response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23662024-09-25T17:32:13.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 54b2ae74-0f7e-4f80-8cb9-5692a2c0b2e6 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23672024-09-25T17:32:13.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 54b2ae74-0f7e-4f80-8cb9-5692a2c0b2e6 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23682024-09-25T17:32:13.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 54b2ae74-0f7e-4f80-8cb9-5692a2c0b2e6 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23692024-09-25T17:32:14.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ea151ff5-3bb3-498b-87b1-78581d962a38 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23702024-09-25T17:32:14.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ea151ff5-3bb3-498b-87b1-78581d962a38 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23712024-09-25T17:32:14.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ea151ff5-3bb3-498b-87b1-78581d962a38 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23722024-09-25T17:32:15.386ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1528 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 9d16f251-4616-46e9-b72f-06047c2f0420 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
23732024-09-25T17:32:15.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fbf9ca83-5265-4611-9cf9-a5b30691f8b0 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23742024-09-25T17:32:15.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fbf9ca83-5265-4611-9cf9-a5b30691f8b0 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23752024-09-25T17:32:15.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fbf9ca83-5265-4611-9cf9-a5b30691f8b0 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23762024-09-25T17:32:16.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f38e085f-3a86-4736-80e2-894a13a139b8 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23772024-09-25T17:32:16.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f38e085f-3a86-4736-80e2-894a13a139b8 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23782024-09-25T17:32:16.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f38e085f-3a86-4736-80e2-894a13a139b8 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23792024-09-25T17:32:17.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e42fb914-a7ad-4b1e-a96f-ae372084bf47 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23802024-09-25T17:32:17.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e42fb914-a7ad-4b1e-a96f-ae372084bf47 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23812024-09-25T17:32:17.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e42fb914-a7ad-4b1e-a96f-ae372084bf47 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23822024-09-25T17:32:18.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e28de248-5eb3-4622-ab7f-1f015ae579a2 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23832024-09-25T17:32:18.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e28de248-5eb3-4622-ab7f-1f015ae579a2 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23842024-09-25T17:32:18.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e28de248-5eb3-4622-ab7f-1f015ae579a2 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23852024-09-25T17:32:19.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b1d87090-7b18-422e-806c-348381b4f362 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23862024-09-25T17:32:19.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b1d87090-7b18-422e-806c-348381b4f362 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23872024-09-25T17:32:19.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b1d87090-7b18-422e-806c-348381b4f362 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23882024-09-25T17:32:20.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cee1d681-868a-4226-97c3-2e0e2ecc20e2 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23892024-09-25T17:32:20.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cee1d681-868a-4226-97c3-2e0e2ecc20e2 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23902024-09-25T17:32:20.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cee1d681-868a-4226-97c3-2e0e2ecc20e2 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
23912024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
23922024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
23932024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23942024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
23952024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23962024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
23972024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23982024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
23992024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
24002024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
24012024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24022024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
24032024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
24042024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
24052024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
24062024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24072024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24082024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24092024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
24102024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
24112024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24122024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24132024-09-25T17:32:21.488ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa
24142024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
24152024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.79\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa"}
24162024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24172024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
24182024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
24192024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
24202024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
24212024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24222024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24232024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24242024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
24252024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24262024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
24272024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24282024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24292024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24302024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24312024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
24322024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
24332024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
24342024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24352024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
24362024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
24372024-09-25T17:32:21.488ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
24382024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24392024-09-25T17:32:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
24402024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24412024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
24422024-09-25T17:32:21.489ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-25 17:22:21.488827876 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
24432024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
24442024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
24452024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24462024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
24472024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24482024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
24492024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24502024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
24512024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
24522024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24532024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24542024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24552024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
24562024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
24572024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24582024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
24592024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24602024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24612024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24622024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
24632024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24642024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24652024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24662024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24672024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24682024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24692024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24702024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
24712024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24722024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24732024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24742024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24752024-09-25T17:32:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24762024-09-25T17:32:21.489ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("11f53a30-9163-413a-8f7f-4bf206fb8176.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("929fdd8e-9f93-4e52-8d3d-ae706bb7a130.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ddd5d4f4-1113-49a5-bb63-a018bec3753e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ddd5d4f4-1113-49a5-bb63-a018bec3753e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2669, tv_nsec: 605345958 } })
24772024-09-25T17:32:21.490ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae9bf3cd-ff12-421b-b5a2-d52b18bde4b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be8cd1d4-baa8-48cc-872f-69bc5c2df30c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be8cd1d4-baa8-48cc-872f-69bc5c2df30c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2669, tv_nsec: 605606173 } })
24782024-09-25T17:32:21.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24792024-09-25T17:32:21.492ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24802024-09-25T17:32:21.493ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.807939ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24812024-09-25T17:32:21.493ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
24822024-09-25T17:32:21.493ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 5.437571ms iteration = 9 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
24832024-09-25T17:32:21.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24842024-09-25T17:32:21.493ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
24852024-09-25T17:32:21.493ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 4.915641ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
24862024-09-25T17:32:21.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24872024-09-25T17:32:21.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24882024-09-25T17:32:21.495ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24892024-09-25T17:32:21.495ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24902024-09-25T17:32:21.495ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24912024-09-25T17:32:21.495ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24922024-09-25T17:32:21.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24932024-09-25T17:32:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24942024-09-25T17:32:21.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24952024-09-25T17:32:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24962024-09-25T17:32:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24972024-09-25T17:32:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24982024-09-25T17:32:21.496ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24992024-09-25T17:32:21.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25002024-09-25T17:32:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25012024-09-25T17:32:21.497ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25022024-09-25T17:32:21.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25032024-09-25T17:32:21.498ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 9.411745ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
25042024-09-25T17:32:21.499ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25052024-09-25T17:32:21.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25062024-09-25T17:32:21.501ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
25072024-09-25T17:32:21.501ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
25082024-09-25T17:32:21.501ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 12.301399ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
25092024-09-25T17:32:21.501ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25102024-09-25T17:32:21.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25112024-09-25T17:32:21.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.121984ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
25122024-09-25T17:32:21.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25132024-09-25T17:32:21.502ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25142024-09-25T17:32:21.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25152024-09-25T17:32:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25162024-09-25T17:32:21.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25172024-09-25T17:32:21.504ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.379696ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
25182024-09-25T17:32:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25192024-09-25T17:32:21.506ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-25 17:22:21.488827876 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
25202024-09-25T17:32:21.506ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.023245ms iteration = 8 status = {"expiration":"2024-09-25T17:22:21.488827876Z","pruned":[]}
25212024-09-25T17:32:21.506ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25222024-09-25T17:32:21.506ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25232024-09-25T17:32:21.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
25242024-09-25T17:32:21.510ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
25252024-09-25T17:32:21.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
25262024-09-25T17:32:21.511ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25272024-09-25T17:32:21.511ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25282024-09-25T17:32:21.511ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25292024-09-25T17:32:21.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25302024-09-25T17:32:21.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25312024-09-25T17:32:21.512ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2669, tv_nsec: 627777084 } })
25322024-09-25T17:32:21.512ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2669, tv_nsec: 627954958 } })
25332024-09-25T17:32:21.513ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
25342024-09-25T17:32:21.513ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
25352024-09-25T17:32:21.513ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25362024-09-25T17:32:21.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25372024-09-25T17:32:21.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25382024-09-25T17:32:21.515ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25392024-09-25T17:32:21.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25402024-09-25T17:32:21.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25412024-09-25T17:32:21.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25422024-09-25T17:32:21.518ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2669, tv_nsec: 634346346 } })
25432024-09-25T17:32:21.519ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25442024-09-25T17:32:21.519ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25452024-09-25T17:32:21.519ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25462024-09-25T17:32:21.519ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25472024-09-25T17:32:21.519ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.894454ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25482024-09-25T17:32:21.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25492024-09-25T17:32:21.520ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
25502024-09-25T17:32:21.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25512024-09-25T17:32:21.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25522024-09-25T17:32:21.522ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25532024-09-25T17:32:21.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25542024-09-25T17:32:21.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25552024-09-25T17:32:21.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25562024-09-25T17:32:21.525ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25572024-09-25T17:32:21.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25582024-09-25T17:32:21.526ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25592024-09-25T17:32:21.527ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25602024-09-25T17:32:21.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25612024-09-25T17:32:21.528ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25622024-09-25T17:32:21.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
25632024-09-25T17:32:21.531ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25642024-09-25T17:32:21.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25652024-09-25T17:32:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
25662024-09-25T17:32:21.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25672024-09-25T17:32:21.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25682024-09-25T17:32:21.535ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25692024-09-25T17:32:21.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25702024-09-25T17:32:21.538ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25712024-09-25T17:32:21.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25722024-09-25T17:32:21.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25732024-09-25T17:32:21.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25742024-09-25T17:32:21.566ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25752024-09-25T17:32:21.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25762024-09-25T17:32:21.570ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
25772024-09-25T17:32:21.570ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.550095ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
25782024-09-25T17:32:21.574ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
25792024-09-25T17:32:21.574ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25802024-09-25T17:32:21.574ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25812024-09-25T17:32:21.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25822024-09-25T17:32:21.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25832024-09-25T17:32:21.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25842024-09-25T17:32:21.581ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25852024-09-25T17:32:21.581ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
25862024-09-25T17:32:21.581ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 92.501988ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25872024-09-25T17:32:21.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25882024-09-25T17:32:21.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25892024-09-25T17:32:21.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25902024-09-25T17:32:21.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25912024-09-25T17:32:21.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25922024-09-25T17:32:21.585ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
25932024-09-25T17:32:21.585ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4983f296-eda5-4ab7-98fb-1acc9a8bf292 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
25942024-09-25T17:32:21.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25952024-09-25T17:32:21.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25962024-09-25T17:32:21.585ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
25972024-09-25T17:32:21.585ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
25982024-09-25T17:32:21.585ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
25992024-09-25T17:32:21.585ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26002024-09-25T17:32:21.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.005302ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26012024-09-25T17:32:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26022024-09-25T17:32:21.586ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26032024-09-25T17:32:21.586ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
26042024-09-25T17:32:21.586ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.9795ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
26052024-09-25T17:32:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26062024-09-25T17:32:21.587ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26072024-09-25T17:32:21.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26082024-09-25T17:32:21.589ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26092024-09-25T17:32:21.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26102024-09-25T17:32:21.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26112024-09-25T17:32:21.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26122024-09-25T17:32:21.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26132024-09-25T17:32:21.592ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26142024-09-25T17:32:21.592ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
26152024-09-25T17:32:21.592ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.629533ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
26162024-09-25T17:32:21.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26172024-09-25T17:32:21.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26182024-09-25T17:32:21.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26192024-09-25T17:32:21.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26202024-09-25T17:32:21.596ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26212024-09-25T17:32:21.596ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4983f296-eda5-4ab7-98fb-1acc9a8bf292 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
26222024-09-25T17:32:21.596ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26232024-09-25T17:32:21.596ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-25 17:25:42.974009 UTC dns_group = internal generation = 1
26242024-09-25T17:32:21.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26252024-09-25T17:32:21.596ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 108.75444ms iteration = 9 status = {"generation":1}
26262024-09-25T17:32:21.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26272024-09-25T17:32:21.598ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26282024-09-25T17:32:21.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26292024-09-25T17:32:21.599ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26302024-09-25T17:32:21.599ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26312024-09-25T17:32:21.601ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26322024-09-25T17:32:21.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26332024-09-25T17:32:21.604ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26342024-09-25T17:32:21.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f0d006a2-eb4a-4510-8a1c-6c144343343f, lookup_type: ById(f0d006a2-eb4a-4510-8a1c-6c144343343f) } result = Ok(())
26352024-09-25T17:32:21.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26362024-09-25T17:32:21.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26372024-09-25T17:32:21.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26382024-09-25T17:32:21.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26392024-09-25T17:32:21.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26402024-09-25T17:32:21.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26412024-09-25T17:32:21.614ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26422024-09-25T17:32:21.616ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 127.900075ms iteration = 15 status = 0
26432024-09-25T17:32:21.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26442024-09-25T17:32:21.618ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26452024-09-25T17:32:21.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26462024-09-25T17:32:21.621ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-25T17:25:19.066517Z, time_modified: 2024-09-25T17:25:19.066517Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, db_silo: Silo { identity: SiloIdentity { id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-25T17:25:43.663371Z, time_modified: 2024-09-25T17:25:43.663371Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, db_silo: Silo { identity: SiloIdentity { id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-25T17:25:43.663371Z, time_modified: 2024-09-25T17:25:43.663371Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
26472024-09-25T17:32:21.621ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 133.211325ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dcfeb960-7abf-4e10-b28d-9fa9c33e4d51","tls_certs":["4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c"]}},"default_endpoint":{"silo_id":"dcfeb960-7abf-4e10-b28d-9fa9c33e4d51","tls_certs":["4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26482024-09-25T17:32:21.621ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26492024-09-25T17:32:21.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26502024-09-25T17:32:21.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 137.029915ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26512024-09-25T17:32:21.627ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:67 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
26522024-09-25T17:32:21.627ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 139.547582ms iteration = 8 status = {"changed_state":[],"instances_found":0,"instances_reincarnated":[],"query_error":null,"restart_errors":{}}
26532024-09-25T17:32:21.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 143.929204ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26542024-09-25T17:32:21.642ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
26552024-09-25T17:32:21.647ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
26562024-09-25T17:32:21.647ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9011eb2e-f736-49fd-9148-03ee7daa981e dns_zone_name = oxide.test found_so_far = 0 version = 2
26572024-09-25T17:32:21.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26582024-09-25T17:32:21.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26592024-09-25T17:32:21.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26602024-09-25T17:32:21.653ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26612024-09-25T17:32:21.653ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26622024-09-25T17:32:21.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26632024-09-25T17:32:21.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e7a2fd6c-c294-4c6b-8589-f4fc124c3087 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
26642024-09-25T17:32:21.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e7a2fd6c-c294-4c6b-8589-f4fc124c3087 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
26652024-09-25T17:32:21.682ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26662024-09-25T17:32:21.700ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
26672024-09-25T17:32:21.700ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26682024-09-25T17:32:21.701ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "51e7a9f7-74eb-45c5-9494-978703b0afef", "content-length": "26", "date": "Wed, 25 Sep 2024 17:32:20 GMT"} })
26692024-09-25T17:32:21.701ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26702024-09-25T17:32:21.701ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 zone_address = fd00:1122:3344:101::2
26712024-09-25T17:32:21.701ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26722024-09-25T17:32:21.702ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
26732024-09-25T17:32:21.702ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26742024-09-25T17:32:21.702ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 213.420494ms iteration = 18 status = {"physical_disks_added":0}
26752024-09-25T17:32:21.702ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a3ca11d0-3b16-4280-a12b-4500caf95348", "content-length": "26", "date": "Wed, 25 Sep 2024 17:32:20 GMT"} })
26762024-09-25T17:32:21.702ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26772024-09-25T17:32:21.703ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fa670706-78be-4410-bb42-c98068b57eac", "content-length": "26", "date": "Wed, 25 Sep 2024 17:32:20 GMT"} })
26782024-09-25T17:32:21.703ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26792024-09-25T17:32:21.703ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26802024-09-25T17:32:21.704ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
26812024-09-25T17:32:21.704ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26822024-09-25T17:32:21.916ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 427.449719ms iteration = 15 status = {}
26832024-09-25T17:32:21.941ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26842024-09-25T17:32:21.941ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2373e74e-8724-42c1-ba94-e5d7c5eacc48", "content-length": "2", "date": "Wed, 25 Sep 2024 17:32:21 GMT"} })
26852024-09-25T17:32:21.942ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26862024-09-25T17:32:21.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26872024-09-25T17:32:21.968ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26882024-09-25T17:32:21.973ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26892024-09-25T17:32:21.975ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "60b70d41-41a1-42e8-9a72-db11e1144d5f", "date": "Wed, 25 Sep 2024 17:32:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26902024-09-25T17:32:21.975ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26912024-09-25T17:32:21.976ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dd97e58c-5c67-44ca-b569-75276989ec56", "date": "Wed, 25 Sep 2024 17:32:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26922024-09-25T17:32:21.976ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26932024-09-25T17:32:21.978ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26942024-09-25T17:32:21.978ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 490.267146ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26952024-09-25T17:32:21.993ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26962024-09-25T17:32:21.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 322030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e7a2fd6c-c294-4c6b-8589-f4fc124c3087 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
26972024-09-25T17:32:21.995ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9011eb2e-f736-49fd-9148-03ee7daa981e dns_zone_name = oxide.test found_so_far = 1 version = 2
26982024-09-25T17:32:21.995ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26992024-09-25T17:32:21.995ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-25 17:25:43.713253 UTC dns_group = external generation = 2
27002024-09-25T17:32:21.995ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 507.078178ms iteration = 9 status = {"generation":2}
27012024-09-25T17:32:21.996ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 507.049757ms iteration = 15 status = null
27022024-09-25T17:32:21.999ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
27032024-09-25T17:32:22.036ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0740aa6c-6d3a-4611-a385-141d20329fa3", "content-length": "691", "date": "Wed, 25 Sep 2024 17:32:22 GMT"} })
27042024-09-25T17:32:22.036ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
27052024-09-25T17:32:22.036ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
27062024-09-25T17:32:22.036ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
27072024-09-25T17:32:22.036ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d7747f21-da6e-45d2-8126-d99d9292b5d2", "content-length": "372", "date": "Wed, 25 Sep 2024 17:32:22 GMT"} })
27082024-09-25T17:32:22.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27092024-09-25T17:32:22.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27102024-09-25T17:32:22.037ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
27112024-09-25T17:32:22.038ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 549.257551ms iteration = 16 status = {}
27122024-09-25T17:32:22.038ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6cc12c06-30b1-4ad6-a650-2ab2ca91a806", "date": "Wed, 25 Sep 2024 17:32:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27132024-09-25T17:32:22.038ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27142024-09-25T17:32:22.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27152024-09-25T17:32:22.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27162024-09-25T17:32:22.039ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "953402dc-0a76-4a4c-8423-6c0981425123", "date": "Wed, 25 Sep 2024 17:32:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27172024-09-25T17:32:22.039ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27182024-09-25T17:32:22.041ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0a02e12f-41aa-4062-951b-8ca72f467e7f", "date": "Wed, 25 Sep 2024 17:32:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27192024-09-25T17:32:22.041ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27202024-09-25T17:32:22.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27212024-09-25T17:32:22.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27222024-09-25T17:32:22.043ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
27232024-09-25T17:32:22.043ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 555.17398ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
27242024-09-25T17:32:22.045ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27252024-09-25T17:32:22.045ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "da0a42aa-5120-40f0-8694-2b0c0e7869b0", "date": "Wed, 25 Sep 2024 17:32:22 GMT"} })
27262024-09-25T17:32:22.047ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 559.344418ms iteration = 17 status = {}
27272024-09-25T17:32:22.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27282024-09-25T17:32:22.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27292024-09-25T17:32:22.050ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 6e5d68bf-01bc-412c-9915-3ad6fd435156, rack_id: 5c1bad99-30b8-419d-9695-a982a6249225, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5d8104c-5830-4cb9-9490-d372d8c75371) } rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
27302024-09-25T17:32:22.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27312024-09-25T17:32:22.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27322024-09-25T17:32:22.060ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27332024-09-25T17:32:22.061ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c0e5f3e5-481c-4212-aca3-0ab6be95cd64", "content-length": "121", "date": "Wed, 25 Sep 2024 17:32:21 GMT"} })
27342024-09-25T17:32:22.061ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
27352024-09-25T17:32:22.061ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5d8104c-5830-4cb9-9490-d372d8c75371
27362024-09-25T17:32:22.061ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27372024-09-25T17:32:22.061ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27382024-09-25T17:32:22.061ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
27392024-09-25T17:32:22.061ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
27402024-09-25T17:32:22.061ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
27412024-09-25T17:32:22.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27422024-09-25T17:32:22.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27432024-09-25T17:32:22.063ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27442024-09-25T17:32:22.063ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f91600e4-5c5d-42c5-ae50-181664f9a442", "content-length": "2", "date": "Wed, 25 Sep 2024 17:32:21 GMT"} })
27452024-09-25T17:32:22.063ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27462024-09-25T17:32:22.063ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "99d48ed6-7afb-4e64-98a8-2b651e5f345f", "content-length": "52", "date": "Wed, 25 Sep 2024 17:32:21 GMT"} })
27472024-09-25T17:32:22.063ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
27482024-09-25T17:32:22.063ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27492024-09-25T17:32:22.155ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8db02d66-f884-4f5b-9b9d-7aa5b2b3758d", "date": "Wed, 25 Sep 2024 17:32:22 GMT"} })
27502024-09-25T17:32:22.155ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch = Switch0
27512024-09-25T17:32:22.155ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27522024-09-25T17:32:22.155ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cb74caac-62b1-413c-a4f7-dc06885cd9e9", "content-length": "667", "date": "Wed, 25 Sep 2024 17:32:22 GMT"} })
27532024-09-25T17:32:22.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27542024-09-25T17:32:22.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27552024-09-25T17:32:22.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27562024-09-25T17:32:22.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27572024-09-25T17:32:22.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27582024-09-25T17:32:22.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27592024-09-25T17:32:22.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27602024-09-25T17:32:22.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27612024-09-25T17:32:22.171ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 683.196068ms iteration = 15 status = {}
27622024-09-25T17:32:23.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0e32a4bf-60a3-4f21-92ad-93a5c33f6112 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27632024-09-25T17:32:23.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0e32a4bf-60a3-4f21-92ad-93a5c33f6112 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27642024-09-25T17:32:23.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0e32a4bf-60a3-4f21-92ad-93a5c33f6112 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27652024-09-25T17:32:24.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 653f0e72-8508-4a32-9541-832b6eb84256 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27662024-09-25T17:32:24.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 653f0e72-8508-4a32-9541-832b6eb84256 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27672024-09-25T17:32:24.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 653f0e72-8508-4a32-9541-832b6eb84256 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27682024-09-25T17:32:25.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1ca20f8a-614f-4e71-9497-eb584ed0ec2a roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27692024-09-25T17:32:25.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1ca20f8a-614f-4e71-9497-eb584ed0ec2a resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27702024-09-25T17:32:25.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1ca20f8a-614f-4e71-9497-eb584ed0ec2a response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27712024-09-25T17:32:25.387ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1379 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 08edde79-5286-4748-b75c-7a49fa2715f1 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
27722024-09-25T17:32:26.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a4308507-5478-4efd-b2f2-34182a4729d4 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27732024-09-25T17:32:26.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a4308507-5478-4efd-b2f2-34182a4729d4 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27742024-09-25T17:32:26.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a4308507-5478-4efd-b2f2-34182a4729d4 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27752024-09-25T17:32:27.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5fd7603b-4118-4a59-9ca4-cb109855e739 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27762024-09-25T17:32:27.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5fd7603b-4118-4a59-9ca4-cb109855e739 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27772024-09-25T17:32:27.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5fd7603b-4118-4a59-9ca4-cb109855e739 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27782024-09-25T17:32:28.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d2941eff-487f-461d-ad9c-366dff820cb8 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27792024-09-25T17:32:28.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d2941eff-487f-461d-ad9c-366dff820cb8 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27802024-09-25T17:32:28.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2553 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d2941eff-487f-461d-ad9c-366dff820cb8 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27812024-09-25T17:32:29.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 73e3e40e-1dcd-48ac-b296-57a60a1baa25 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27822024-09-25T17:32:29.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 73e3e40e-1dcd-48ac-b296-57a60a1baa25 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27832024-09-25T17:32:29.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 73e3e40e-1dcd-48ac-b296-57a60a1baa25 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27842024-09-25T17:32:30.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4f66105d-8bc2-4839-a6d6-0b7b0150064b roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27852024-09-25T17:32:30.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4f66105d-8bc2-4839-a6d6-0b7b0150064b resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27862024-09-25T17:32:30.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4f66105d-8bc2-4839-a6d6-0b7b0150064b response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27872024-09-25T17:32:31.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 38271d54-cd63-449f-a99d-05d1c7648206 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27882024-09-25T17:32:31.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 38271d54-cd63-449f-a99d-05d1c7648206 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27892024-09-25T17:32:31.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 38271d54-cd63-449f-a99d-05d1c7648206 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
27902024-09-25T17:32:31.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
27912024-09-25T17:32:31.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27922024-09-25T17:32:31.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
27932024-09-25T17:32:31.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27942024-09-25T17:32:31.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27952024-09-25T17:32:31.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27962024-09-25T17:32:31.490ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27972024-09-25T17:32:31.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27982024-09-25T17:32:31.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27992024-09-25T17:32:31.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.844341ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28002024-09-25T17:32:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28012024-09-25T17:32:31.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28022024-09-25T17:32:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28032024-09-25T17:32:31.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28042024-09-25T17:32:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28052024-09-25T17:32:31.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28062024-09-25T17:32:31.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
28072024-09-25T17:32:31.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28082024-09-25T17:32:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28092024-09-25T17:32:31.505ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
28102024-09-25T17:32:31.505ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.25177ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
28112024-09-25T17:32:32.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d0e28643-e70e-4bb3-814c-bef984b6e501 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28122024-09-25T17:32:32.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d0e28643-e70e-4bb3-814c-bef984b6e501 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28132024-09-25T17:32:32.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d0e28643-e70e-4bb3-814c-bef984b6e501 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28142024-09-25T17:32:33.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 0f2d051d-9cd6-48fe-a22a-a5bd38bb76fe roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
28152024-09-25T17:32:33.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 0f2d051d-9cd6-48fe-a22a-a5bd38bb76fe resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
28162024-09-25T17:32:33.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 0f2d051d-9cd6-48fe-a22a-a5bd38bb76fe response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
28172024-09-25T17:32:33.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 74ab2ee1-7b7a-484e-9bb2-7e5669104004 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28182024-09-25T17:32:33.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 74ab2ee1-7b7a-484e-9bb2-7e5669104004 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28192024-09-25T17:32:33.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 74ab2ee1-7b7a-484e-9bb2-7e5669104004 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28202024-09-25T17:32:34.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1c758943-cb39-41ff-9328-31c6d2f683a0 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28212024-09-25T17:32:34.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1c758943-cb39-41ff-9328-31c6d2f683a0 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28222024-09-25T17:32:34.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1c758943-cb39-41ff-9328-31c6d2f683a0 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28232024-09-25T17:32:35.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5f68725e-1a16-484d-b429-9c9707a69205 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28242024-09-25T17:32:35.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5f68725e-1a16-484d-b429-9c9707a69205 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28252024-09-25T17:32:35.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2851 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5f68725e-1a16-484d-b429-9c9707a69205 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28262024-09-25T17:32:35.387ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1743 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 59818f65-d447-4093-b2f8-f4f5016309c4 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
28272024-09-25T17:32:36.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2d099dfb-821a-469b-8b1d-515a8ca209d0 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28282024-09-25T17:32:36.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2d099dfb-821a-469b-8b1d-515a8ca209d0 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28292024-09-25T17:32:36.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2d099dfb-821a-469b-8b1d-515a8ca209d0 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28302024-09-25T17:32:37.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5507953c-c8d0-4c69-989d-6d6c7310216a roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28312024-09-25T17:32:37.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5507953c-c8d0-4c69-989d-6d6c7310216a resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28322024-09-25T17:32:37.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5507953c-c8d0-4c69-989d-6d6c7310216a response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28332024-09-25T17:32:38.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ec943413-67b1-4d69-bf80-9332ea5fe163 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28342024-09-25T17:32:38.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ec943413-67b1-4d69-bf80-9332ea5fe163 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28352024-09-25T17:32:38.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ec943413-67b1-4d69-bf80-9332ea5fe163 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28362024-09-25T17:32:39.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f676117c-9b4f-4630-bf50-261673632703 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28372024-09-25T17:32:39.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f676117c-9b4f-4630-bf50-261673632703 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28382024-09-25T17:32:39.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2664 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f676117c-9b4f-4630-bf50-261673632703 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28392024-09-25T17:32:40.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = eb4f4fc3-4ffb-435c-a946-4ecaf24a7856 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28402024-09-25T17:32:40.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = eb4f4fc3-4ffb-435c-a946-4ecaf24a7856 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28412024-09-25T17:32:40.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1937 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = eb4f4fc3-4ffb-435c-a946-4ecaf24a7856 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28422024-09-25T17:32:41.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 70d2cf8a-44f3-4270-bde7-80eff2960f67 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28432024-09-25T17:32:41.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 70d2cf8a-44f3-4270-bde7-80eff2960f67 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28442024-09-25T17:32:41.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 70d2cf8a-44f3-4270-bde7-80eff2960f67 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28452024-09-25T17:32:41.487ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
28462024-09-25T17:32:41.487ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28472024-09-25T17:32:41.487ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
28482024-09-25T17:32:41.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28492024-09-25T17:32:41.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28502024-09-25T17:32:41.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28512024-09-25T17:32:41.489ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28522024-09-25T17:32:41.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28532024-09-25T17:32:41.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28542024-09-25T17:32:41.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.514466ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28552024-09-25T17:32:41.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28562024-09-25T17:32:41.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28572024-09-25T17:32:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28582024-09-25T17:32:41.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28592024-09-25T17:32:41.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28602024-09-25T17:32:41.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28612024-09-25T17:32:41.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
28622024-09-25T17:32:41.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28632024-09-25T17:32:41.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28642024-09-25T17:32:41.507ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
28652024-09-25T17:32:41.507ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.107063ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
28662024-09-25T17:32:42.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 08cd816a-cc67-403a-818f-80091d0a2c9a roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28672024-09-25T17:32:42.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 08cd816a-cc67-403a-818f-80091d0a2c9a resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28682024-09-25T17:32:42.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 08cd816a-cc67-403a-818f-80091d0a2c9a response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28692024-09-25T17:32:43.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a8286842-4044-4c92-abfb-7bebe6ee0f16 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28702024-09-25T17:32:43.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a8286842-4044-4c92-abfb-7bebe6ee0f16 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28712024-09-25T17:32:43.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a8286842-4044-4c92-abfb-7bebe6ee0f16 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28722024-09-25T17:32:44.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = bc350649-1fee-4fb8-bacd-5f6a85935302 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28732024-09-25T17:32:44.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = bc350649-1fee-4fb8-bacd-5f6a85935302 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28742024-09-25T17:32:44.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = bc350649-1fee-4fb8-bacd-5f6a85935302 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28752024-09-25T17:32:45.386ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1366 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = ee674d42-a07b-48d2-94b4-fc015c9a4442 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
28762024-09-25T17:32:45.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9d59d7b8-4feb-4ea9-a977-45c89bfec6e0 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28772024-09-25T17:32:45.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9d59d7b8-4feb-4ea9-a977-45c89bfec6e0 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28782024-09-25T17:32:45.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9d59d7b8-4feb-4ea9-a977-45c89bfec6e0 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28792024-09-25T17:32:46.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5f8180b0-3d89-4c5f-bb77-55fffec745b1 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28802024-09-25T17:32:46.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5f8180b0-3d89-4c5f-bb77-55fffec745b1 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28812024-09-25T17:32:46.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5f8180b0-3d89-4c5f-bb77-55fffec745b1 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28822024-09-25T17:32:47.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6193543b-2c11-4af0-8b28-df7179a2498b roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28832024-09-25T17:32:47.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6193543b-2c11-4af0-8b28-df7179a2498b resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28842024-09-25T17:32:47.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6193543b-2c11-4af0-8b28-df7179a2498b response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28852024-09-25T17:32:48.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e9b16dcc-f415-4aa7-895f-004831f1171e roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28862024-09-25T17:32:48.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e9b16dcc-f415-4aa7-895f-004831f1171e resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28872024-09-25T17:32:48.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e9b16dcc-f415-4aa7-895f-004831f1171e response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28882024-09-25T17:32:49.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = eb6bab67-f9b0-45a6-8dc8-efda099fe3a3 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28892024-09-25T17:32:49.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = eb6bab67-f9b0-45a6-8dc8-efda099fe3a3 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28902024-09-25T17:32:49.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2768 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = eb6bab67-f9b0-45a6-8dc8-efda099fe3a3 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28912024-09-25T17:32:50.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a47402d0-5ea4-4dc3-b04b-bcbfadd7df9c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28922024-09-25T17:32:50.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a47402d0-5ea4-4dc3-b04b-bcbfadd7df9c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28932024-09-25T17:32:50.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a47402d0-5ea4-4dc3-b04b-bcbfadd7df9c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
28942024-09-25T17:32:51.487ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
28952024-09-25T17:32:51.487ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
28962024-09-25T17:32:51.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28972024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
28982024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28992024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29002024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
29012024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
29022024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29032024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
29042024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29052024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29062024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
29072024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29082024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
29092024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29102024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
29112024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29122024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29132024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
29142024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
29152024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29162024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
29172024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
29182024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29192024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29202024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
29212024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29222024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
29232024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29242024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
29252024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29262024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
29272024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29282024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29292024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29302024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29312024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29322024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29332024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29342024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29352024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29362024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29372024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29382024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29392024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29402024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29412024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29422024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29432024-09-25T17:32:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29442024-09-25T17:32:51.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29452024-09-25T17:32:51.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29462024-09-25T17:32:51.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29472024-09-25T17:32:51.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.841571ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
29482024-09-25T17:32:51.492ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.104406ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29492024-09-25T17:32:51.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29502024-09-25T17:32:51.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29512024-09-25T17:32:51.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29522024-09-25T17:32:51.492ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29532024-09-25T17:32:51.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29542024-09-25T17:32:51.494ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29552024-09-25T17:32:51.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29562024-09-25T17:32:51.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29572024-09-25T17:32:51.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29582024-09-25T17:32:51.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29592024-09-25T17:32:51.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29602024-09-25T17:32:51.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29612024-09-25T17:32:51.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29622024-09-25T17:32:51.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29632024-09-25T17:32:51.497ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29642024-09-25T17:32:51.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29652024-09-25T17:32:51.498ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29662024-09-25T17:32:51.498ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29672024-09-25T17:32:51.498ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29682024-09-25T17:32:51.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29692024-09-25T17:32:51.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29702024-09-25T17:32:51.498ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29712024-09-25T17:32:51.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29722024-09-25T17:32:51.500ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29732024-09-25T17:32:51.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29742024-09-25T17:32:51.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29752024-09-25T17:32:51.502ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2699, tv_nsec: 617802588 } })
29762024-09-25T17:32:51.502ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2699, tv_nsec: 618074533 } })
29772024-09-25T17:32:51.502ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.655792ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29782024-09-25T17:32:51.503ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
29792024-09-25T17:32:51.504ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
29802024-09-25T17:32:51.504ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29812024-09-25T17:32:51.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29822024-09-25T17:32:51.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29832024-09-25T17:32:51.505ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2699, tv_nsec: 620746422 } })
29842024-09-25T17:32:51.505ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
29852024-09-25T17:32:51.506ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29862024-09-25T17:32:51.506ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29872024-09-25T17:32:51.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29882024-09-25T17:32:51.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29892024-09-25T17:32:51.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29902024-09-25T17:32:51.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29912024-09-25T17:32:51.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29922024-09-25T17:32:51.508ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29932024-09-25T17:32:51.508ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29942024-09-25T17:32:51.509ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29952024-09-25T17:32:51.509ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.639962ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29962024-09-25T17:32:51.510ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29972024-09-25T17:32:51.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29982024-09-25T17:32:51.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29992024-09-25T17:32:51.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30002024-09-25T17:32:51.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30012024-09-25T17:32:51.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30022024-09-25T17:32:51.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
30032024-09-25T17:32:51.513ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30042024-09-25T17:32:51.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30052024-09-25T17:32:51.530ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.896848ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
30062024-09-25T17:32:51.530ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
30072024-09-25T17:32:51.530ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.320406ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
30082024-09-25T17:32:51.531ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30092024-09-25T17:32:51.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30102024-09-25T17:32:51.532ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30112024-09-25T17:32:51.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30122024-09-25T17:32:51.535ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30132024-09-25T17:32:51.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30142024-09-25T17:32:51.542ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30152024-09-25T17:32:51.542ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30162024-09-25T17:32:51.542ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30172024-09-25T17:32:51.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30182024-09-25T17:32:51.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30192024-09-25T17:32:51.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30202024-09-25T17:32:51.546ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30212024-09-25T17:32:51.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30222024-09-25T17:32:51.553ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30232024-09-25T17:32:51.557ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.395219ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30242024-09-25T17:32:51.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f0d006a2-eb4a-4510-8a1c-6c144343343f, lookup_type: ById(f0d006a2-eb4a-4510-8a1c-6c144343343f) } result = Ok(())
30252024-09-25T17:32:51.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30262024-09-25T17:32:51.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30272024-09-25T17:32:51.560ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 72.255042ms iteration = 16 status = 0
30282024-09-25T17:32:51.569ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 81.234779ms iteration = 19 status = {"physical_disks_added":0}
30292024-09-25T17:32:51.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 91.611031ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30302024-09-25T17:32:51.582ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.997016ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30312024-09-25T17:32:51.586ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30322024-09-25T17:32:51.586ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30332024-09-25T17:32:51.586ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 98.860937ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30342024-09-25T17:32:51.601ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
30352024-09-25T17:32:51.601ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30362024-09-25T17:32:51.602ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fc73c8ef-0626-4e2d-9fe7-150d0f5f4c20", "content-length": "26", "date": "Wed, 25 Sep 2024 17:32:50 GMT"} })
30372024-09-25T17:32:51.602ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30382024-09-25T17:32:51.603ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30392024-09-25T17:32:51.610ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 zone_address = fd00:1122:3344:101::2
30402024-09-25T17:32:51.610ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30412024-09-25T17:32:51.611ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a4c5a5e3-b029-4a21-82a9-e674fa8e68fd", "content-length": "26", "date": "Wed, 25 Sep 2024 17:32:50 GMT"} })
30422024-09-25T17:32:51.611ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30432024-09-25T17:32:51.613ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
30442024-09-25T17:32:51.613ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
30452024-09-25T17:32:51.613ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30462024-09-25T17:32:51.613ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f1ec6132-296b-425c-9978-6ad9153a5df8", "content-length": "26", "date": "Wed, 25 Sep 2024 17:32:50 GMT"} })
30472024-09-25T17:32:51.613ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30482024-09-25T17:32:51.615ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30492024-09-25T17:32:51.643ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30502024-09-25T17:32:51.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30512024-09-25T17:32:51.651ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30522024-09-25T17:32:51.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30532024-09-25T17:32:51.653ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30542024-09-25T17:32:51.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30552024-09-25T17:32:51.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30562024-09-25T17:32:51.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30572024-09-25T17:32:51.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 36e28bb7-7808-40ed-b1ca-41078c7eaa7a roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
30582024-09-25T17:32:51.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 36e28bb7-7808-40ed-b1ca-41078c7eaa7a resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
30592024-09-25T17:32:51.701ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30602024-09-25T17:32:51.701ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a28a9736-2cd9-453b-87fc-5523872d07ab", "content-length": "372", "date": "Wed, 25 Sep 2024 17:32:51 GMT"} })
30612024-09-25T17:32:51.701ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30622024-09-25T17:32:51.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30632024-09-25T17:32:51.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 36724 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 36e28bb7-7808-40ed-b1ca-41078c7eaa7a response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
30642024-09-25T17:32:51.705ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30652024-09-25T17:32:51.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30662024-09-25T17:32:51.707ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 219.071199ms iteration = 16 status = {}
30672024-09-25T17:32:51.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30682024-09-25T17:32:51.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30692024-09-25T17:32:51.712ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30702024-09-25T17:32:51.713ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "547623fb-332b-41ba-a472-30c32fc99b16", "date": "Wed, 25 Sep 2024 17:32:51 GMT"} })
30712024-09-25T17:32:51.714ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 226.464936ms iteration = 18 status = {}
30722024-09-25T17:32:51.724ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30732024-09-25T17:32:51.724ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bb4d305b-5235-4ef1-a5a2-a783982f8c92", "content-length": "2", "date": "Wed, 25 Sep 2024 17:32:51 GMT"} })
30742024-09-25T17:32:51.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30752024-09-25T17:32:51.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30762024-09-25T17:32:51.728ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 240.735651ms iteration = 16 status = null
30772024-09-25T17:32:51.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30782024-09-25T17:32:51.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30792024-09-25T17:32:51.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30802024-09-25T17:32:51.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30812024-09-25T17:32:51.801ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30822024-09-25T17:32:51.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30832024-09-25T17:32:51.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30842024-09-25T17:32:51.817ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 6e5d68bf-01bc-412c-9915-3ad6fd435156, rack_id: 5c1bad99-30b8-419d-9695-a982a6249225, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5d8104c-5830-4cb9-9490-d372d8c75371) } rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
30852024-09-25T17:32:51.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30862024-09-25T17:32:51.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30872024-09-25T17:32:51.825ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30882024-09-25T17:32:51.826ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "559f8748-2542-4e40-b72f-c0abae2486fe", "content-length": "121", "date": "Wed, 25 Sep 2024 17:32:51 GMT"} })
30892024-09-25T17:32:51.826ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
30902024-09-25T17:32:51.826ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5d8104c-5830-4cb9-9490-d372d8c75371
30912024-09-25T17:32:51.826ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30922024-09-25T17:32:51.826ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30932024-09-25T17:32:51.826ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
30942024-09-25T17:32:51.826ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
30952024-09-25T17:32:51.826ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
30962024-09-25T17:32:51.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30972024-09-25T17:32:51.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30982024-09-25T17:32:51.828ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30992024-09-25T17:32:51.829ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3ea2eb3d-a1aa-4998-9cb7-338b3c5a7c91", "content-length": "2", "date": "Wed, 25 Sep 2024 17:32:51 GMT"} })
31002024-09-25T17:32:51.829ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
31012024-09-25T17:32:51.829ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c10d8135-1fbe-42b1-ae45-abaa3f4c3665", "content-length": "52", "date": "Wed, 25 Sep 2024 17:32:51 GMT"} })
31022024-09-25T17:32:51.829ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
31032024-09-25T17:32:51.829ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
31042024-09-25T17:32:51.876ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "80feae51-fb09-4808-b92c-834eba0e73b2", "content-length": "691", "date": "Wed, 25 Sep 2024 17:32:51 GMT"} })
31052024-09-25T17:32:51.876ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
31062024-09-25T17:32:51.876ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
31072024-09-25T17:32:51.876ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
31082024-09-25T17:32:51.877ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 389.684227ms iteration = 17 status = {}
31092024-09-25T17:32:51.962ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0b60640c-fa95-470b-9c27-607b17c5072d", "date": "Wed, 25 Sep 2024 17:32:51 GMT"} })
31102024-09-25T17:32:51.962ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch = Switch0
31112024-09-25T17:32:51.962ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31122024-09-25T17:32:51.965ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1c498b93-910b-4d84-97b9-a49299bb2eef", "content-length": "667", "date": "Wed, 25 Sep 2024 17:32:51 GMT"} })
31132024-09-25T17:32:51.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31142024-09-25T17:32:51.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31152024-09-25T17:32:51.969ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31162024-09-25T17:32:51.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31172024-09-25T17:32:51.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31182024-09-25T17:32:51.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31192024-09-25T17:32:51.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31202024-09-25T17:32:51.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31212024-09-25T17:32:51.981ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 494.086166ms iteration = 16 status = {}
31222024-09-25T17:32:52.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 99be93eb-1e8d-4b97-829a-80efe60cd6b1 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31232024-09-25T17:32:52.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 99be93eb-1e8d-4b97-829a-80efe60cd6b1 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31242024-09-25T17:32:52.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 99be93eb-1e8d-4b97-829a-80efe60cd6b1 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31252024-09-25T17:32:53.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7951efef-4698-48d6-9581-e7d03895f4e7 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31262024-09-25T17:32:53.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7951efef-4698-48d6-9581-e7d03895f4e7 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31272024-09-25T17:32:53.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7951efef-4698-48d6-9581-e7d03895f4e7 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31282024-09-25T17:32:54.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 367d9bcb-d967-438f-9536-54572d3a7e48 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31292024-09-25T17:32:54.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 367d9bcb-d967-438f-9536-54572d3a7e48 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31302024-09-25T17:32:54.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 367d9bcb-d967-438f-9536-54572d3a7e48 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31312024-09-25T17:32:55.254ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:57595
31322024-09-25T17:32:55.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57595 req_id = 42a9b3d3-4aac-45d7-a95d-49bae70bab90 roles = RoleSet { roles: {} } uri = /metrics/producers
31332024-09-25T17:32:55.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57595 req_id = 42a9b3d3-4aac-45d7-a95d-49bae70bab90 resource = Database result = Ok(()) uri = /metrics/producers
31342024-09-25T17:32:55.273ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:62612
31352024-09-25T17:32:55.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e1610bd8-4756-487e-a978-f2c9fa644599 roles = RoleSet { roles: {} } uri = /metrics/producers
31362024-09-25T17:32:55.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e1610bd8-4756-487e-a978-f2c9fa644599 resource = Database result = Ok(()) uri = /metrics/producers
31372024-09-25T17:32:55.297ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
31382024-09-25T17:32:55.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57595 req_id = 42a9b3d3-4aac-45d7-a95d-49bae70bab90 roles = RoleSet { roles: {} } uri = /metrics/producers
31392024-09-25T17:32:55.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57595 req_id = 42a9b3d3-4aac-45d7-a95d-49bae70bab90 resource = Database result = Ok(()) uri = /metrics/producers
31402024-09-25T17:32:55.318ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
31412024-09-25T17:32:55.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e1610bd8-4756-487e-a978-f2c9fa644599 roles = RoleSet { roles: {} } uri = /metrics/producers
31422024-09-25T17:32:55.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e1610bd8-4756-487e-a978-f2c9fa644599 resource = Database result = Ok(()) uri = /metrics/producers
31432024-09-25T17:32:55.334ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
31442024-09-25T17:32:55.335ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "18b23c9a-c661-4089-af5c-20a017895ec3", "date": "Wed, 25 Sep 2024 17:32:55 GMT"} })
31452024-09-25T17:32:55.335ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = fd342822-d2f0-4be0-8561-e7a748d52087
31462024-09-25T17:32:55.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 82037 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:57595 req_id = 42a9b3d3-4aac-45d7-a95d-49bae70bab90 response_code = 201 uri = /metrics/producers
31472024-09-25T17:32:55.348ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
31482024-09-25T17:32:55.348ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ef2cb4a5-4592-4364-b3c3-5878f472440d", "date": "Wed, 25 Sep 2024 17:32:55 GMT"} })
31492024-09-25T17:32:55.348ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = ac63bbf5-a00d-448f-b231-397bfcb31b7d
31502024-09-25T17:32:55.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 76840 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62612 req_id = e1610bd8-4756-487e-a978-f2c9fa644599 response_code = 201 uri = /metrics/producers
31512024-09-25T17:32:55.386ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1295 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 450c3661-da27-4a74-aba9-5849ea791450 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
31522024-09-25T17:32:55.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = db350145-4105-4428-88af-5d7bcc978c23 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31532024-09-25T17:32:55.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = db350145-4105-4428-88af-5d7bcc978c23 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31542024-09-25T17:32:55.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = db350145-4105-4428-88af-5d7bcc978c23 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31552024-09-25T17:32:56.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ae5906b7-f98c-44b8-ab79-207f461ba103 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31562024-09-25T17:32:56.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ae5906b7-f98c-44b8-ab79-207f461ba103 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31572024-09-25T17:32:56.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ae5906b7-f98c-44b8-ab79-207f461ba103 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31582024-09-25T17:32:57.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f6869ba5-6df6-4071-a0c6-c12f11f3f1ea roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31592024-09-25T17:32:57.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f6869ba5-6df6-4071-a0c6-c12f11f3f1ea resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31602024-09-25T17:32:57.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f6869ba5-6df6-4071-a0c6-c12f11f3f1ea response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31612024-09-25T17:32:58.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a68335e7-5f07-45be-81a8-d128cfb674b9 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31622024-09-25T17:32:58.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a68335e7-5f07-45be-81a8-d128cfb674b9 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31632024-09-25T17:32:58.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a68335e7-5f07-45be-81a8-d128cfb674b9 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31642024-09-25T17:32:59.245ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:58331
31652024-09-25T17:32:59.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58331 req_id = 1f10cfb2-27e7-4c92-8815-984fbf2a74fb roles = RoleSet { roles: {} } uri = /metrics/producers
31662024-09-25T17:32:59.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58331 req_id = 1f10cfb2-27e7-4c92-8815-984fbf2a74fb resource = Database result = Ok(()) uri = /metrics/producers
31672024-09-25T17:32:59.279ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
31682024-09-25T17:32:59.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58331 req_id = 1f10cfb2-27e7-4c92-8815-984fbf2a74fb roles = RoleSet { roles: {} } uri = /metrics/producers
31692024-09-25T17:32:59.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58331 req_id = 1f10cfb2-27e7-4c92-8815-984fbf2a74fb resource = Database result = Ok(()) uri = /metrics/producers
31702024-09-25T17:32:59.313ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
31712024-09-25T17:32:59.313ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "06e687b9-a81a-4468-8123-96fab3539e07", "date": "Wed, 25 Sep 2024 17:32:59 GMT"} })
31722024-09-25T17:32:59.313ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = 4251ad8b-dbc2-403a-ad95-0a1062ebfb52
31732024-09-25T17:32:59.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 69316 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58331 req_id = 1f10cfb2-27e7-4c92-8815-984fbf2a74fb response_code = 201 uri = /metrics/producers
31742024-09-25T17:32:59.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2e35461f-0797-4280-8ac1-e09fc3bb0ec3 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31752024-09-25T17:32:59.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2e35461f-0797-4280-8ac1-e09fc3bb0ec3 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31762024-09-25T17:32:59.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2e35461f-0797-4280-8ac1-e09fc3bb0ec3 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31772024-09-25T17:33:00.769ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:60960
31782024-09-25T17:33:00.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60960 req_id = 1f87a3ae-5b16-4669-9fba-ae37b4a3f1e7 roles = RoleSet { roles: {} } uri = /metrics/producers
31792024-09-25T17:33:00.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60960 req_id = 1f87a3ae-5b16-4669-9fba-ae37b4a3f1e7 resource = Database result = Ok(()) uri = /metrics/producers
31802024-09-25T17:33:00.801ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
31812024-09-25T17:33:00.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60960 req_id = 1f87a3ae-5b16-4669-9fba-ae37b4a3f1e7 roles = RoleSet { roles: {} } uri = /metrics/producers
31822024-09-25T17:33:00.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60960 req_id = 1f87a3ae-5b16-4669-9fba-ae37b4a3f1e7 resource = Database result = Ok(()) uri = /metrics/producers
31832024-09-25T17:33:00.811ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
31842024-09-25T17:33:00.812ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "448f8a50-856d-459f-bdde-ef7b48804464", "date": "Wed, 25 Sep 2024 17:33:00 GMT"} })
31852024-09-25T17:33:00.812ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = a18a8a51-3215-4e6c-86bc-50d6d9f8b136
31862024-09-25T17:33:00.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 44601 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60960 req_id = 1f87a3ae-5b16-4669-9fba-ae37b4a3f1e7 response_code = 201 uri = /metrics/producers
31872024-09-25T17:33:00.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7a4ed483-f33e-43e5-a98f-56b431d693c8 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31882024-09-25T17:33:00.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7a4ed483-f33e-43e5-a98f-56b431d693c8 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31892024-09-25T17:33:00.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7a4ed483-f33e-43e5-a98f-56b431d693c8 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
31902024-09-25T17:33:01.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
31912024-09-25T17:33:01.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
31922024-09-25T17:33:01.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31932024-09-25T17:33:01.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31942024-09-25T17:33:01.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31952024-09-25T17:33:01.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31962024-09-25T17:33:01.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31972024-09-25T17:33:01.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31982024-09-25T17:33:01.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31992024-09-25T17:33:01.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32002024-09-25T17:33:01.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32012024-09-25T17:33:01.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32022024-09-25T17:33:01.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32032024-09-25T17:33:01.500ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
32042024-09-25T17:33:01.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32052024-09-25T17:33:01.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32062024-09-25T17:33:01.510ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
32072024-09-25T17:33:01.510ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.53851ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
32082024-09-25T17:33:01.521ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32092024-09-25T17:33:01.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32102024-09-25T17:33:01.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.670967ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32112024-09-25T17:33:01.635ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:62953
32122024-09-25T17:33:01.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62953 req_id = d865f5d2-3905-4d5e-b431-dd39e599a169 roles = RoleSet { roles: {} } uri = /metrics/producers
32132024-09-25T17:33:01.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62953 req_id = d865f5d2-3905-4d5e-b431-dd39e599a169 resource = Database result = Ok(()) uri = /metrics/producers
32142024-09-25T17:33:01.670ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
32152024-09-25T17:33:01.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62953 req_id = d865f5d2-3905-4d5e-b431-dd39e599a169 roles = RoleSet { roles: {} } uri = /metrics/producers
32162024-09-25T17:33:01.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62953 req_id = d865f5d2-3905-4d5e-b431-dd39e599a169 resource = Database result = Ok(()) uri = /metrics/producers
32172024-09-25T17:33:01.682ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
32182024-09-25T17:33:01.683ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "350496eb-dfd0-4e4b-aade-180354a42867", "date": "Wed, 25 Sep 2024 17:33:00 GMT"} })
32192024-09-25T17:33:01.683ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = f0d006a2-eb4a-4510-8a1c-6c144343343f
32202024-09-25T17:33:01.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 49190 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62953 req_id = d865f5d2-3905-4d5e-b431-dd39e599a169 response_code = 201 uri = /metrics/producers
32212024-09-25T17:33:01.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1f46ecee-0c05-4979-b007-185d294be74d roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32222024-09-25T17:33:01.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1f46ecee-0c05-4979-b007-185d294be74d resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32232024-09-25T17:33:01.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1f46ecee-0c05-4979-b007-185d294be74d response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32242024-09-25T17:33:02.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a2925297-bd88-42f8-b154-3685ab0c3d34 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32252024-09-25T17:33:02.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a2925297-bd88-42f8-b154-3685ab0c3d34 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32262024-09-25T17:33:02.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a2925297-bd88-42f8-b154-3685ab0c3d34 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32272024-09-25T17:33:03.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 974d4d4e-5ec2-4267-82b5-53c3a32f0fbf roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
32282024-09-25T17:33:03.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 974d4d4e-5ec2-4267-82b5-53c3a32f0fbf resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
32292024-09-25T17:33:03.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 974d4d4e-5ec2-4267-82b5-53c3a32f0fbf response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
32302024-09-25T17:33:03.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = bccabfe7-bd55-4434-9c5d-3644842783e9 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32312024-09-25T17:33:03.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = bccabfe7-bd55-4434-9c5d-3644842783e9 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32322024-09-25T17:33:03.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = bccabfe7-bd55-4434-9c5d-3644842783e9 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32332024-09-25T17:33:04.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f78bdba3-f7f9-44fe-be81-6089bee2822a roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32342024-09-25T17:33:04.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f78bdba3-f7f9-44fe-be81-6089bee2822a resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32352024-09-25T17:33:04.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f78bdba3-f7f9-44fe-be81-6089bee2822a response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32362024-09-25T17:33:05.388ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = ec585161-43d3-4022-862f-33f6be2748bc response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
32372024-09-25T17:33:06.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dd2e9630-7355-4bc2-8747-8081bb0bc8b2 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32382024-09-25T17:33:06.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dd2e9630-7355-4bc2-8747-8081bb0bc8b2 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32392024-09-25T17:33:06.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dd2e9630-7355-4bc2-8747-8081bb0bc8b2 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32402024-09-25T17:33:07.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f12bc770-08fb-4f50-b45a-54d8a427d572 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32412024-09-25T17:33:07.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f12bc770-08fb-4f50-b45a-54d8a427d572 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32422024-09-25T17:33:07.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2800 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f12bc770-08fb-4f50-b45a-54d8a427d572 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32432024-09-25T17:33:08.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 024a6208-52fb-4584-8e69-0f30e1639438 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32442024-09-25T17:33:08.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 024a6208-52fb-4584-8e69-0f30e1639438 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32452024-09-25T17:33:08.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 024a6208-52fb-4584-8e69-0f30e1639438 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32462024-09-25T17:33:09.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e9a2a988-c545-4d50-8217-720bb2b2bb2f roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32472024-09-25T17:33:09.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e9a2a988-c545-4d50-8217-720bb2b2bb2f resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32482024-09-25T17:33:09.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e9a2a988-c545-4d50-8217-720bb2b2bb2f response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32492024-09-25T17:33:10.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 041cd415-b832-4e96-b424-68e0456f70c9 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32502024-09-25T17:33:10.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 041cd415-b832-4e96-b424-68e0456f70c9 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32512024-09-25T17:33:10.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2512 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 041cd415-b832-4e96-b424-68e0456f70c9 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32522024-09-25T17:33:11.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9c64239c-7c47-478b-afde-5d21d8131e4c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32532024-09-25T17:33:11.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9c64239c-7c47-478b-afde-5d21d8131e4c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32542024-09-25T17:33:11.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9c64239c-7c47-478b-afde-5d21d8131e4c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32552024-09-25T17:33:11.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
32562024-09-25T17:33:11.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32572024-09-25T17:33:11.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
32582024-09-25T17:33:11.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32592024-09-25T17:33:11.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32602024-09-25T17:33:11.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32612024-09-25T17:33:11.514ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32622024-09-25T17:33:11.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32632024-09-25T17:33:11.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32642024-09-25T17:33:11.516ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.613852ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32652024-09-25T17:33:11.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32662024-09-25T17:33:11.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32672024-09-25T17:33:11.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32682024-09-25T17:33:11.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32692024-09-25T17:33:11.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32702024-09-25T17:33:11.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32712024-09-25T17:33:11.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
32722024-09-25T17:33:11.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32732024-09-25T17:33:11.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32742024-09-25T17:33:11.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
32752024-09-25T17:33:11.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.65551ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
32762024-09-25T17:33:12.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 791f9c95-3d04-442f-b809-46ee95b0c0c9 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32772024-09-25T17:33:12.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 791f9c95-3d04-442f-b809-46ee95b0c0c9 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32782024-09-25T17:33:12.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 791f9c95-3d04-442f-b809-46ee95b0c0c9 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32792024-09-25T17:33:13.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 69ea0d70-a3a9-4864-9d71-36eeb721b090 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32802024-09-25T17:33:13.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 69ea0d70-a3a9-4864-9d71-36eeb721b090 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32812024-09-25T17:33:13.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 69ea0d70-a3a9-4864-9d71-36eeb721b090 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32822024-09-25T17:33:14.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c924c41d-c397-4967-bf08-3279f68affce roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32832024-09-25T17:33:14.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c924c41d-c397-4967-bf08-3279f68affce resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32842024-09-25T17:33:14.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c924c41d-c397-4967-bf08-3279f68affce response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32852024-09-25T17:33:15.082ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:52009
32862024-09-25T17:33:15.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52009 req_id = 4485da08-fabd-4ada-97c5-f274152e1188 roles = RoleSet { roles: {} } uri = /metrics/producers
32872024-09-25T17:33:15.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52009 req_id = 4485da08-fabd-4ada-97c5-f274152e1188 resource = Database result = Ok(()) uri = /metrics/producers
32882024-09-25T17:33:15.115ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
32892024-09-25T17:33:15.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52009 req_id = 4485da08-fabd-4ada-97c5-f274152e1188 roles = RoleSet { roles: {} } uri = /metrics/producers
32902024-09-25T17:33:15.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52009 req_id = 4485da08-fabd-4ada-97c5-f274152e1188 resource = Database result = Ok(()) uri = /metrics/producers
32912024-09-25T17:33:15.157ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
32922024-09-25T17:33:15.158ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d234df49-c861-44c3-89fa-b95fb9e528b2", "date": "Wed, 25 Sep 2024 17:33:15 GMT"} })
32932024-09-25T17:33:15.158ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = c811776d-391a-4536-8874-314f94386d41
32942024-09-25T17:33:15.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 77016 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52009 req_id = 4485da08-fabd-4ada-97c5-f274152e1188 response_code = 201 uri = /metrics/producers
32952024-09-25T17:33:15.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7da02eda-5180-496b-9ca4-9da4f1051823 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32962024-09-25T17:33:15.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7da02eda-5180-496b-9ca4-9da4f1051823 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32972024-09-25T17:33:15.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7da02eda-5180-496b-9ca4-9da4f1051823 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
32982024-09-25T17:33:15.386ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1381 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 866bf584-4fa9-47e3-9f28-b346e3203c6f response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
32992024-09-25T17:33:15.389ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
33002024-09-25T17:33:15.389ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
33012024-09-25T17:33:15.419ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
33022024-09-25T17:33:15.419ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:50176
33032024-09-25T17:33:15.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50176 req_id = 33ad364f-32cf-4192-ab97-fe720615af6c roles = RoleSet { roles: {} } uri = /metrics/producers
33042024-09-25T17:33:15.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50176 req_id = 33ad364f-32cf-4192-ab97-fe720615af6c resource = Database result = Ok(()) uri = /metrics/producers
33052024-09-25T17:33:15.452ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7
33062024-09-25T17:33:15.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50176 req_id = 33ad364f-32cf-4192-ab97-fe720615af6c roles = RoleSet { roles: {} } uri = /metrics/producers
33072024-09-25T17:33:15.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50176 req_id = 33ad364f-32cf-4192-ab97-fe720615af6c resource = Database result = Ok(()) uri = /metrics/producers
33082024-09-25T17:33:15.461ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 uri = http://[fd00:1122:3344:101::d]:12223/producers
33092024-09-25T17:33:15.461ZDEBGnexus: client response oximeter-collector = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2c1c9841-2b4d-4211-ba57-8e849a5f86e0", "date": "Wed, 25 Sep 2024 17:33:15 GMT"} })
33102024-09-25T17:33:15.461ZINFOnexus: assigned collector to new producer collector_id = 59f5203c-436e-41c1-82ad-d4ecd34c73e7 file = nexus/src/app/oximeter.rs:125 producer_id = 2fc249d5-9788-4a35-ad94-1440f36e8698
33112024-09-25T17:33:15.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42939 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:50176 req_id = 33ad364f-32cf-4192-ab97-fe720615af6c response_code = 201 uri = /metrics/producers
33122024-09-25T17:33:15.462ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::c)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "33ad364f-32cf-4192-ab97-fe720615af6c", "content-length": "41", "date": "Wed, 25 Sep 2024 17:33:15 GMT"} })
33132024-09-25T17:33:15.463ZDEBGnexus (producer-registration-task): registered with nexus successfully
33142024-09-25T17:33:15.463ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
33152024-09-25T17:33:16.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 24fd93ea-0d4b-4d7d-8add-f9ce717f0140 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33162024-09-25T17:33:16.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 24fd93ea-0d4b-4d7d-8add-f9ce717f0140 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33172024-09-25T17:33:16.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 24fd93ea-0d4b-4d7d-8add-f9ce717f0140 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33182024-09-25T17:33:17.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8deee0df-3170-42b1-b0f5-c4bdad54866e roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33192024-09-25T17:33:17.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8deee0df-3170-42b1-b0f5-c4bdad54866e resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33202024-09-25T17:33:17.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8deee0df-3170-42b1-b0f5-c4bdad54866e response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33212024-09-25T17:33:18.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a544bfc7-5411-48e8-9dec-991c8a82bda0 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33222024-09-25T17:33:18.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a544bfc7-5411-48e8-9dec-991c8a82bda0 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33232024-09-25T17:33:18.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2226 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a544bfc7-5411-48e8-9dec-991c8a82bda0 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33242024-09-25T17:33:19.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 08a393ce-2424-4d09-a7bc-15de7b91e216 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33252024-09-25T17:33:19.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 08a393ce-2424-4d09-a7bc-15de7b91e216 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33262024-09-25T17:33:19.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 08a393ce-2424-4d09-a7bc-15de7b91e216 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33272024-09-25T17:33:20.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2b3c994c-0169-41e1-86b0-b0bce91f52e7 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33282024-09-25T17:33:20.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2b3c994c-0169-41e1-86b0-b0bce91f52e7 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33292024-09-25T17:33:20.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2b3c994c-0169-41e1-86b0-b0bce91f52e7 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33302024-09-25T17:33:21.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c72c4a15-a8a8-4428-b2c2-cbd78cd7f6e5 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33312024-09-25T17:33:21.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c72c4a15-a8a8-4428-b2c2-cbd78cd7f6e5 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33322024-09-25T17:33:21.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2361 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c72c4a15-a8a8-4428-b2c2-cbd78cd7f6e5 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
33332024-09-25T17:33:21.487ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
33342024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
33352024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33362024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
33372024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
33382024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33392024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33402024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
33412024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33422024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
33432024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
33442024-09-25T17:33:21.488ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-25 17:23:21.488041844 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
33452024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
33462024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
33472024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
33482024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33492024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33502024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
33512024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
33522024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33532024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
33542024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
33552024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
33562024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33572024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33582024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
33592024-09-25T17:33:21.488ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
33602024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
33612024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33622024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33632024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33642024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
33652024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
33662024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33672024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33682024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
33692024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33702024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
33712024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33722024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
33732024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33742024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
33752024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
33762024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
33772024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
33782024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33792024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
33802024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
33812024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33822024-09-25T17:33:21.488ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa
33832024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.24\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa"}
33842024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
33852024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
33862024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33872024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
33882024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
33892024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
33902024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33912024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
33922024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
33932024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33942024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33952024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33962024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33972024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33982024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33992024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34002024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
34012024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34022024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34032024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
34042024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34052024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34062024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34072024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
34082024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34092024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34102024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34112024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
34122024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34132024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34142024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34152024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
34162024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34172024-09-25T17:33:21.488ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae9bf3cd-ff12-421b-b5a2-d52b18bde4b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be8cd1d4-baa8-48cc-872f-69bc5c2df30c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be8cd1d4-baa8-48cc-872f-69bc5c2df30c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2729, tv_nsec: 604423405 } })
34182024-09-25T17:33:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
34192024-09-25T17:33:21.488ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("11f53a30-9163-413a-8f7f-4bf206fb8176.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("929fdd8e-9f93-4e52-8d3d-ae706bb7a130.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ddd5d4f4-1113-49a5-bb63-a018bec3753e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ddd5d4f4-1113-49a5-bb63-a018bec3753e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2729, tv_nsec: 604458016 } })
34202024-09-25T17:33:21.490ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
34212024-09-25T17:33:21.490ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.023068ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
34222024-09-25T17:33:21.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34232024-09-25T17:33:21.491ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34242024-09-25T17:33:21.491ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
34252024-09-25T17:33:21.491ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.123278ms iteration = 10 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
34262024-09-25T17:33:21.491ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.296881ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
34272024-09-25T17:33:21.491ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34282024-09-25T17:33:21.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.406081ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
34292024-09-25T17:33:21.492ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34302024-09-25T17:33:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34312024-09-25T17:33:21.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34322024-09-25T17:33:21.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34332024-09-25T17:33:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34342024-09-25T17:33:21.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34352024-09-25T17:33:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34362024-09-25T17:33:21.495ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34372024-09-25T17:33:21.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34382024-09-25T17:33:21.495ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34392024-09-25T17:33:21.495ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34402024-09-25T17:33:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34412024-09-25T17:33:21.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34422024-09-25T17:33:21.497ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-25 17:23:21.488041844 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34432024-09-25T17:33:21.497ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.909544ms iteration = 9 status = {"expiration":"2024-09-25T17:23:21.488041844Z","pruned":[]}
34442024-09-25T17:33:21.498ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34452024-09-25T17:33:21.498ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34462024-09-25T17:33:21.498ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34472024-09-25T17:33:21.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34482024-09-25T17:33:21.501ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34492024-09-25T17:33:21.501ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34502024-09-25T17:33:21.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34512024-09-25T17:33:21.502ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2729, tv_nsec: 617929246 } })
34522024-09-25T17:33:21.502ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.287155ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
34532024-09-25T17:33:21.502ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
34542024-09-25T17:33:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34552024-09-25T17:33:21.504ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34562024-09-25T17:33:21.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34572024-09-25T17:33:21.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34582024-09-25T17:33:21.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34592024-09-25T17:33:21.507ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2729, tv_nsec: 622603963 } })
34602024-09-25T17:33:21.512ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
34612024-09-25T17:33:21.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34622024-09-25T17:33:21.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34632024-09-25T17:33:21.515ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2729, tv_nsec: 630709423 } })
34642024-09-25T17:33:21.516ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34652024-09-25T17:33:21.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34662024-09-25T17:33:21.516ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
34672024-09-25T17:33:21.517ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34682024-09-25T17:33:21.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34692024-09-25T17:33:21.518ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34702024-09-25T17:33:21.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34712024-09-25T17:33:21.522ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34722024-09-25T17:33:21.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34732024-09-25T17:33:21.525ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34742024-09-25T17:33:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
34752024-09-25T17:33:21.530ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34762024-09-25T17:33:21.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34772024-09-25T17:33:21.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34782024-09-25T17:33:21.535ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34792024-09-25T17:33:21.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34802024-09-25T17:33:21.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34812024-09-25T17:33:21.548ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34822024-09-25T17:33:21.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34832024-09-25T17:33:21.551ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.303866ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
34842024-09-25T17:33:21.551ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34852024-09-25T17:33:21.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34862024-09-25T17:33:21.553ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34872024-09-25T17:33:21.553ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34882024-09-25T17:33:21.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34892024-09-25T17:33:21.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34902024-09-25T17:33:21.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34912024-09-25T17:33:21.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34922024-09-25T17:33:21.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34932024-09-25T17:33:21.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34942024-09-25T17:33:21.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34952024-09-25T17:33:21.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34962024-09-25T17:33:21.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34972024-09-25T17:33:21.561ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34982024-09-25T17:33:21.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34992024-09-25T17:33:21.565ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
35002024-09-25T17:33:21.565ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
35012024-09-25T17:33:21.565ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.136613ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
35022024-09-25T17:33:21.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
35032024-09-25T17:33:21.565ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
35042024-09-25T17:33:21.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
35052024-09-25T17:33:21.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35062024-09-25T17:33:21.567ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35072024-09-25T17:33:21.567ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35082024-09-25T17:33:21.567ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35092024-09-25T17:33:21.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35102024-09-25T17:33:21.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35112024-09-25T17:33:21.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35122024-09-25T17:33:21.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35132024-09-25T17:33:21.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35142024-09-25T17:33:21.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35152024-09-25T17:33:21.577ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35162024-09-25T17:33:21.577ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.875421ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35172024-09-25T17:33:21.596ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35182024-09-25T17:33:21.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35192024-09-25T17:33:21.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35202024-09-25T17:33:21.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35212024-09-25T17:33:21.601ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35222024-09-25T17:33:21.603ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:67 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
35232024-09-25T17:33:21.603ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 115.739809ms iteration = 9 status = {"changed_state":[],"instances_found":0,"instances_reincarnated":[],"query_error":null,"restart_errors":{}}
35242024-09-25T17:33:21.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f0d006a2-eb4a-4510-8a1c-6c144343343f, lookup_type: ById(f0d006a2-eb4a-4510-8a1c-6c144343343f) } result = Ok(())
35252024-09-25T17:33:21.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35262024-09-25T17:33:21.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35272024-09-25T17:33:21.608ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 119.870837ms iteration = 17 status = 0
35282024-09-25T17:33:21.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35292024-09-25T17:33:21.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 124.315469ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
35302024-09-25T17:33:21.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35312024-09-25T17:33:21.615ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 127.008779ms iteration = 20 status = {"physical_disks_added":0}
35322024-09-25T17:33:21.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35332024-09-25T17:33:21.616ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35342024-09-25T17:33:21.617ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35352024-09-25T17:33:21.617ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35362024-09-25T17:33:21.617ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35372024-09-25T17:33:21.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35382024-09-25T17:33:21.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35392024-09-25T17:33:21.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 130.984503ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
35402024-09-25T17:33:21.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35412024-09-25T17:33:21.619ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
35422024-09-25T17:33:21.619ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
35432024-09-25T17:33:21.619ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
35442024-09-25T17:33:21.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35452024-09-25T17:33:21.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35462024-09-25T17:33:21.619ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35472024-09-25T17:33:21.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35482024-09-25T17:33:21.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35492024-09-25T17:33:21.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
35502024-09-25T17:33:21.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35512024-09-25T17:33:21.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35522024-09-25T17:33:21.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35532024-09-25T17:33:21.623ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35542024-09-25T17:33:21.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35552024-09-25T17:33:21.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35562024-09-25T17:33:21.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35572024-09-25T17:33:21.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35582024-09-25T17:33:21.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 137.386232ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35592024-09-25T17:33:21.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35602024-09-25T17:33:21.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35612024-09-25T17:33:21.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35622024-09-25T17:33:21.631ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
35632024-09-25T17:33:21.631ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
35642024-09-25T17:33:21.631ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 143.562386ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35652024-09-25T17:33:21.637ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35662024-09-25T17:33:21.637ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35672024-09-25T17:33:21.637ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.915156ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35682024-09-25T17:33:21.637ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35692024-09-25T17:33:21.650ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
35702024-09-25T17:33:21.650ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 162.455818ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
35712024-09-25T17:33:21.666ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
35722024-09-25T17:33:21.674ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35732024-09-25T17:33:21.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35742024-09-25T17:33:21.678ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-25T17:25:19.066517Z, time_modified: 2024-09-25T17:25:19.066517Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, db_silo: Silo { identity: SiloIdentity { id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-25T17:25:43.663371Z, time_modified: 2024-09-25T17:25:43.663371Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, db_silo: Silo { identity: SiloIdentity { id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-25T17:25:43.663371Z, time_modified: 2024-09-25T17:25:43.663371Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c" }] }) }
35752024-09-25T17:33:21.678ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 190.539599ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dcfeb960-7abf-4e10-b28d-9fa9c33e4d51","tls_certs":["4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c"]}},"default_endpoint":{"silo_id":"dcfeb960-7abf-4e10-b28d-9fa9c33e4d51","tls_certs":["4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
35762024-09-25T17:33:21.692ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
35772024-09-25T17:33:21.692ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9011eb2e-f736-49fd-9148-03ee7daa981e dns_zone_name = oxide.test found_so_far = 0 version = 2
35782024-09-25T17:33:21.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35792024-09-25T17:33:21.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35802024-09-25T17:33:21.694ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
35812024-09-25T17:33:21.694ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4983f296-eda5-4ab7-98fb-1acc9a8bf292 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
35822024-09-25T17:33:21.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35832024-09-25T17:33:21.694ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 206.346672ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
35842024-09-25T17:33:21.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35852024-09-25T17:33:21.718ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 zone_address = fd00:1122:3344:101::2
35862024-09-25T17:33:21.718ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35872024-09-25T17:33:21.718ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "76d0f207-da81-41a7-9080-16e3fd5f98d6", "content-length": "26", "date": "Wed, 25 Sep 2024 17:33:20 GMT"} })
35882024-09-25T17:33:21.718ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35892024-09-25T17:33:21.720ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
35902024-09-25T17:33:21.742ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
35912024-09-25T17:33:21.742ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35922024-09-25T17:33:21.742ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "acae1438-99f1-4924-98ba-777f9cdc19c9", "content-length": "26", "date": "Wed, 25 Sep 2024 17:33:20 GMT"} })
35932024-09-25T17:33:21.742ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35942024-09-25T17:33:21.744ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35952024-09-25T17:33:21.795ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
35962024-09-25T17:33:21.795ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35972024-09-25T17:33:21.795ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c20cce19-dba8-4378-8b1e-e6a54c28bd81", "content-length": "26", "date": "Wed, 25 Sep 2024 17:33:20 GMT"} })
35982024-09-25T17:33:21.795ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35992024-09-25T17:33:21.797ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36002024-09-25T17:33:21.853ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
36012024-09-25T17:33:21.908ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
36022024-09-25T17:33:21.908ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ef07acc6-b19d-4b4f-8044-92066ae921c8", "date": "Wed, 25 Sep 2024 17:33:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36032024-09-25T17:33:21.908ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36042024-09-25T17:33:21.910ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0fb19978-9895-4e44-b46b-9d3b0dce3772", "date": "Wed, 25 Sep 2024 17:33:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36052024-09-25T17:33:21.910ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36062024-09-25T17:33:21.912ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
36072024-09-25T17:33:21.912ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 423.78905ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
36082024-09-25T17:33:21.946ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
36092024-09-25T17:33:21.946ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5912c5eb-cd08-42aa-bbbd-cd8b06614d58", "content-length": "2", "date": "Wed, 25 Sep 2024 17:33:21 GMT"} })
36102024-09-25T17:33:21.946ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36112024-09-25T17:33:21.947ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36122024-09-25T17:33:21.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36132024-09-25T17:33:21.947ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0d881c97-5ad6-4fd2-aaad-c48c7c31f2eb", "content-length": "372", "date": "Wed, 25 Sep 2024 17:33:21 GMT"} })
36142024-09-25T17:33:21.947ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36152024-09-25T17:33:21.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36162024-09-25T17:33:21.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36172024-09-25T17:33:21.950ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 462.250585ms iteration = 17 status = null
36182024-09-25T17:33:21.951ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36192024-09-25T17:33:21.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36202024-09-25T17:33:21.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
36212024-09-25T17:33:21.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36222024-09-25T17:33:21.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36232024-09-25T17:33:21.955ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9011eb2e-f736-49fd-9148-03ee7daa981e dns_zone_name = oxide.test found_so_far = 1 version = 2
36242024-09-25T17:33:21.955ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
36252024-09-25T17:33:21.955ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-25 17:25:43.713253 UTC dns_group = external generation = 2
36262024-09-25T17:33:21.955ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 466.790829ms iteration = 10 status = {"generation":2}
36272024-09-25T17:33:21.955ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36282024-09-25T17:33:21.955ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36292024-09-25T17:33:21.958ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36302024-09-25T17:33:21.970ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
36312024-09-25T17:33:21.970ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 482.517581ms iteration = 17 status = {}
36322024-09-25T17:33:21.970ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "45b0a7f5-52a6-42d9-b487-f8024fb3ba3d", "date": "Wed, 25 Sep 2024 17:33:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36332024-09-25T17:33:21.970ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36342024-09-25T17:33:21.972ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f6c92280-c13b-4a46-8586-e4e0579f0e01", "date": "Wed, 25 Sep 2024 17:33:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36352024-09-25T17:33:21.972ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36362024-09-25T17:33:21.974ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d88f8f1f-9a59-4a89-ac0a-3250a43473cb", "date": "Wed, 25 Sep 2024 17:33:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36372024-09-25T17:33:21.974ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36382024-09-25T17:33:21.976ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
36392024-09-25T17:33:21.976ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 488.012644ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
36402024-09-25T17:33:21.980ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36412024-09-25T17:33:21.983ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
36422024-09-25T17:33:21.983ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36432024-09-25T17:33:21.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36442024-09-25T17:33:21.986ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4983f296-eda5-4ab7-98fb-1acc9a8bf292 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
36452024-09-25T17:33:21.986ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
36462024-09-25T17:33:21.986ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-25 17:25:42.974009 UTC dns_group = internal generation = 1
36472024-09-25T17:33:21.986ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 497.995739ms iteration = 10 status = {"generation":1}
36482024-09-25T17:33:22.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36492024-09-25T17:33:22.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36502024-09-25T17:33:22.029ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 6e5d68bf-01bc-412c-9915-3ad6fd435156, rack_id: 5c1bad99-30b8-419d-9695-a982a6249225, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5d8104c-5830-4cb9-9490-d372d8c75371) } rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
36512024-09-25T17:33:22.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36522024-09-25T17:33:22.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36532024-09-25T17:33:22.040ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36542024-09-25T17:33:22.040ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1ff3b629-24a3-44f1-8596-78b7f833259c", "content-length": "121", "date": "Wed, 25 Sep 2024 17:33:21 GMT"} })
36552024-09-25T17:33:22.040ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
36562024-09-25T17:33:22.040ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5d8104c-5830-4cb9-9490-d372d8c75371
36572024-09-25T17:33:22.041ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36582024-09-25T17:33:22.041ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36592024-09-25T17:33:22.041ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
36602024-09-25T17:33:22.041ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
36612024-09-25T17:33:22.041ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
36622024-09-25T17:33:22.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36632024-09-25T17:33:22.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36642024-09-25T17:33:22.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36652024-09-25T17:33:22.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36662024-09-25T17:33:22.043ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36672024-09-25T17:33:22.043ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7d83e04e-59a1-4f03-b000-6b44fe1a512b", "content-length": "2", "date": "Wed, 25 Sep 2024 17:33:21 GMT"} })
36682024-09-25T17:33:22.043ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36692024-09-25T17:33:22.044ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7bbf74b7-0f1e-48a8-aaba-ee2423db1612", "content-length": "52", "date": "Wed, 25 Sep 2024 17:33:21 GMT"} })
36702024-09-25T17:33:22.044ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
36712024-09-25T17:33:22.044ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36722024-09-25T17:33:22.061ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "20efa94c-b65e-45cc-9ecb-d2c7e9dd8714", "date": "Wed, 25 Sep 2024 17:33:21 GMT"} })
36732024-09-25T17:33:22.063ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 575.101931ms iteration = 19 status = {}
36742024-09-25T17:33:22.071ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36752024-09-25T17:33:22.072ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36762024-09-25T17:33:22.072ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36772024-09-25T17:33:22.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36782024-09-25T17:33:22.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36792024-09-25T17:33:22.076ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36802024-09-25T17:33:22.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36812024-09-25T17:33:22.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36822024-09-25T17:33:22.109ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36832024-09-25T17:33:22.111ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "02e958b6-825f-46ca-a407-f2701b8d9eaa", "content-length": "691", "date": "Wed, 25 Sep 2024 17:33:22 GMT"} })
36842024-09-25T17:33:22.111ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
36852024-09-25T17:33:22.111ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
36862024-09-25T17:33:22.111ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
36872024-09-25T17:33:22.113ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 624.873286ms iteration = 18 status = {}
36882024-09-25T17:33:22.235ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "eef74f22-2248-40e7-b5cb-58febc48fde2", "date": "Wed, 25 Sep 2024 17:33:22 GMT"} })
36892024-09-25T17:33:22.235ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch = Switch0
36902024-09-25T17:33:22.235ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36912024-09-25T17:33:22.236ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bb023234-675d-4ad5-8ba5-d4c14549dfd6", "content-length": "667", "date": "Wed, 25 Sep 2024 17:33:22 GMT"} })
36922024-09-25T17:33:22.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36932024-09-25T17:33:22.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36942024-09-25T17:33:22.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36952024-09-25T17:33:22.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36962024-09-25T17:33:22.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36972024-09-25T17:33:22.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36982024-09-25T17:33:22.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36992024-09-25T17:33:22.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37002024-09-25T17:33:22.252ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 764.750124ms iteration = 17 status = {}
37012024-09-25T17:33:22.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 01307a2f-f8aa-43e0-a2a0-cbfbbaa5be94 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37022024-09-25T17:33:22.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 01307a2f-f8aa-43e0-a2a0-cbfbbaa5be94 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37032024-09-25T17:33:22.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 01307a2f-f8aa-43e0-a2a0-cbfbbaa5be94 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37042024-09-25T17:33:23.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dc8cb0a5-7eef-4d2e-9c31-1a4313c15dac roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37052024-09-25T17:33:23.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dc8cb0a5-7eef-4d2e-9c31-1a4313c15dac resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37062024-09-25T17:33:23.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dc8cb0a5-7eef-4d2e-9c31-1a4313c15dac response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37072024-09-25T17:33:24.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a3eaba0e-e0c5-4384-8f93-386c1b1c9fce roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37082024-09-25T17:33:24.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a3eaba0e-e0c5-4384-8f93-386c1b1c9fce resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37092024-09-25T17:33:24.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a3eaba0e-e0c5-4384-8f93-386c1b1c9fce response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37102024-09-25T17:33:25.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d0d27b41-ca47-4e32-88d8-63fce314175d roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37112024-09-25T17:33:25.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d0d27b41-ca47-4e32-88d8-63fce314175d resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37122024-09-25T17:33:25.425ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2710 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d0d27b41-ca47-4e32-88d8-63fce314175d response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37132024-09-25T17:33:25.463ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1444 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 34502334-3171-48cf-9c2e-0eb5435d09d9 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
37142024-09-25T17:33:26.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3ae99427-bf59-4995-96f9-63ada3eeae7f roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37152024-09-25T17:33:26.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3ae99427-bf59-4995-96f9-63ada3eeae7f resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37162024-09-25T17:33:26.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3ae99427-bf59-4995-96f9-63ada3eeae7f response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37172024-09-25T17:33:27.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f8b46d54-8fc4-4f16-841a-ad04c689f3c8 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37182024-09-25T17:33:27.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f8b46d54-8fc4-4f16-841a-ad04c689f3c8 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37192024-09-25T17:33:27.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f8b46d54-8fc4-4f16-841a-ad04c689f3c8 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37202024-09-25T17:33:28.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7da67a42-b733-4aa9-9f9c-85e559bb63d8 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37212024-09-25T17:33:28.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7da67a42-b733-4aa9-9f9c-85e559bb63d8 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37222024-09-25T17:33:28.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7da67a42-b733-4aa9-9f9c-85e559bb63d8 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37232024-09-25T17:33:29.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 25a520cc-9dbb-453f-88d2-a3596f3ebbec roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37242024-09-25T17:33:29.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 25a520cc-9dbb-453f-88d2-a3596f3ebbec resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37252024-09-25T17:33:29.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 25a520cc-9dbb-453f-88d2-a3596f3ebbec response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37262024-09-25T17:33:30.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 68a9089a-6ce7-493d-b63e-5f10c354b843 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37272024-09-25T17:33:30.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 68a9089a-6ce7-493d-b63e-5f10c354b843 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37282024-09-25T17:33:30.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 68a9089a-6ce7-493d-b63e-5f10c354b843 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37292024-09-25T17:33:31.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
37302024-09-25T17:33:31.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37312024-09-25T17:33:31.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
37322024-09-25T17:33:31.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37332024-09-25T17:33:31.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37342024-09-25T17:33:31.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37352024-09-25T17:33:31.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37362024-09-25T17:33:31.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37372024-09-25T17:33:31.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37382024-09-25T17:33:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37392024-09-25T17:33:31.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37402024-09-25T17:33:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37412024-09-25T17:33:31.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37422024-09-25T17:33:31.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37432024-09-25T17:33:31.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37442024-09-25T17:33:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
37452024-09-25T17:33:31.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37462024-09-25T17:33:31.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37472024-09-25T17:33:31.507ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
37482024-09-25T17:33:31.507ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.518242ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
37492024-09-25T17:33:31.517ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.723754ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37502024-09-25T17:33:31.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 92d05a9c-8091-492a-bcfd-64d48f77b5f6 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37512024-09-25T17:33:31.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 92d05a9c-8091-492a-bcfd-64d48f77b5f6 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37522024-09-25T17:33:31.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 92d05a9c-8091-492a-bcfd-64d48f77b5f6 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37532024-09-25T17:33:32.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8d20b7d6-8c2a-465e-b004-a852f3093e56 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37542024-09-25T17:33:32.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8d20b7d6-8c2a-465e-b004-a852f3093e56 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37552024-09-25T17:33:32.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8d20b7d6-8c2a-465e-b004-a852f3093e56 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37562024-09-25T17:33:33.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 20b886fa-e876-4a3c-a7ee-1d133e81f95a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
37572024-09-25T17:33:33.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 20b886fa-e876-4a3c-a7ee-1d133e81f95a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
37582024-09-25T17:33:33.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 20b886fa-e876-4a3c-a7ee-1d133e81f95a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
37592024-09-25T17:33:33.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c8d25754-1702-4943-a55f-dd1dff935950 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37602024-09-25T17:33:33.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c8d25754-1702-4943-a55f-dd1dff935950 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37612024-09-25T17:33:33.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2677 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c8d25754-1702-4943-a55f-dd1dff935950 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37622024-09-25T17:33:34.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = eeae58c9-d710-4d2e-bb68-c746a79dcf1a roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37632024-09-25T17:33:34.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = eeae58c9-d710-4d2e-bb68-c746a79dcf1a resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37642024-09-25T17:33:34.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = eeae58c9-d710-4d2e-bb68-c746a79dcf1a response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37652024-09-25T17:33:35.464ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1392 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = c6230b5f-b333-482b-ae31-7ee61237f5a9 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
37662024-09-25T17:33:35.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ac46b8c3-79ea-4d4d-8790-bcbf519232b5 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37672024-09-25T17:33:35.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ac46b8c3-79ea-4d4d-8790-bcbf519232b5 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37682024-09-25T17:33:35.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ac46b8c3-79ea-4d4d-8790-bcbf519232b5 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37692024-09-25T17:33:36.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e61bb181-949d-4cc8-b3ec-3f946b94252b roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37702024-09-25T17:33:36.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e61bb181-949d-4cc8-b3ec-3f946b94252b resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37712024-09-25T17:33:36.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e61bb181-949d-4cc8-b3ec-3f946b94252b response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37722024-09-25T17:33:37.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = be6b0cf2-d998-41b4-8de7-f27186b4a5cc roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37732024-09-25T17:33:37.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = be6b0cf2-d998-41b4-8de7-f27186b4a5cc resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37742024-09-25T17:33:37.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = be6b0cf2-d998-41b4-8de7-f27186b4a5cc response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37752024-09-25T17:33:38.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 64d94f5d-7696-487f-b254-1ca0955c9275 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37762024-09-25T17:33:38.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 64d94f5d-7696-487f-b254-1ca0955c9275 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37772024-09-25T17:33:38.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2689 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 64d94f5d-7696-487f-b254-1ca0955c9275 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37782024-09-25T17:33:39.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a812680f-2eab-4acd-a82b-1d643fded77c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37792024-09-25T17:33:39.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a812680f-2eab-4acd-a82b-1d643fded77c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37802024-09-25T17:33:39.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a812680f-2eab-4acd-a82b-1d643fded77c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37812024-09-25T17:33:40.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2d1c479c-022c-4706-9518-b8b8e80f6490 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37822024-09-25T17:33:40.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2d1c479c-022c-4706-9518-b8b8e80f6490 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37832024-09-25T17:33:40.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2d1c479c-022c-4706-9518-b8b8e80f6490 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
37842024-09-25T17:33:41.487ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
37852024-09-25T17:33:41.487ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37862024-09-25T17:33:41.487ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
37872024-09-25T17:33:41.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37882024-09-25T17:33:41.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37892024-09-25T17:33:41.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37902024-09-25T17:33:41.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37912024-09-25T17:33:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37922024-09-25T17:33:41.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37932024-09-25T17:33:41.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37942024-09-25T17:33:41.494ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37952024-09-25T17:33:41.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37962024-09-25T17:33:41.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37972024-09-25T17:33:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
37982024-09-25T17:33:41.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37992024-09-25T17:33:41.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38002024-09-25T17:33:41.507ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
38012024-09-25T17:33:41.507ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.107164ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
38022024-09-25T17:33:41.515ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38032024-09-25T17:33:41.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38042024-09-25T17:33:41.516ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.933337ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38052024-09-25T17:33:41.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9ced8c06-c70f-47f7-8e9d-33da1b15f43d roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38062024-09-25T17:33:41.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9ced8c06-c70f-47f7-8e9d-33da1b15f43d resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38072024-09-25T17:33:41.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9ced8c06-c70f-47f7-8e9d-33da1b15f43d response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38082024-09-25T17:33:42.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e78ec254-2625-45ca-8058-bc7dfb6c3bfa roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38092024-09-25T17:33:42.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e78ec254-2625-45ca-8058-bc7dfb6c3bfa resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38102024-09-25T17:33:42.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e78ec254-2625-45ca-8058-bc7dfb6c3bfa response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38112024-09-25T17:33:43.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 54da20f8-d2d3-4437-8a45-a9b226711495 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38122024-09-25T17:33:43.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 54da20f8-d2d3-4437-8a45-a9b226711495 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38132024-09-25T17:33:43.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 54da20f8-d2d3-4437-8a45-a9b226711495 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38142024-09-25T17:33:44.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2b66c4ec-f222-4876-ab05-2980791fe114 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38152024-09-25T17:33:44.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2b66c4ec-f222-4876-ab05-2980791fe114 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38162024-09-25T17:33:44.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2b66c4ec-f222-4876-ab05-2980791fe114 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38172024-09-25T17:33:45.464ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1501 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 621beac5-1aac-4087-a89c-6596f59097cc response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
38182024-09-25T17:33:45.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ff8d702e-9137-4dad-85e3-500454816d9e roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38192024-09-25T17:33:45.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ff8d702e-9137-4dad-85e3-500454816d9e resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38202024-09-25T17:33:45.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = ff8d702e-9137-4dad-85e3-500454816d9e response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38212024-09-25T17:33:46.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 49744c5b-d2fc-494b-8eb4-0fe0622fc6ea roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38222024-09-25T17:33:46.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 49744c5b-d2fc-494b-8eb4-0fe0622fc6ea resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38232024-09-25T17:33:46.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 49744c5b-d2fc-494b-8eb4-0fe0622fc6ea response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38242024-09-25T17:33:47.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4951bb4a-98d9-479a-9bb3-19ced20997fc roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38252024-09-25T17:33:47.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4951bb4a-98d9-479a-9bb3-19ced20997fc resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38262024-09-25T17:33:47.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2898 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4951bb4a-98d9-479a-9bb3-19ced20997fc response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38272024-09-25T17:33:48.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d38626cc-39aa-4fad-b4c4-ef86af3ae159 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38282024-09-25T17:33:48.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d38626cc-39aa-4fad-b4c4-ef86af3ae159 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38292024-09-25T17:33:48.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d38626cc-39aa-4fad-b4c4-ef86af3ae159 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38302024-09-25T17:33:49.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c636d352-bad2-4c4e-b44d-de08e99ab975 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38312024-09-25T17:33:49.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c636d352-bad2-4c4e-b44d-de08e99ab975 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38322024-09-25T17:33:49.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c636d352-bad2-4c4e-b44d-de08e99ab975 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38332024-09-25T17:33:50.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fd6d1555-a507-4e5f-8384-15824af29650 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38342024-09-25T17:33:50.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fd6d1555-a507-4e5f-8384-15824af29650 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38352024-09-25T17:33:50.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fd6d1555-a507-4e5f-8384-15824af29650 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
38362024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
38372024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
38382024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38392024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38402024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
38412024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38422024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
38432024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38442024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
38452024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38462024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
38472024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38482024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38492024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
38502024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38512024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
38522024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38532024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
38542024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38552024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
38562024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
38572024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38582024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
38592024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38602024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
38612024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
38622024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38632024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
38642024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38652024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
38662024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38672024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38682024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
38692024-09-25T17:33:51.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38702024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38712024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38722024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38732024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38742024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38752024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38762024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38772024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38782024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38792024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38802024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38812024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38822024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38832024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38842024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38852024-09-25T17:33:51.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38862024-09-25T17:33:51.490ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38872024-09-25T17:33:51.490ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
38882024-09-25T17:33:51.490ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38892024-09-25T17:33:51.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38902024-09-25T17:33:51.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38912024-09-25T17:33:51.492ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.353511ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38922024-09-25T17:33:51.493ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38932024-09-25T17:33:51.494ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2759, tv_nsec: 610001717 } })
38942024-09-25T17:33:51.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38952024-09-25T17:33:51.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38962024-09-25T17:33:51.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38972024-09-25T17:33:51.495ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
38982024-09-25T17:33:51.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38992024-09-25T17:33:51.496ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39002024-09-25T17:33:51.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39012024-09-25T17:33:51.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39022024-09-25T17:33:51.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39032024-09-25T17:33:51.500ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2759, tv_nsec: 615848455 } })
39042024-09-25T17:33:51.502ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
39052024-09-25T17:33:51.502ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39062024-09-25T17:33:51.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39072024-09-25T17:33:51.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39082024-09-25T17:33:51.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39092024-09-25T17:33:51.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39102024-09-25T17:33:51.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39112024-09-25T17:33:51.510ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39122024-09-25T17:33:51.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39132024-09-25T17:33:51.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39142024-09-25T17:33:51.511ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39152024-09-25T17:33:51.511ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2759, tv_nsec: 626755548 } })
39162024-09-25T17:33:51.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39172024-09-25T17:33:51.511ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
39182024-09-25T17:33:51.512ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39192024-09-25T17:33:51.514ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39202024-09-25T17:33:51.514ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39212024-09-25T17:33:51.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39222024-09-25T17:33:51.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39232024-09-25T17:33:51.516ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39242024-09-25T17:33:51.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39252024-09-25T17:33:51.531ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39262024-09-25T17:33:51.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39272024-09-25T17:33:51.535ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.126733ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
39282024-09-25T17:33:51.539ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39292024-09-25T17:33:51.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39302024-09-25T17:33:51.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39312024-09-25T17:33:51.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39322024-09-25T17:33:51.544ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39332024-09-25T17:33:51.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39342024-09-25T17:33:51.547ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.383013ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39352024-09-25T17:33:51.548ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.243847ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
39362024-09-25T17:33:51.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.780197ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
39372024-09-25T17:33:51.550ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39382024-09-25T17:33:51.553ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39392024-09-25T17:33:51.553ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39402024-09-25T17:33:51.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39412024-09-25T17:33:51.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39422024-09-25T17:33:51.558ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
39432024-09-25T17:33:51.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39442024-09-25T17:33:51.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39452024-09-25T17:33:51.562ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39462024-09-25T17:33:51.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39472024-09-25T17:33:51.564ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39482024-09-25T17:33:51.564ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39492024-09-25T17:33:51.564ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39502024-09-25T17:33:51.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39512024-09-25T17:33:51.566ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39522024-09-25T17:33:51.566ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.832744ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39532024-09-25T17:33:51.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39542024-09-25T17:33:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
39552024-09-25T17:33:51.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39562024-09-25T17:33:51.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39572024-09-25T17:33:51.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39582024-09-25T17:33:51.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39592024-09-25T17:33:51.588ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39602024-09-25T17:33:51.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39612024-09-25T17:33:51.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 104.866408ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
39622024-09-25T17:33:51.596ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
39632024-09-25T17:33:51.596ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 108.589287ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
39642024-09-25T17:33:51.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39652024-09-25T17:33:51.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39662024-09-25T17:33:51.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39672024-09-25T17:33:51.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39682024-09-25T17:33:51.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39692024-09-25T17:33:51.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f0d006a2-eb4a-4510-8a1c-6c144343343f, lookup_type: ById(f0d006a2-eb4a-4510-8a1c-6c144343343f) } result = Ok(())
39702024-09-25T17:33:51.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39712024-09-25T17:33:51.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39722024-09-25T17:33:51.615ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 127.59512ms iteration = 18 status = 0
39732024-09-25T17:33:51.617ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39742024-09-25T17:33:51.617ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39752024-09-25T17:33:51.617ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 129.980585ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
39762024-09-25T17:33:51.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 139.584682ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
39772024-09-25T17:33:51.637ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 zone_address = fd00:1122:3344:101::2
39782024-09-25T17:33:51.637ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39792024-09-25T17:33:51.637ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c18d410e-d924-4879-9ae4-299b40cefdd9", "content-length": "26", "date": "Wed, 25 Sep 2024 17:33:50 GMT"} })
39802024-09-25T17:33:51.638ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39812024-09-25T17:33:51.639ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
39822024-09-25T17:33:51.679ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 191.596829ms iteration = 21 status = {"physical_disks_added":0}
39832024-09-25T17:33:51.684ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39842024-09-25T17:33:51.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39852024-09-25T17:33:51.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39862024-09-25T17:33:51.687ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39872024-09-25T17:33:51.687ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39882024-09-25T17:33:51.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39892024-09-25T17:33:51.736ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
39902024-09-25T17:33:51.736ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39912024-09-25T17:33:51.736ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "03cf28ef-f102-4d2f-b20d-60ab52532a43", "content-length": "26", "date": "Wed, 25 Sep 2024 17:33:50 GMT"} })
39922024-09-25T17:33:51.736ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39932024-09-25T17:33:51.738ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39942024-09-25T17:33:51.748ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39952024-09-25T17:33:51.750ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6b4ae792-6b17-44f7-afdb-a0f497f99f50", "content-length": "372", "date": "Wed, 25 Sep 2024 17:33:51 GMT"} })
39962024-09-25T17:33:51.750ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39972024-09-25T17:33:51.750ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39982024-09-25T17:33:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39992024-09-25T17:33:51.752ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40002024-09-25T17:33:51.752ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40012024-09-25T17:33:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40022024-09-25T17:33:51.752ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40032024-09-25T17:33:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40042024-09-25T17:33:51.755ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40052024-09-25T17:33:51.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40062024-09-25T17:33:51.758ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40072024-09-25T17:33:51.759ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9c188a44-034c-4d63-8926-a40d3b7e8362", "date": "Wed, 25 Sep 2024 17:33:51 GMT"} })
40082024-09-25T17:33:51.760ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 272.746235ms iteration = 20 status = {}
40092024-09-25T17:33:51.761ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
40102024-09-25T17:33:51.761ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40112024-09-25T17:33:51.761ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ea5e5048-35c6-453a-bc03-68aadf6b55b9", "content-length": "26", "date": "Wed, 25 Sep 2024 17:33:50 GMT"} })
40122024-09-25T17:33:51.761ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40132024-09-25T17:33:51.763ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40142024-09-25T17:33:51.831ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40152024-09-25T17:33:51.831ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c30c9b86-786f-4141-ade4-dfab2afd2ab8", "content-length": "2", "date": "Wed, 25 Sep 2024 17:33:51 GMT"} })
40162024-09-25T17:33:51.834ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40172024-09-25T17:33:51.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40182024-09-25T17:33:51.836ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 348.531062ms iteration = 18 status = null
40192024-09-25T17:33:51.841ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40202024-09-25T17:33:51.847ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 360.124388ms iteration = 18 status = {}
40212024-09-25T17:33:51.875ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "46bdf0bf-7f88-425f-a7b7-0d051aa00e67", "content-length": "691", "date": "Wed, 25 Sep 2024 17:33:51 GMT"} })
40222024-09-25T17:33:51.875ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
40232024-09-25T17:33:51.875ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
40242024-09-25T17:33:51.875ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
40252024-09-25T17:33:51.877ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 389.726477ms iteration = 19 status = {}
40262024-09-25T17:33:51.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40272024-09-25T17:33:51.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40282024-09-25T17:33:51.901ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 6e5d68bf-01bc-412c-9915-3ad6fd435156, rack_id: 5c1bad99-30b8-419d-9695-a982a6249225, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5d8104c-5830-4cb9-9490-d372d8c75371) } rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
40292024-09-25T17:33:51.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40302024-09-25T17:33:51.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40312024-09-25T17:33:51.910ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40322024-09-25T17:33:51.910ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "229afefd-05a0-4682-814f-d1acd1d47f00", "content-length": "121", "date": "Wed, 25 Sep 2024 17:33:51 GMT"} })
40332024-09-25T17:33:51.910ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
40342024-09-25T17:33:51.910ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5d8104c-5830-4cb9-9490-d372d8c75371
40352024-09-25T17:33:51.910ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40362024-09-25T17:33:51.910ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40372024-09-25T17:33:51.910ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
40382024-09-25T17:33:51.910ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
40392024-09-25T17:33:51.910ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
40402024-09-25T17:33:51.910ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40412024-09-25T17:33:51.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40422024-09-25T17:33:51.912ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40432024-09-25T17:33:51.912ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c8ca1bb5-02af-4448-a1ef-37e23b83c5fc", "content-length": "2", "date": "Wed, 25 Sep 2024 17:33:51 GMT"} })
40442024-09-25T17:33:51.912ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40452024-09-25T17:33:51.912ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "38d78625-736a-4720-ac89-3a91567d0636", "content-length": "52", "date": "Wed, 25 Sep 2024 17:33:51 GMT"} })
40462024-09-25T17:33:51.912ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
40472024-09-25T17:33:51.912ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40482024-09-25T17:33:52.005ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6b67affe-be03-4776-978a-9bc1ef79da6d", "date": "Wed, 25 Sep 2024 17:33:51 GMT"} })
40492024-09-25T17:33:52.005ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch = Switch0
40502024-09-25T17:33:52.005ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40512024-09-25T17:33:52.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5363679a-ea0d-4304-a841-855d549a2998 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40522024-09-25T17:33:52.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5363679a-ea0d-4304-a841-855d549a2998 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40532024-09-25T17:33:52.005ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d16e914f-fa93-4c55-9df4-a182195ce7cf", "content-length": "667", "date": "Wed, 25 Sep 2024 17:33:51 GMT"} })
40542024-09-25T17:33:52.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40552024-09-25T17:33:52.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40562024-09-25T17:33:52.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5363679a-ea0d-4304-a841-855d549a2998 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40572024-09-25T17:33:52.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40582024-09-25T17:33:52.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40592024-09-25T17:33:52.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40602024-09-25T17:33:52.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40612024-09-25T17:33:52.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40622024-09-25T17:33:52.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40632024-09-25T17:33:52.021ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 534.231171ms iteration = 18 status = {}
40642024-09-25T17:33:53.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d46323bf-9c97-4077-865d-ef7e75d46f0c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40652024-09-25T17:33:53.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d46323bf-9c97-4077-865d-ef7e75d46f0c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40662024-09-25T17:33:53.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d46323bf-9c97-4077-865d-ef7e75d46f0c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40672024-09-25T17:33:54.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e6412b0b-3b39-4433-8099-79a91cab36f1 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40682024-09-25T17:33:54.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e6412b0b-3b39-4433-8099-79a91cab36f1 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40692024-09-25T17:33:54.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e6412b0b-3b39-4433-8099-79a91cab36f1 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40702024-09-25T17:33:55.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b19a7c9d-94a2-4988-9a91-88386551950d roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40712024-09-25T17:33:55.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b19a7c9d-94a2-4988-9a91-88386551950d resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40722024-09-25T17:33:55.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b19a7c9d-94a2-4988-9a91-88386551950d response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40732024-09-25T17:33:55.464ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1404 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = da86d7bf-7cf3-4ffb-91ca-80fccb1ef2ba response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
40742024-09-25T17:33:56.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 331f718d-69bf-4aa2-afec-29a54ee66ca0 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40752024-09-25T17:33:56.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 331f718d-69bf-4aa2-afec-29a54ee66ca0 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40762024-09-25T17:33:56.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 331f718d-69bf-4aa2-afec-29a54ee66ca0 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40772024-09-25T17:33:57.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fa4f4636-86d2-4d99-a623-1a899f20c809 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40782024-09-25T17:33:57.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fa4f4636-86d2-4d99-a623-1a899f20c809 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40792024-09-25T17:33:57.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fa4f4636-86d2-4d99-a623-1a899f20c809 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40802024-09-25T17:33:58.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d90f8f90-f467-46dc-a9bb-0c5f6b18b190 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40812024-09-25T17:33:58.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d90f8f90-f467-46dc-a9bb-0c5f6b18b190 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40822024-09-25T17:33:58.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d90f8f90-f467-46dc-a9bb-0c5f6b18b190 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40832024-09-25T17:33:59.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fd4eee2d-7d48-40cd-b05e-877b767df962 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40842024-09-25T17:33:59.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fd4eee2d-7d48-40cd-b05e-877b767df962 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40852024-09-25T17:33:59.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fd4eee2d-7d48-40cd-b05e-877b767df962 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40862024-09-25T17:34:00.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5c4813ae-df98-425f-ab67-5a8147044ed1 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40872024-09-25T17:34:00.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5c4813ae-df98-425f-ab67-5a8147044ed1 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40882024-09-25T17:34:00.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5c4813ae-df98-425f-ab67-5a8147044ed1 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40892024-09-25T17:34:01.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 91e5b020-4306-41fe-becc-93818949a875 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40902024-09-25T17:34:01.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 91e5b020-4306-41fe-becc-93818949a875 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40912024-09-25T17:34:01.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 91e5b020-4306-41fe-becc-93818949a875 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
40922024-09-25T17:34:01.487ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
40932024-09-25T17:34:01.487ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40942024-09-25T17:34:01.487ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
40952024-09-25T17:34:01.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40962024-09-25T17:34:01.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40972024-09-25T17:34:01.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40982024-09-25T17:34:01.516ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40992024-09-25T17:34:01.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41002024-09-25T17:34:01.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41012024-09-25T17:34:01.517ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.007258ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41022024-09-25T17:34:01.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41032024-09-25T17:34:01.519ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41042024-09-25T17:34:01.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41052024-09-25T17:34:01.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41062024-09-25T17:34:01.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41072024-09-25T17:34:01.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41082024-09-25T17:34:01.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
41092024-09-25T17:34:01.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41102024-09-25T17:34:01.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41112024-09-25T17:34:01.531ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
41122024-09-25T17:34:01.531ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.840724ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
41132024-09-25T17:34:02.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d289936e-f3a3-4489-a987-cc190fdc72dc roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41142024-09-25T17:34:02.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d289936e-f3a3-4489-a987-cc190fdc72dc resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41152024-09-25T17:34:02.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d289936e-f3a3-4489-a987-cc190fdc72dc response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41162024-09-25T17:34:03.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e91ab8ee-625b-4f99-9dbd-d180d39ac402 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41172024-09-25T17:34:03.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e91ab8ee-625b-4f99-9dbd-d180d39ac402 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41182024-09-25T17:34:03.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e91ab8ee-625b-4f99-9dbd-d180d39ac402 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41192024-09-25T17:34:03.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 2aa74ebd-244f-4576-85a3-aa8ac89bac8a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
41202024-09-25T17:34:03.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 2aa74ebd-244f-4576-85a3-aa8ac89bac8a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
41212024-09-25T17:34:03.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3592 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 2aa74ebd-244f-4576-85a3-aa8ac89bac8a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
41222024-09-25T17:34:04.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 40a6c168-98a6-4913-8d67-f817b40924a2 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41232024-09-25T17:34:04.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 40a6c168-98a6-4913-8d67-f817b40924a2 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41242024-09-25T17:34:04.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 40a6c168-98a6-4913-8d67-f817b40924a2 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41252024-09-25T17:34:05.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7e35dce5-c3de-49dc-9427-4dfba64b3201 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41262024-09-25T17:34:05.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7e35dce5-c3de-49dc-9427-4dfba64b3201 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41272024-09-25T17:34:05.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7e35dce5-c3de-49dc-9427-4dfba64b3201 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41282024-09-25T17:34:05.464ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1432 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = ea154a00-8a20-4f12-9955-432b11d71c72 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
41292024-09-25T17:34:06.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a413cbf1-26ea-4bad-bab1-063a02a341aa roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41302024-09-25T17:34:06.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a413cbf1-26ea-4bad-bab1-063a02a341aa resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41312024-09-25T17:34:06.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a413cbf1-26ea-4bad-bab1-063a02a341aa response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41322024-09-25T17:34:07.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e56a8446-7496-4bf0-9790-be407d959470 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41332024-09-25T17:34:07.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e56a8446-7496-4bf0-9790-be407d959470 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41342024-09-25T17:34:07.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e56a8446-7496-4bf0-9790-be407d959470 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41352024-09-25T17:34:08.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d0fb975b-d0fb-4553-be3e-41534d74b7a0 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41362024-09-25T17:34:08.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d0fb975b-d0fb-4553-be3e-41534d74b7a0 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41372024-09-25T17:34:08.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d0fb975b-d0fb-4553-be3e-41534d74b7a0 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41382024-09-25T17:34:09.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 48f0eaae-6f74-40ca-9861-bfc81cb70b04 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41392024-09-25T17:34:09.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 48f0eaae-6f74-40ca-9861-bfc81cb70b04 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41402024-09-25T17:34:09.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 48f0eaae-6f74-40ca-9861-bfc81cb70b04 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41412024-09-25T17:34:10.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b35e7643-dfec-4d74-97fc-f08a44fdc47f roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41422024-09-25T17:34:10.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b35e7643-dfec-4d74-97fc-f08a44fdc47f resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41432024-09-25T17:34:10.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b35e7643-dfec-4d74-97fc-f08a44fdc47f response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41442024-09-25T17:34:11.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9414a56b-5ec2-474b-a51b-0925ddfffc0e roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41452024-09-25T17:34:11.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9414a56b-5ec2-474b-a51b-0925ddfffc0e resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41462024-09-25T17:34:11.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9414a56b-5ec2-474b-a51b-0925ddfffc0e response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41472024-09-25T17:34:11.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
41482024-09-25T17:34:11.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
41492024-09-25T17:34:11.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41502024-09-25T17:34:11.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41512024-09-25T17:34:11.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41522024-09-25T17:34:11.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41532024-09-25T17:34:11.514ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41542024-09-25T17:34:11.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41552024-09-25T17:34:11.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41562024-09-25T17:34:11.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41572024-09-25T17:34:11.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41582024-09-25T17:34:11.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41592024-09-25T17:34:11.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41602024-09-25T17:34:11.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41612024-09-25T17:34:11.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41622024-09-25T17:34:11.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
41632024-09-25T17:34:11.524ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41642024-09-25T17:34:11.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41652024-09-25T17:34:11.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
41662024-09-25T17:34:11.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.291803ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
41672024-09-25T17:34:11.541ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.793271ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41682024-09-25T17:34:12.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c2989fb4-e25b-49ab-8d4c-56aa6466b415 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41692024-09-25T17:34:12.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c2989fb4-e25b-49ab-8d4c-56aa6466b415 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41702024-09-25T17:34:12.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c2989fb4-e25b-49ab-8d4c-56aa6466b415 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41712024-09-25T17:34:13.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 60abed20-e77d-45d8-adf9-5b0585bc9fb5 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41722024-09-25T17:34:13.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 60abed20-e77d-45d8-adf9-5b0585bc9fb5 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41732024-09-25T17:34:13.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 60abed20-e77d-45d8-adf9-5b0585bc9fb5 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41742024-09-25T17:34:14.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5eb8f74a-641a-49c3-b70b-2f697c8da36c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41752024-09-25T17:34:14.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5eb8f74a-641a-49c3-b70b-2f697c8da36c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41762024-09-25T17:34:14.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5eb8f74a-641a-49c3-b70b-2f697c8da36c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41772024-09-25T17:34:15.464ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1466 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 8be8aaa2-1c1a-47b2-b33f-c21c633d754e response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
41782024-09-25T17:34:15.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4165f66a-f862-4bf8-b3cf-160bf90ccc93 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41792024-09-25T17:34:15.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4165f66a-f862-4bf8-b3cf-160bf90ccc93 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41802024-09-25T17:34:15.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4165f66a-f862-4bf8-b3cf-160bf90ccc93 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41812024-09-25T17:34:16.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fc123463-6710-404e-9500-eb231cb887ac roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41822024-09-25T17:34:16.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fc123463-6710-404e-9500-eb231cb887ac resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41832024-09-25T17:34:16.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2714 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fc123463-6710-404e-9500-eb231cb887ac response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41842024-09-25T17:34:17.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3cecdabb-85d7-4d63-8e0b-b1a73053664e roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41852024-09-25T17:34:17.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3cecdabb-85d7-4d63-8e0b-b1a73053664e resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41862024-09-25T17:34:17.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 3cecdabb-85d7-4d63-8e0b-b1a73053664e response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41872024-09-25T17:34:18.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0d8eb10e-399d-4760-8607-bdaa281748c3 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41882024-09-25T17:34:18.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0d8eb10e-399d-4760-8607-bdaa281748c3 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41892024-09-25T17:34:18.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0d8eb10e-399d-4760-8607-bdaa281748c3 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41902024-09-25T17:34:19.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2ad7ce78-e991-4117-bef8-558b9a3f01e0 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41912024-09-25T17:34:19.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2ad7ce78-e991-4117-bef8-558b9a3f01e0 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41922024-09-25T17:34:19.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2ad7ce78-e991-4117-bef8-558b9a3f01e0 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41932024-09-25T17:34:20.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cbb9ec13-08e6-40b5-a6aa-a248a3df5a5c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41942024-09-25T17:34:20.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cbb9ec13-08e6-40b5-a6aa-a248a3df5a5c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41952024-09-25T17:34:20.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cbb9ec13-08e6-40b5-a6aa-a248a3df5a5c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
41962024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
41972024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
41982024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41992024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
42002024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
42012024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42022024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42032024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
42042024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
42052024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42062024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42072024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
42082024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42092024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
42102024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42112024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42122024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
42132024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
42142024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42152024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42162024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
42172024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
42182024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42192024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42202024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
42212024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
42222024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
42232024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42242024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
42252024-09-25T17:34:21.488ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa
42262024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.39\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa"}
42272024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
42282024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
42292024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42302024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42312024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
42322024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42332024-09-25T17:34:21.488ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-09-25 17:24:21.488476526 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42342024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42352024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
42362024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42372024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
42382024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42392024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
42402024-09-25T17:34:21.488ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42412024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
42422024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42432024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
42442024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
42452024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42462024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
42472024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42482024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
42492024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
42502024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
42512024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42522024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
42532024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42542024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
42552024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
42562024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42572024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42582024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
42592024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42602024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42612024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42622024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42632024-09-25T17:34:21.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42642024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42652024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42662024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42672024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42682024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42692024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42702024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
42712024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42722024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42732024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42742024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42752024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
42762024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
42772024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42782024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
42792024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
42802024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
42812024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
42822024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42832024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42842024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42852024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42862024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42872024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42882024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42892024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42902024-09-25T17:34:21.489ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42912024-09-25T17:34:21.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42922024-09-25T17:34:21.490ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ae9bf3cd-ff12-421b-b5a2-d52b18bde4b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("be8cd1d4-baa8-48cc-872f-69bc5c2df30c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("be8cd1d4-baa8-48cc-872f-69bc5c2df30c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 2789, tv_nsec: 606027480 } })
42932024-09-25T17:34:21.491ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42942024-09-25T17:34:21.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42952024-09-25T17:34:21.492ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("11f53a30-9163-413a-8f7f-4bf206fb8176.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("929fdd8e-9f93-4e52-8d3d-ae706bb7a130.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ddd5d4f4-1113-49a5-bb63-a018bec3753e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ddd5d4f4-1113-49a5-bb63-a018bec3753e.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 2789, tv_nsec: 607658650 } })
42962024-09-25T17:34:21.492ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
42972024-09-25T17:34:21.492ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.812161ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
42982024-09-25T17:34:21.492ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.736439ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
42992024-09-25T17:34:21.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43002024-09-25T17:34:21.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43012024-09-25T17:34:21.493ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43022024-09-25T17:34:21.495ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
43032024-09-25T17:34:21.495ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.585933ms iteration = 11 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
43042024-09-25T17:34:21.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43052024-09-25T17:34:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43062024-09-25T17:34:21.496ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43072024-09-25T17:34:21.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43082024-09-25T17:34:21.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43092024-09-25T17:34:21.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43102024-09-25T17:34:21.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43112024-09-25T17:34:21.519ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-09-25 17:24:21.488476526 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43122024-09-25T17:34:21.519ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 30.68999ms iteration = 10 status = {"expiration":"2024-09-25T17:24:21.488476526Z","pruned":[]}
43132024-09-25T17:34:21.521ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 32.935012ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
43142024-09-25T17:34:21.524ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2789, tv_nsec: 640148163 } })
43152024-09-25T17:34:21.526ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
43162024-09-25T17:34:21.537ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2789, tv_nsec: 652852179 } })
43172024-09-25T17:34:21.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
43182024-09-25T17:34:21.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43192024-09-25T17:34:21.544ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43202024-09-25T17:34:21.547ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43212024-09-25T17:34:21.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43222024-09-25T17:34:21.547ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43232024-09-25T17:34:21.547ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43242024-09-25T17:34:21.547ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43252024-09-25T17:34:21.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43262024-09-25T17:34:21.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43272024-09-25T17:34:21.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43282024-09-25T17:34:21.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43292024-09-25T17:34:21.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43302024-09-25T17:34:21.557ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43312024-09-25T17:34:21.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43322024-09-25T17:34:21.559ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43332024-09-25T17:34:21.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43342024-09-25T17:34:21.563ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43352024-09-25T17:34:21.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43362024-09-25T17:34:21.569ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43372024-09-25T17:34:21.571ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
43382024-09-25T17:34:21.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43392024-09-25T17:34:21.572ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43402024-09-25T17:34:21.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43412024-09-25T17:34:21.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43422024-09-25T17:34:21.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43432024-09-25T17:34:21.577ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43442024-09-25T17:34:21.578ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43452024-09-25T17:34:21.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43462024-09-25T17:34:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43472024-09-25T17:34:21.581ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43482024-09-25T17:34:21.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43492024-09-25T17:34:21.581ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43502024-09-25T17:34:21.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43512024-09-25T17:34:21.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43522024-09-25T17:34:21.585ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43532024-09-25T17:34:21.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43542024-09-25T17:34:21.585ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43552024-09-25T17:34:21.585ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43562024-09-25T17:34:21.585ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43572024-09-25T17:34:21.585ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43582024-09-25T17:34:21.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43592024-09-25T17:34:21.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43602024-09-25T17:34:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43612024-09-25T17:34:21.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43622024-09-25T17:34:21.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43632024-09-25T17:34:21.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43642024-09-25T17:34:21.588ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43652024-09-25T17:34:21.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43662024-09-25T17:34:21.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43672024-09-25T17:34:21.589ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43682024-09-25T17:34:21.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43692024-09-25T17:34:21.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43702024-09-25T17:34:21.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43712024-09-25T17:34:21.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43722024-09-25T17:34:21.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43732024-09-25T17:34:21.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43742024-09-25T17:34:21.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 109.475053ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
43752024-09-25T17:34:21.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 110.189166ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
43762024-09-25T17:34:21.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 110.411081ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
43772024-09-25T17:34:21.599ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43782024-09-25T17:34:21.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43792024-09-25T17:34:21.600ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
43802024-09-25T17:34:21.600ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
43812024-09-25T17:34:21.600ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 111.442889ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
43822024-09-25T17:34:21.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
43832024-09-25T17:34:21.600ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43842024-09-25T17:34:21.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43852024-09-25T17:34:21.602ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43862024-09-25T17:34:21.602ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
43872024-09-25T17:34:21.602ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 114.193391ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
43882024-09-25T17:34:21.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43892024-09-25T17:34:21.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43902024-09-25T17:34:21.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43912024-09-25T17:34:21.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43922024-09-25T17:34:21.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43932024-09-25T17:34:21.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43942024-09-25T17:34:21.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
43952024-09-25T17:34:21.609ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43962024-09-25T17:34:21.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43972024-09-25T17:34:21.616ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 128.328174ms iteration = 5 status = {"nsuccess":5}
43982024-09-25T17:34:21.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43992024-09-25T17:34:21.624ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
44002024-09-25T17:34:21.624ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44012024-09-25T17:34:21.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44022024-09-25T17:34:21.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44032024-09-25T17:34:21.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44042024-09-25T17:34:21.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44052024-09-25T17:34:21.632ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2789, tv_nsec: 747796403 } })
44062024-09-25T17:34:21.633ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
44072024-09-25T17:34:21.642ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:67 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
44082024-09-25T17:34:21.642ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 154.204555ms iteration = 10 status = {"changed_state":[],"instances_found":0,"instances_reincarnated":[],"query_error":null,"restart_errors":{}}
44092024-09-25T17:34:21.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f5c1d63b-80d0-467b-9311-c47f6b3f49f4 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
44102024-09-25T17:34:21.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f5c1d63b-80d0-467b-9311-c47f6b3f49f4 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
44112024-09-25T17:34:21.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f5c1d63b-80d0-467b-9311-c47f6b3f49f4 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
44122024-09-25T17:34:21.650ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44132024-09-25T17:34:21.650ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44142024-09-25T17:34:21.650ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44152024-09-25T17:34:21.650ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44162024-09-25T17:34:21.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44172024-09-25T17:34:21.657ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44182024-09-25T17:34:21.657ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44192024-09-25T17:34:21.657ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44202024-09-25T17:34:21.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44212024-09-25T17:34:21.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44222024-09-25T17:34:21.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44232024-09-25T17:34:21.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44242024-09-25T17:34:21.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44252024-09-25T17:34:21.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44262024-09-25T17:34:21.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44272024-09-25T17:34:21.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44282024-09-25T17:34:21.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44292024-09-25T17:34:21.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44302024-09-25T17:34:21.672ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44312024-09-25T17:34:21.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44322024-09-25T17:34:21.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44332024-09-25T17:34:21.676ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 188.581063ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44342024-09-25T17:34:21.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f0d006a2-eb4a-4510-8a1c-6c144343343f, lookup_type: ById(f0d006a2-eb4a-4510-8a1c-6c144343343f) } result = Ok(())
44352024-09-25T17:34:21.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44362024-09-25T17:34:21.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44372024-09-25T17:34:21.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 190.658881ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44382024-09-25T17:34:21.680ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44392024-09-25T17:34:21.680ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44402024-09-25T17:34:21.680ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44412024-09-25T17:34:21.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44422024-09-25T17:34:21.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44432024-09-25T17:34:21.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44442024-09-25T17:34:21.680ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44452024-09-25T17:34:21.680ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
44462024-09-25T17:34:21.680ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 192.392373ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44472024-09-25T17:34:21.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44482024-09-25T17:34:21.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
44492024-09-25T17:34:21.681ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44502024-09-25T17:34:21.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44512024-09-25T17:34:21.682ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
44522024-09-25T17:34:21.682ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44532024-09-25T17:34:21.682ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 193.906791ms iteration = 19 status = 0
44542024-09-25T17:34:21.682ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "87f4bb48-6ad4-461d-b071-9bd85f052fbe", "content-length": "26", "date": "Wed, 25 Sep 2024 17:34:20 GMT"} })
44552024-09-25T17:34:21.682ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44562024-09-25T17:34:21.684ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44572024-09-25T17:34:21.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44582024-09-25T17:34:21.684ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44592024-09-25T17:34:21.686ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44602024-09-25T17:34:21.688ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44612024-09-25T17:34:21.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44622024-09-25T17:34:21.689ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44632024-09-25T17:34:21.689ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44642024-09-25T17:34:21.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44652024-09-25T17:34:21.694ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
44662024-09-25T17:34:21.694ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 206.458645ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
44672024-09-25T17:34:21.703ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
44682024-09-25T17:34:21.703ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44692024-09-25T17:34:21.703ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7f73a628-208e-47cb-b15b-43fecf4c0c9b", "content-length": "26", "date": "Wed, 25 Sep 2024 17:34:20 GMT"} })
44702024-09-25T17:34:21.703ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44712024-09-25T17:34:21.705ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44722024-09-25T17:34:21.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44732024-09-25T17:34:21.730ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44742024-09-25T17:34:21.730ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44752024-09-25T17:34:21.730ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 241.997275ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44762024-09-25T17:34:21.731ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
44772024-09-25T17:34:21.731ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 9011eb2e-f736-49fd-9148-03ee7daa981e dns_zone_name = oxide.test found_so_far = 0 version = 2
44782024-09-25T17:34:21.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44792024-09-25T17:34:21.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44802024-09-25T17:34:21.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44812024-09-25T17:34:21.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44822024-09-25T17:34:21.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44832024-09-25T17:34:21.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44842024-09-25T17:34:21.737ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44852024-09-25T17:34:21.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44862024-09-25T17:34:21.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44872024-09-25T17:34:21.738ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44882024-09-25T17:34:21.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44892024-09-25T17:34:21.741ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 253.171263ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
44902024-09-25T17:34:21.741ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 9011eb2e-f736-49fd-9148-03ee7daa981e dns_zone_name = oxide.test found_so_far = 1 version = 2
44912024-09-25T17:34:21.741ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
44922024-09-25T17:34:21.741ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-09-25 17:25:43.713253 UTC dns_group = external generation = 2
44932024-09-25T17:34:21.741ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 253.319415ms iteration = 11 status = {"generation":2}
44942024-09-25T17:34:21.748ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-09-25T17:25:19.066517Z, time_modified: 2024-09-25T17:25:19.066517Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, db_silo: Silo { identity: SiloIdentity { id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-25T17:25:43.663371Z, time_modified: 2024-09-25T17:25:43.663371Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, db_silo: Silo { identity: SiloIdentity { id: dcfeb960-7abf-4e10-b28d-9fa9c33e4d51, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-09-25T17:25:43.663371Z, time_modified: 2024-09-25T17:25:43.663371Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c" }] }) }
44952024-09-25T17:34:21.748ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 260.496948ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"dcfeb960-7abf-4e10-b28d-9fa9c33e4d51","tls_certs":["4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c"]}},"default_endpoint":{"silo_id":"dcfeb960-7abf-4e10-b28d-9fa9c33e4d51","tls_certs":["4587ecbaf2b67b7db60d75403e610f2e4649ec3cf3016f341553db229aceff9c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
44962024-09-25T17:34:21.767ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 279.122665ms iteration = 22 status = {"physical_disks_added":0}
44972024-09-25T17:34:21.770ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 zone_address = fd00:1122:3344:101::2
44982024-09-25T17:34:21.770ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44992024-09-25T17:34:21.772ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d2428f60-104c-4fc9-9999-aa7e8c114f53", "content-length": "26", "date": "Wed, 25 Sep 2024 17:34:20 GMT"} })
45002024-09-25T17:34:21.772ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45012024-09-25T17:34:21.774ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
45022024-09-25T17:34:21.777ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
45032024-09-25T17:34:21.781ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
45042024-09-25T17:34:21.781ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4983f296-eda5-4ab7-98fb-1acc9a8bf292 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
45052024-09-25T17:34:21.781ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45062024-09-25T17:34:21.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45072024-09-25T17:34:21.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45082024-09-25T17:34:21.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45092024-09-25T17:34:21.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45102024-09-25T17:34:21.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45112024-09-25T17:34:21.791ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4983f296-eda5-4ab7-98fb-1acc9a8bf292 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
45122024-09-25T17:34:21.791ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
45132024-09-25T17:34:21.791ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-09-25 17:25:42.974009 UTC dns_group = internal generation = 1
45142024-09-25T17:34:21.791ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 303.12827ms iteration = 11 status = {"generation":1}
45152024-09-25T17:34:21.845ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
45162024-09-25T17:34:21.845ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bc626a57-261b-4bb2-a5e4-acf98a74467c", "date": "Wed, 25 Sep 2024 17:34:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45172024-09-25T17:34:21.845ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45182024-09-25T17:34:21.847ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c7713fbb-ea98-4cfd-a9cc-18d39b8e7bd7", "date": "Wed, 25 Sep 2024 17:34:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45192024-09-25T17:34:21.847ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45202024-09-25T17:34:21.849ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
45212024-09-25T17:34:21.849ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 360.890252ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45222024-09-25T17:34:21.860ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45232024-09-25T17:34:21.861ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "aa082236-1859-490b-9cd0-426fb1b8fc51", "content-length": "2", "date": "Wed, 25 Sep 2024 17:34:21 GMT"} })
45242024-09-25T17:34:21.863ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45252024-09-25T17:34:21.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45262024-09-25T17:34:21.865ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 377.131174ms iteration = 19 status = null
45272024-09-25T17:34:21.871ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45282024-09-25T17:34:21.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45292024-09-25T17:34:21.892ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 404.308589ms iteration = 19 status = {}
45302024-09-25T17:34:21.914ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45312024-09-25T17:34:21.915ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6cfea562-bc43-404a-b161-91374fcff5c7", "content-length": "372", "date": "Wed, 25 Sep 2024 17:34:21 GMT"} })
45322024-09-25T17:34:21.915ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45332024-09-25T17:34:21.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45342024-09-25T17:34:21.916ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45352024-09-25T17:34:21.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45362024-09-25T17:34:21.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45372024-09-25T17:34:21.918ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45382024-09-25T17:34:21.918ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45392024-09-25T17:34:21.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45402024-09-25T17:34:21.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45412024-09-25T17:34:21.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45422024-09-25T17:34:21.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45432024-09-25T17:34:21.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45442024-09-25T17:34:21.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45452024-09-25T17:34:21.921ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
45462024-09-25T17:34:21.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45472024-09-25T17:34:21.922ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0503fd5c-7b51-44ef-a49a-3d944bb5af0d", "date": "Wed, 25 Sep 2024 17:34:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45482024-09-25T17:34:21.922ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45492024-09-25T17:34:21.923ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45502024-09-25T17:34:21.923ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8b1e19dc-8f3f-46da-8af9-113ce9284915", "date": "Wed, 25 Sep 2024 17:34:21 GMT"} })
45512024-09-25T17:34:21.924ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3933ceea-bd6b-4990-867a-eac5feeed6e8", "date": "Wed, 25 Sep 2024 17:34:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45522024-09-25T17:34:21.924ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45532024-09-25T17:34:21.925ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 436.848933ms iteration = 21 status = {}
45542024-09-25T17:34:21.926ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "488247d0-f2b3-4265-90ba-669fce0ea573", "date": "Wed, 25 Sep 2024 17:34:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45552024-09-25T17:34:21.926ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45562024-09-25T17:34:21.927ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
45572024-09-25T17:34:21.927ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 439.37142ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45582024-09-25T17:34:21.985ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45592024-09-25T17:34:22.017ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45602024-09-25T17:34:22.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45612024-09-25T17:34:22.019ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 6e5d68bf-01bc-412c-9915-3ad6fd435156, rack_id: 5c1bad99-30b8-419d-9695-a982a6249225, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5d8104c-5830-4cb9-9490-d372d8c75371) } rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
45622024-09-25T17:34:22.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45632024-09-25T17:34:22.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45642024-09-25T17:34:22.027ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45652024-09-25T17:34:22.028ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "65cb1e91-d19d-4cbd-8ff2-cc05d0f917f8", "content-length": "121", "date": "Wed, 25 Sep 2024 17:34:21 GMT"} })
45662024-09-25T17:34:22.028ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
45672024-09-25T17:34:22.028ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5d8104c-5830-4cb9-9490-d372d8c75371
45682024-09-25T17:34:22.028ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45692024-09-25T17:34:22.028ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45702024-09-25T17:34:22.028ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
45712024-09-25T17:34:22.028ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
45722024-09-25T17:34:22.028ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
45732024-09-25T17:34:22.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45742024-09-25T17:34:22.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45752024-09-25T17:34:22.030ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45762024-09-25T17:34:22.030ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e7789300-d34e-45fe-91f2-4a145f1cb154", "content-length": "2", "date": "Wed, 25 Sep 2024 17:34:21 GMT"} })
45772024-09-25T17:34:22.030ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45782024-09-25T17:34:22.030ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6df6fa19-e220-431a-8786-2f58bf5a6188", "content-length": "52", "date": "Wed, 25 Sep 2024 17:34:21 GMT"} })
45792024-09-25T17:34:22.030ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
45802024-09-25T17:34:22.030ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45812024-09-25T17:34:22.060ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d7bb8662-c1fc-47ac-966e-6cae94e7a040", "content-length": "691", "date": "Wed, 25 Sep 2024 17:34:21 GMT"} })
45822024-09-25T17:34:22.060ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
45832024-09-25T17:34:22.060ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
45842024-09-25T17:34:22.060ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
45852024-09-25T17:34:22.062ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 573.396789ms iteration = 20 status = {}
45862024-09-25T17:34:22.149ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "12e0d140-1af6-4cc5-ac58-15b71a698c74", "date": "Wed, 25 Sep 2024 17:34:22 GMT"} })
45872024-09-25T17:34:22.149ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch = Switch0
45882024-09-25T17:34:22.149ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45892024-09-25T17:34:22.152ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "14725927-8abb-470b-b52d-c8fe60fa0832", "content-length": "667", "date": "Wed, 25 Sep 2024 17:34:22 GMT"} })
45902024-09-25T17:34:22.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45912024-09-25T17:34:22.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45922024-09-25T17:34:22.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45932024-09-25T17:34:22.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45942024-09-25T17:34:22.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45952024-09-25T17:34:22.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45962024-09-25T17:34:22.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45972024-09-25T17:34:22.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45982024-09-25T17:34:22.170ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 681.903565ms iteration = 19 status = {}
45992024-09-25T17:34:22.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9caccf9d-c1fd-4dff-b040-173a4ea224f9 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46002024-09-25T17:34:22.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9caccf9d-c1fd-4dff-b040-173a4ea224f9 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46012024-09-25T17:34:22.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9caccf9d-c1fd-4dff-b040-173a4ea224f9 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46022024-09-25T17:34:23.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6240e868-ede6-42d3-9301-1ced0b28345f roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46032024-09-25T17:34:23.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6240e868-ede6-42d3-9301-1ced0b28345f resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46042024-09-25T17:34:23.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 6240e868-ede6-42d3-9301-1ced0b28345f response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46052024-09-25T17:34:24.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 85e6a82d-7af9-4b7f-9b1a-c14627e28429 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46062024-09-25T17:34:24.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 85e6a82d-7af9-4b7f-9b1a-c14627e28429 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46072024-09-25T17:34:24.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 85e6a82d-7af9-4b7f-9b1a-c14627e28429 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46082024-09-25T17:34:25.464ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1564 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 9745cec4-c7de-453e-a96e-bd74ceb622c0 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
46092024-09-25T17:34:25.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = be067854-d47e-4387-a039-815752fd6c5b roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46102024-09-25T17:34:25.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = be067854-d47e-4387-a039-815752fd6c5b resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46112024-09-25T17:34:25.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = be067854-d47e-4387-a039-815752fd6c5b response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46122024-09-25T17:34:26.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5c5aca64-aa66-4c8e-bbbe-4dcfeea1bf6c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46132024-09-25T17:34:26.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5c5aca64-aa66-4c8e-bbbe-4dcfeea1bf6c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46142024-09-25T17:34:26.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2712 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 5c5aca64-aa66-4c8e-bbbe-4dcfeea1bf6c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46152024-09-25T17:34:27.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7f3fcfa8-912b-43b1-a4c8-034ce82537e9 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46162024-09-25T17:34:27.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7f3fcfa8-912b-43b1-a4c8-034ce82537e9 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46172024-09-25T17:34:27.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7f3fcfa8-912b-43b1-a4c8-034ce82537e9 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46182024-09-25T17:34:28.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c28d5514-b0b5-4f32-a5a3-dcd51dcef1f2 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46192024-09-25T17:34:28.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c28d5514-b0b5-4f32-a5a3-dcd51dcef1f2 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46202024-09-25T17:34:28.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = c28d5514-b0b5-4f32-a5a3-dcd51dcef1f2 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46212024-09-25T17:34:29.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e5312ad1-8233-453e-a5e1-2c61fa7258e9 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46222024-09-25T17:34:29.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e5312ad1-8233-453e-a5e1-2c61fa7258e9 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46232024-09-25T17:34:29.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2796 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e5312ad1-8233-453e-a5e1-2c61fa7258e9 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46242024-09-25T17:34:30.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f6677475-99c6-4fe0-b168-9b53d303b439 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46252024-09-25T17:34:30.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f6677475-99c6-4fe0-b168-9b53d303b439 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46262024-09-25T17:34:30.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f6677475-99c6-4fe0-b168-9b53d303b439 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46272024-09-25T17:34:31.487ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
46282024-09-25T17:34:31.487ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46292024-09-25T17:34:31.487ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
46302024-09-25T17:34:31.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46312024-09-25T17:34:31.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46322024-09-25T17:34:31.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46332024-09-25T17:34:31.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46342024-09-25T17:34:31.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46352024-09-25T17:34:31.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46362024-09-25T17:34:31.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46372024-09-25T17:34:31.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46382024-09-25T17:34:31.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46392024-09-25T17:34:31.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46402024-09-25T17:34:31.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46412024-09-25T17:34:31.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46422024-09-25T17:34:31.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
46432024-09-25T17:34:31.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46442024-09-25T17:34:31.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46452024-09-25T17:34:31.514ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
46462024-09-25T17:34:31.514ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.731107ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
46472024-09-25T17:34:31.529ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.114852ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46482024-09-25T17:34:31.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e7b63dde-c006-4506-8d76-a204432bb294 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46492024-09-25T17:34:31.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e7b63dde-c006-4506-8d76-a204432bb294 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46502024-09-25T17:34:31.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e7b63dde-c006-4506-8d76-a204432bb294 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46512024-09-25T17:34:32.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 031dfef7-bad3-4501-9725-a537edcaf027 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46522024-09-25T17:34:32.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 031dfef7-bad3-4501-9725-a537edcaf027 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46532024-09-25T17:34:32.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2391 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 031dfef7-bad3-4501-9725-a537edcaf027 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46542024-09-25T17:34:33.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 18689f64-0437-4103-b899-4d797d767c88 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
46552024-09-25T17:34:33.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 18689f64-0437-4103-b899-4d797d767c88 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
46562024-09-25T17:34:33.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 18689f64-0437-4103-b899-4d797d767c88 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
46572024-09-25T17:34:33.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b3e9ffb8-aa12-4a63-8a77-9f0e41b5e4ca roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46582024-09-25T17:34:33.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b3e9ffb8-aa12-4a63-8a77-9f0e41b5e4ca resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46592024-09-25T17:34:33.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b3e9ffb8-aa12-4a63-8a77-9f0e41b5e4ca response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46602024-09-25T17:34:34.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0d4d8fe2-7274-4fbb-9c7c-ea69a1b86109 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46612024-09-25T17:34:34.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0d4d8fe2-7274-4fbb-9c7c-ea69a1b86109 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46622024-09-25T17:34:34.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1886 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0d4d8fe2-7274-4fbb-9c7c-ea69a1b86109 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46632024-09-25T17:34:35.464ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 1a3b5e9a-5213-4117-be7c-9e590e188781 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
46642024-09-25T17:34:35.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4355ae7f-b833-40b7-acca-b5ba6e5619d5 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46652024-09-25T17:34:35.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4355ae7f-b833-40b7-acca-b5ba6e5619d5 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46662024-09-25T17:34:35.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 4355ae7f-b833-40b7-acca-b5ba6e5619d5 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46672024-09-25T17:34:36.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9833d814-28b8-4a85-acf9-75334b40dacf roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46682024-09-25T17:34:36.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9833d814-28b8-4a85-acf9-75334b40dacf resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46692024-09-25T17:34:36.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9833d814-28b8-4a85-acf9-75334b40dacf response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46702024-09-25T17:34:38.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8ce13370-63cd-4566-98b2-037554f51b13 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46712024-09-25T17:34:38.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8ce13370-63cd-4566-98b2-037554f51b13 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46722024-09-25T17:34:38.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 8ce13370-63cd-4566-98b2-037554f51b13 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46732024-09-25T17:34:39.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f5079f26-d9cd-48b9-8282-7697fc6b3a91 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46742024-09-25T17:34:39.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f5079f26-d9cd-48b9-8282-7697fc6b3a91 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46752024-09-25T17:34:39.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2712 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f5079f26-d9cd-48b9-8282-7697fc6b3a91 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46762024-09-25T17:34:40.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a8a424f6-e643-4df9-b268-63d623740218 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46772024-09-25T17:34:40.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a8a424f6-e643-4df9-b268-63d623740218 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46782024-09-25T17:34:40.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a8a424f6-e643-4df9-b268-63d623740218 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46792024-09-25T17:34:41.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e3233f48-f1c4-4ef3-98dd-668ea1eb6153 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46802024-09-25T17:34:41.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e3233f48-f1c4-4ef3-98dd-668ea1eb6153 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46812024-09-25T17:34:41.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = e3233f48-f1c4-4ef3-98dd-668ea1eb6153 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
46822024-09-25T17:34:41.487ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
46832024-09-25T17:34:41.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46842024-09-25T17:34:41.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
46852024-09-25T17:34:41.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46862024-09-25T17:34:41.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46872024-09-25T17:34:41.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46882024-09-25T17:34:41.489ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46892024-09-25T17:34:41.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46902024-09-25T17:34:41.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46912024-09-25T17:34:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46922024-09-25T17:34:41.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46932024-09-25T17:34:41.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46942024-09-25T17:34:41.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46952024-09-25T17:34:41.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46962024-09-25T17:34:41.496ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46972024-09-25T17:34:41.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
46982024-09-25T17:34:41.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46992024-09-25T17:34:41.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47002024-09-25T17:34:41.507ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
47012024-09-25T17:34:41.507ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.426781ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
47022024-09-25T17:34:41.517ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.532609ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47032024-09-25T17:34:42.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 81012447-9ccd-490d-bdba-257cb36c70eb roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47042024-09-25T17:34:42.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 81012447-9ccd-490d-bdba-257cb36c70eb resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47052024-09-25T17:34:42.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 81012447-9ccd-490d-bdba-257cb36c70eb response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47062024-09-25T17:34:43.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d8c75b16-5957-4cc9-9bdf-a775ae600a83 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47072024-09-25T17:34:43.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d8c75b16-5957-4cc9-9bdf-a775ae600a83 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47082024-09-25T17:34:43.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = d8c75b16-5957-4cc9-9bdf-a775ae600a83 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47092024-09-25T17:34:44.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a75c60db-42f6-4c8c-a0bb-93c4904f16b4 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47102024-09-25T17:34:44.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a75c60db-42f6-4c8c-a0bb-93c4904f16b4 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47112024-09-25T17:34:44.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a75c60db-42f6-4c8c-a0bb-93c4904f16b4 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47122024-09-25T17:34:45.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2349fe2b-e307-4d64-8d22-d7e8118439f0 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47132024-09-25T17:34:45.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2349fe2b-e307-4d64-8d22-d7e8118439f0 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47142024-09-25T17:34:45.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2349fe2b-e307-4d64-8d22-d7e8118439f0 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47152024-09-25T17:34:45.464ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = 8970f724-32c5-4f8f-9564-e0f668edfc37 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
47162024-09-25T17:34:46.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2364c1f4-794f-4b63-8de3-230a160491be roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47172024-09-25T17:34:46.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2364c1f4-794f-4b63-8de3-230a160491be resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47182024-09-25T17:34:46.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2364c1f4-794f-4b63-8de3-230a160491be response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47192024-09-25T17:34:47.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9695e1b1-4021-47a3-9ca5-30cea5353f12 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47202024-09-25T17:34:47.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9695e1b1-4021-47a3-9ca5-30cea5353f12 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47212024-09-25T17:34:47.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 9695e1b1-4021-47a3-9ca5-30cea5353f12 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47222024-09-25T17:34:48.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2a30c6b1-7fbd-4024-b54b-e2a9d3085a60 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47232024-09-25T17:34:48.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2a30c6b1-7fbd-4024-b54b-e2a9d3085a60 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47242024-09-25T17:34:48.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 2a30c6b1-7fbd-4024-b54b-e2a9d3085a60 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47252024-09-25T17:34:49.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0622860a-6c82-4ca1-bb4b-d55cd7f9adca roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47262024-09-25T17:34:49.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0622860a-6c82-4ca1-bb4b-d55cd7f9adca resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47272024-09-25T17:34:49.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0622860a-6c82-4ca1-bb4b-d55cd7f9adca response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47282024-09-25T17:34:50.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 008696eb-6429-43d4-a380-039c4702dcd5 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47292024-09-25T17:34:50.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 008696eb-6429-43d4-a380-039c4702dcd5 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47302024-09-25T17:34:50.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 008696eb-6429-43d4-a380-039c4702dcd5 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47312024-09-25T17:34:51.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f2badd44-c3bf-4359-8986-3fee18411c9c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47322024-09-25T17:34:51.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f2badd44-c3bf-4359-8986-3fee18411c9c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47332024-09-25T17:34:51.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f2badd44-c3bf-4359-8986-3fee18411c9c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
47342024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
47352024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
47362024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47372024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
47382024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
47392024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47402024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
47412024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47422024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
47432024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47442024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
47452024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
47462024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47472024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
47482024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
47492024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47502024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47512024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
47522024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
47532024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47542024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
47552024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47562024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47572024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
47582024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47592024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
47602024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
47612024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
47622024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47632024-09-25T17:34:51.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47642024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
47652024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
47662024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47672024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
47682024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47692024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47702024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47712024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
47722024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47732024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47742024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47752024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47762024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47772024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
47782024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47792024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
47802024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47812024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47822024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47832024-09-25T17:34:51.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47842024-09-25T17:34:51.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47852024-09-25T17:34:51.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47862024-09-25T17:34:51.492ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.520206ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47872024-09-25T17:34:51.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47882024-09-25T17:34:51.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47892024-09-25T17:34:51.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47902024-09-25T17:34:51.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47912024-09-25T17:34:51.495ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47922024-09-25T17:34:51.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47932024-09-25T17:34:51.497ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47942024-09-25T17:34:51.497ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2819, tv_nsec: 613222400 } })
47952024-09-25T17:34:51.498ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1051
47962024-09-25T17:34:51.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47972024-09-25T17:34:51.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47982024-09-25T17:34:51.498ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47992024-09-25T17:34:51.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48002024-09-25T17:34:51.499ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2819, tv_nsec: 615310649 } })
48012024-09-25T17:34:51.500ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1051
48022024-09-25T17:34:51.501ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48032024-09-25T17:34:51.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48042024-09-25T17:34:51.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48052024-09-25T17:34:51.502ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48062024-09-25T17:34:51.504ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f0d006a2-eb4a-4510-8a1c-6c144343343f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2819, tv_nsec: 620008036 } })
48072024-09-25T17:34:51.504ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1051 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
48082024-09-25T17:34:51.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48092024-09-25T17:34:51.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48102024-09-25T17:34:51.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48112024-09-25T17:34:51.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48122024-09-25T17:34:51.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48132024-09-25T17:34:51.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48142024-09-25T17:34:51.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48152024-09-25T17:34:51.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48162024-09-25T17:34:51.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48172024-09-25T17:34:51.534ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48182024-09-25T17:34:51.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48192024-09-25T17:34:51.539ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.470167ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
48202024-09-25T17:34:51.541ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48212024-09-25T17:34:51.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48222024-09-25T17:34:51.546ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48232024-09-25T17:34:51.546ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
48242024-09-25T17:34:51.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48252024-09-25T17:34:51.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48262024-09-25T17:34:51.548ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48272024-09-25T17:34:51.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48282024-09-25T17:34:51.550ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.683746ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48292024-09-25T17:34:51.554ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48302024-09-25T17:34:51.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48312024-09-25T17:34:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48322024-09-25T17:34:51.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48332024-09-25T17:34:51.556ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48342024-09-25T17:34:51.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48352024-09-25T17:34:51.557ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.720837ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
48362024-09-25T17:34:51.558ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
48372024-09-25T17:34:51.558ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.282916ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
48382024-09-25T17:34:51.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48392024-09-25T17:34:51.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48402024-09-25T17:34:51.559ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48412024-09-25T17:34:51.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48422024-09-25T17:34:51.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48432024-09-25T17:34:51.560ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48442024-09-25T17:34:51.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48452024-09-25T17:34:51.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48462024-09-25T17:34:51.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48472024-09-25T17:34:51.561ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48482024-09-25T17:34:51.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48492024-09-25T17:34:51.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
48502024-09-25T17:34:51.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48512024-09-25T17:34:51.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48522024-09-25T17:34:51.567ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48532024-09-25T17:34:51.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48542024-09-25T17:34:51.576ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
48552024-09-25T17:34:51.576ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.314472ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
48562024-09-25T17:34:51.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 92.640301ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
48572024-09-25T17:34:51.587ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
48582024-09-25T17:34:51.587ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48592024-09-25T17:34:51.587ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f876b3e7-0062-4a75-ba4a-6126ae14890d", "content-length": "26", "date": "Wed, 25 Sep 2024 17:34:50 GMT"} })
48602024-09-25T17:34:51.587ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48612024-09-25T17:34:51.588ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48622024-09-25T17:34:51.588ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
48632024-09-25T17:34:51.588ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48642024-09-25T17:34:51.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48652024-09-25T17:34:51.589ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48662024-09-25T17:34:51.591ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1059 zone_address = fd00:1122:3344:101::2
48672024-09-25T17:34:51.591ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48682024-09-25T17:34:51.592ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3b28a9ce-9cb7-49e1-b6ad-a23514e6e991", "content-length": "26", "date": "Wed, 25 Sep 2024 17:34:50 GMT"} })
48692024-09-25T17:34:51.592ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1064 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48702024-09-25T17:34:51.594ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48712024-09-25T17:34:51.599ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1059 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 zone_address = fd00:1122:3344:101::2
48722024-09-25T17:34:51.599ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48732024-09-25T17:34:51.599ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9c55ba89-69ec-47cd-bb7d-e1791a24735a", "content-length": "26", "date": "Wed, 25 Sep 2024 17:34:50 GMT"} })
48742024-09-25T17:34:51.599ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1064 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48752024-09-25T17:34:51.601ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1096 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
48762024-09-25T17:34:51.603ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48772024-09-25T17:34:51.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 117.320579ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
48782024-09-25T17:34:51.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f0d006a2-eb4a-4510-8a1c-6c144343343f, lookup_type: ById(f0d006a2-eb4a-4510-8a1c-6c144343343f) } result = Ok(())
48792024-09-25T17:34:51.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48802024-09-25T17:34:51.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48812024-09-25T17:34:51.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48822024-09-25T17:34:51.609ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 120.638071ms iteration = 20 status = 0
48832024-09-25T17:34:51.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 121.597658ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
48842024-09-25T17:34:51.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48852024-09-25T17:34:51.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48862024-09-25T17:34:51.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48872024-09-25T17:34:51.634ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48882024-09-25T17:34:51.634ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48892024-09-25T17:34:51.634ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.429011ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48902024-09-25T17:34:51.638ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48912024-09-25T17:34:51.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48922024-09-25T17:34:51.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48932024-09-25T17:34:51.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48942024-09-25T17:34:51.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48952024-09-25T17:34:51.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48962024-09-25T17:34:51.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48972024-09-25T17:34:51.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48982024-09-25T17:34:51.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48992024-09-25T17:34:51.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49002024-09-25T17:34:51.713ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 224.746884ms iteration = 23 status = {"physical_disks_added":0}
49012024-09-25T17:34:51.847ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
49022024-09-25T17:34:51.847ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "07fe26c2-f903-4aca-9c34-f6886c84ccb6", "content-length": "2", "date": "Wed, 25 Sep 2024 17:34:51 GMT"} })
49032024-09-25T17:34:51.849ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49042024-09-25T17:34:51.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49052024-09-25T17:34:51.851ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 363.120053ms iteration = 20 status = null
49062024-09-25T17:34:51.858ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 369.36961ms iteration = 20 status = {}
49072024-09-25T17:34:51.876ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49082024-09-25T17:34:51.889ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49092024-09-25T17:34:51.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49102024-09-25T17:34:51.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49112024-09-25T17:34:51.907ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: 6e5d68bf-01bc-412c-9915-3ad6fd435156, rack_id: 5c1bad99-30b8-419d-9695-a982a6249225, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5d8104c-5830-4cb9-9490-d372d8c75371) } rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
49122024-09-25T17:34:51.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49132024-09-25T17:34:51.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49142024-09-25T17:34:51.916ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
49152024-09-25T17:34:51.917ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b14f6869-617c-4951-8143-9a0d859e5be5", "content-length": "121", "date": "Wed, 25 Sep 2024 17:34:51 GMT"} })
49162024-09-25T17:34:51.917ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
49172024-09-25T17:34:51.917ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5d8104c-5830-4cb9-9490-d372d8c75371
49182024-09-25T17:34:51.917ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49192024-09-25T17:34:51.917ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49202024-09-25T17:34:51.917ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
49212024-09-25T17:34:51.917ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 routes = {}
49222024-09-25T17:34:51.917ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225
49232024-09-25T17:34:51.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49242024-09-25T17:34:51.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49252024-09-25T17:34:51.919ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
49262024-09-25T17:34:51.919ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8ba58939-33ea-4d69-a83a-0372c3ae0cc0", "content-length": "2", "date": "Wed, 25 Sep 2024 17:34:51 GMT"} })
49272024-09-25T17:34:51.919ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
49282024-09-25T17:34:51.919ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "797c7845-96a4-4415-aa5a-6017af611fa3", "content-length": "52", "date": "Wed, 25 Sep 2024 17:34:51 GMT"} })
49292024-09-25T17:34:51.919ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch_location = Switch0
49302024-09-25T17:34:51.919ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49312024-09-25T17:34:51.957ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "547a08b6-5dc2-40b2-844c-ad6174b53a26", "content-length": "372", "date": "Wed, 25 Sep 2024 17:34:51 GMT"} })
49322024-09-25T17:34:51.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49332024-09-25T17:34:51.957ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "190190b4-1124-4820-b5d7-8c52d30ec17e", "content-length": "691", "date": "Wed, 25 Sep 2024 17:34:51 GMT"} })
49342024-09-25T17:34:51.957ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
49352024-09-25T17:34:51.957ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
49362024-09-25T17:34:51.957ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
49372024-09-25T17:34:51.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49382024-09-25T17:34:51.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49392024-09-25T17:34:51.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49402024-09-25T17:34:51.960ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 471.435385ms iteration = 21 status = {}
49412024-09-25T17:34:51.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49422024-09-25T17:34:51.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49432024-09-25T17:34:51.965ZDEBGnexus (BackgroundTasks): client request SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49442024-09-25T17:34:51.966ZDEBGnexus (BackgroundTasks): client response SledAgent = f0d006a2-eb4a-4510-8a1c-6c144343343f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "89281191-9b34-42ef-8b78-fe4015d9d12d", "date": "Wed, 25 Sep 2024 17:34:51 GMT"} })
49452024-09-25T17:34:51.968ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 479.708239ms iteration = 22 status = {}
49462024-09-25T17:34:52.054ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cb6cd1fc-4d5b-4eb9-a00f-cbbf8313a6bd", "date": "Wed, 25 Sep 2024 17:34:51 GMT"} })
49472024-09-25T17:34:52.054ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 switch = Switch0
49482024-09-25T17:34:52.054ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49492024-09-25T17:34:52.054ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5c1bad99-30b8-419d-9695-a982a6249225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bf218cfd-b227-4574-82ad-e5e0d17f7201", "content-length": "667", "date": "Wed, 25 Sep 2024 17:34:51 GMT"} })
49502024-09-25T17:34:52.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49512024-09-25T17:34:52.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49522024-09-25T17:34:52.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49532024-09-25T17:34:52.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49542024-09-25T17:34:52.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49552024-09-25T17:34:52.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49562024-09-25T17:34:52.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49572024-09-25T17:34:52.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49582024-09-25T17:34:52.069ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 580.92896ms iteration = 20 status = {}
49592024-09-25T17:34:52.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = eae4de01-ab7e-4df5-a4ee-a9a5b048f627 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49602024-09-25T17:34:52.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = eae4de01-ab7e-4df5-a4ee-a9a5b048f627 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49612024-09-25T17:34:52.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = eae4de01-ab7e-4df5-a4ee-a9a5b048f627 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49622024-09-25T17:34:53.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 98b41f36-df03-4044-b483-f00155395ccb roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49632024-09-25T17:34:53.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 98b41f36-df03-4044-b483-f00155395ccb resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49642024-09-25T17:34:53.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 98b41f36-df03-4044-b483-f00155395ccb response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49652024-09-25T17:34:54.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 569e00b3-3b5a-4588-ba06-9655bbbc5da7 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49662024-09-25T17:34:54.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 569e00b3-3b5a-4588-ba06-9655bbbc5da7 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49672024-09-25T17:34:54.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 569e00b3-3b5a-4588-ba06-9655bbbc5da7 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49682024-09-25T17:34:55.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 335e31d0-cb54-4591-a7c8-a8aa1ffb5a04 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49692024-09-25T17:34:55.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 335e31d0-cb54-4591-a7c8-a8aa1ffb5a04 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49702024-09-25T17:34:55.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 335e31d0-cb54-4591-a7c8-a8aa1ffb5a04 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49712024-09-25T17:34:55.464ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1548 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = fa42e6c9-1092-4653-9b9d-8b7978bcac11 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
49722024-09-25T17:34:56.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1dfa6ea3-3671-4e97-8a68-14508a0890af roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49732024-09-25T17:34:56.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1dfa6ea3-3671-4e97-8a68-14508a0890af resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49742024-09-25T17:34:56.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1dfa6ea3-3671-4e97-8a68-14508a0890af response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49752024-09-25T17:34:57.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dff7f250-6c5f-4362-a27c-fb74c26e32e4 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49762024-09-25T17:34:57.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dff7f250-6c5f-4362-a27c-fb74c26e32e4 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49772024-09-25T17:34:57.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2265 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = dff7f250-6c5f-4362-a27c-fb74c26e32e4 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49782024-09-25T17:34:58.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7af0fd27-2a48-4b19-99da-c539147fe52f roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49792024-09-25T17:34:58.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7af0fd27-2a48-4b19-99da-c539147fe52f resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49802024-09-25T17:34:58.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 7af0fd27-2a48-4b19-99da-c539147fe52f response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49812024-09-25T17:34:59.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b88828a4-b64e-42e7-b7cb-d010ed481325 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49822024-09-25T17:34:59.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b88828a4-b64e-42e7-b7cb-d010ed481325 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49832024-09-25T17:34:59.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = b88828a4-b64e-42e7-b7cb-d010ed481325 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49842024-09-25T17:35:00.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cb48ab65-dc41-4125-a629-25300b22952d roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49852024-09-25T17:35:00.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cb48ab65-dc41-4125-a629-25300b22952d resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49862024-09-25T17:35:00.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = cb48ab65-dc41-4125-a629-25300b22952d response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
49872024-09-25T17:35:01.488ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
49882024-09-25T17:35:01.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49892024-09-25T17:35:01.488ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
49902024-09-25T17:35:01.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49912024-09-25T17:35:01.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49922024-09-25T17:35:01.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49932024-09-25T17:35:01.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49942024-09-25T17:35:01.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49952024-09-25T17:35:01.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49962024-09-25T17:35:01.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49972024-09-25T17:35:01.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49982024-09-25T17:35:01.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49992024-09-25T17:35:01.497ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50002024-09-25T17:35:01.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa, lookup_type: ById(9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa) } result = Ok(())
50012024-09-25T17:35:01.499ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50022024-09-25T17:35:01.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50032024-09-25T17:35:01.506ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa original_time_created = 2024-09-25 17:25:00.941959 UTC target_id = 9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa time_created = 2024-09-25 17:25:00.941959 UTC
50042024-09-25T17:35:01.506ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.788329ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9b104cb0-9b78-4cf9-b1ba-0ef6ebb98afa","time_created":"2024-09-25T17:25:00.941959Z"}
50052024-09-25T17:35:01.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 88d07a5d-0199-49c5-87a8-2cc8fb4088f2 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50062024-09-25T17:35:01.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 88d07a5d-0199-49c5-87a8-2cc8fb4088f2 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50072024-09-25T17:35:01.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 88d07a5d-0199-49c5-87a8-2cc8fb4088f2 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50082024-09-25T17:35:01.513ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50092024-09-25T17:35:01.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50102024-09-25T17:35:01.515ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 26.973191ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50112024-09-25T17:35:02.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f30f47fb-21e8-4c2e-bdfc-b7d40420af1f roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50122024-09-25T17:35:02.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f30f47fb-21e8-4c2e-bdfc-b7d40420af1f resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50132024-09-25T17:35:02.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2622 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = f30f47fb-21e8-4c2e-bdfc-b7d40420af1f response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50142024-09-25T17:35:03.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 10e137f8-7491-4562-90b5-c8bbc2f3eec1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
50152024-09-25T17:35:03.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 10e137f8-7491-4562-90b5-c8bbc2f3eec1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
50162024-09-25T17:35:03.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:42315 req_id = 10e137f8-7491-4562-90b5-c8bbc2f3eec1 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
50172024-09-25T17:35:03.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 262cf12a-ce5e-4ef7-98f4-de0cdeda3325 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50182024-09-25T17:35:03.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 262cf12a-ce5e-4ef7-98f4-de0cdeda3325 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50192024-09-25T17:35:03.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 262cf12a-ce5e-4ef7-98f4-de0cdeda3325 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50202024-09-25T17:35:04.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0fc1e818-ac64-41d8-bda4-c059016e209c roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50212024-09-25T17:35:04.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0fc1e818-ac64-41d8-bda4-c059016e209c resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50222024-09-25T17:35:04.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2433 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 0fc1e818-ac64-41d8-bda4-c059016e209c response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50232024-09-25T17:35:05.464ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1518 local_addr = [fd00:1122:3344:101::c]:42795 method = GET remote_addr = [fd00:1122:3344:101::d]:39644 req_id = c644b4f7-cffd-4ab2-8e0a-3eb454525222 response_code = 200 uri = /2fc249d5-9788-4a35-ad94-1440f36e8698
50242024-09-25T17:35:05.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fc3d2bda-f286-485b-bfe3-11adb06014d3 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50252024-09-25T17:35:05.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fc3d2bda-f286-485b-bfe3-11adb06014d3 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50262024-09-25T17:35:05.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = fc3d2bda-f286-485b-bfe3-11adb06014d3 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50272024-09-25T17:35:06.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1dda1d45-5c1b-4c25-9dd8-a6eb253d5e03 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50282024-09-25T17:35:06.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1dda1d45-5c1b-4c25-9dd8-a6eb253d5e03 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50292024-09-25T17:35:06.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = 1dda1d45-5c1b-4c25-9dd8-a6eb253d5e03 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50302024-09-25T17:35:07.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a8d2b3fc-f497-4a2c-ad28-d88bf9c14e78 roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50312024-09-25T17:35:07.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a8d2b3fc-f497-4a2c-ad28-d88bf9c14e78 resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50322024-09-25T17:35:07.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a8d2b3fc-f497-4a2c-ad28-d88bf9c14e78 response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50332024-09-25T17:35:08.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a6f382a9-5d2d-4b3f-b29c-1ad18c2b576e roles = RoleSet { roles: {} } uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50342024-09-25T17:35:08.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a6f382a9-5d2d-4b3f-b29c-1ad18c2b576e resource = Database result = Ok(()) uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f
50352024-09-25T17:35:08.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39232 req_id = a6f382a9-5d2d-4b3f-b29c-1ad18c2b576e response_code = 200 uri = /probes/f0d006a2-eb4a-4510-8a1c-6c144343343f