Max level shown:
12025-07-29T19:00:04.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7d4ef4d3-5774-4d4b-be01-2a8808b1daed roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
22025-07-29T19:00:04.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7d4ef4d3-5774-4d4b-be01-2a8808b1daed resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
32025-07-29T19:00:04.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7d4ef4d3-5774-4d4b-be01-2a8808b1daed response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
42025-07-29T19:00:05.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = e29749b5-dfc9-4208-a371-1ff29e55f74f roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
52025-07-29T19:00:05.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = e29749b5-dfc9-4208-a371-1ff29e55f74f resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
62025-07-29T19:00:05.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = e29749b5-dfc9-4208-a371-1ff29e55f74f response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
72025-07-29T19:00:05.627ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 573 local_addr = [fd00:1122:3344:101::c]:51026 method = GET remote_addr = [fd00:1122:3344:101::d]:61933 req_id = d617d6f4-3b73-4b83-bb23-506f2a10839e response_code = 200 uri = /90ad0cc8-96db-48ff-b8fa-3f4895896eed
82025-07-29T19:00:06.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4fc9a207-7845-4e1f-a8c8-53718757869e roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
92025-07-29T19:00:06.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4fc9a207-7845-4e1f-a8c8-53718757869e resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
102025-07-29T19:00:06.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4fc9a207-7845-4e1f-a8c8-53718757869e response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
112025-07-29T19:00:06.841ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 142 reason = Timeout
122025-07-29T19:00:06.841ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
132025-07-29T19:00:06.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
142025-07-29T19:00:06.843ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
152025-07-29T19:00:06.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
162025-07-29T19:00:06.845ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
172025-07-29T19:00:06.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
182025-07-29T19:00:06.847ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
192025-07-29T19:00:06.847ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.606974ms iteration = 142 status = {"chicken_switches_updated":false}
202025-07-29T19:00:06.910ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a904f883-2ab0-426c-b151-6e152497958a remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 459769bd-856e-4156-8d8c-3252bacf022d uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-07-29T19:00:06.898421011Z }
212025-07-29T19:00:06.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 459769bd-856e-4156-8d8c-3252bacf022d roles = RoleSet { roles: {} } uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
222025-07-29T19:00:06.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 459769bd-856e-4156-8d8c-3252bacf022d resource = Database result = Ok(()) uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
232025-07-29T19:00:06.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 33082 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 459769bd-856e-4156-8d8c-3252bacf022d response_code = 204 uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
242025-07-29T19:00:06.970ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a904f883-2ab0-426c-b151-6e152497958a remote_addr = [fd00:1122:3344:101::1]:43478 req_id = dea092ae-815e-4318-a8ec-658678a8eb5c uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-07-29T19:00:06.970009709Z }
252025-07-29T19:00:06.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = dea092ae-815e-4318-a8ec-658678a8eb5c roles = RoleSet { roles: {} } uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
262025-07-29T19:00:06.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = dea092ae-815e-4318-a8ec-658678a8eb5c resource = Database result = Ok(()) uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
272025-07-29T19:00:07.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 50219 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = dea092ae-815e-4318-a8ec-658678a8eb5c response_code = 204 uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
282025-07-29T19:00:07.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 93ac098f-5a92-4caa-a86d-397e8e2ac730 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
292025-07-29T19:00:07.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 93ac098f-5a92-4caa-a86d-397e8e2ac730 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
302025-07-29T19:00:07.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 93ac098f-5a92-4caa-a86d-397e8e2ac730 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
312025-07-29T19:00:08.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3f07d2e3-f8fb-47bd-b0da-5dc0c9042c28 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
322025-07-29T19:00:08.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3f07d2e3-f8fb-47bd-b0da-5dc0c9042c28 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
332025-07-29T19:00:08.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3f07d2e3-f8fb-47bd-b0da-5dc0c9042c28 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
342025-07-29T19:00:09.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = ad36a2cd-9034-44d5-bd54-d472f840bfe2 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
352025-07-29T19:00:09.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = ad36a2cd-9034-44d5-bd54-d472f840bfe2 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
362025-07-29T19:00:09.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = ad36a2cd-9034-44d5-bd54-d472f840bfe2 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
372025-07-29T19:00:10.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b0fbb9cd-b0b9-4250-b08d-65ebd4ee55f2 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
382025-07-29T19:00:10.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b0fbb9cd-b0b9-4250-b08d-65ebd4ee55f2 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
392025-07-29T19:00:10.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b0fbb9cd-b0b9-4250-b08d-65ebd4ee55f2 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
402025-07-29T19:00:11.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f900b3fb-ec6c-4073-a919-0cd4bdc32684 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
412025-07-29T19:00:11.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f900b3fb-ec6c-4073-a919-0cd4bdc32684 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
422025-07-29T19:00:11.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 6151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f900b3fb-ec6c-4073-a919-0cd4bdc32684 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
432025-07-29T19:00:11.841ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
442025-07-29T19:00:11.841ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
452025-07-29T19:00:11.841ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
462025-07-29T19:00:11.841ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 143 reason = Timeout
472025-07-29T19:00:11.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
482025-07-29T19:00:11.841ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
492025-07-29T19:00:11.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
502025-07-29T19:00:11.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
512025-07-29T19:00:11.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
522025-07-29T19:00:11.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
532025-07-29T19:00:11.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
542025-07-29T19:00:11.844ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
552025-07-29T19:00:11.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
562025-07-29T19:00:11.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.463372ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
572025-07-29T19:00:11.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
582025-07-29T19:00:11.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
592025-07-29T19:00:11.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
602025-07-29T19:00:11.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
612025-07-29T19:00:11.848ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
622025-07-29T19:00:11.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
632025-07-29T19:00:11.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
642025-07-29T19:00:11.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
652025-07-29T19:00:11.850ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
662025-07-29T19:00:11.850ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.782065ms iteration = 143 status = {"chicken_switches_updated":false}
672025-07-29T19:00:11.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
682025-07-29T19:00:11.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0a28dc16-a065-459e-b1aa-d53bcbda4625, lookup_type: ById(0a28dc16-a065-459e-b1aa-d53bcbda4625) } result = Ok(())
692025-07-29T19:00:11.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
702025-07-29T19:00:11.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
712025-07-29T19:00:11.865ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 original_time_created = 2025-07-29 18:48:16.280373 UTC target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 time_created = 2025-07-29 18:48:16.280373 UTC
722025-07-29T19:00:11.865ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.710269ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0a28dc16-a065-459e-b1aa-d53bcbda4625","time_created":"2025-07-29T18:48:16.280373Z"}
732025-07-29T19:00:12.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a8e60b0e-ec9a-4bfb-8e76-85a20e4d2e4a roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
742025-07-29T19:00:12.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a8e60b0e-ec9a-4bfb-8e76-85a20e4d2e4a resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
752025-07-29T19:00:12.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a8e60b0e-ec9a-4bfb-8e76-85a20e4d2e4a response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
762025-07-29T19:00:13.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 50ef6688-f719-4837-b3ab-c88617fa7375 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
772025-07-29T19:00:13.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 50ef6688-f719-4837-b3ab-c88617fa7375 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
782025-07-29T19:00:13.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 50ef6688-f719-4837-b3ab-c88617fa7375 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
792025-07-29T19:00:14.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 5c486ac8-4264-48a6-8a5c-3a52e4b72e14 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
802025-07-29T19:00:14.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 5c486ac8-4264-48a6-8a5c-3a52e4b72e14 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
812025-07-29T19:00:14.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 5c486ac8-4264-48a6-8a5c-3a52e4b72e14 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
822025-07-29T19:00:15.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 0759c38f-277e-4338-9b9e-a8c3010c735c roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
832025-07-29T19:00:15.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 0759c38f-277e-4338-9b9e-a8c3010c735c resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
842025-07-29T19:00:15.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 0759c38f-277e-4338-9b9e-a8c3010c735c response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
852025-07-29T19:00:15.628ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 877 local_addr = [fd00:1122:3344:101::c]:51026 method = GET remote_addr = [fd00:1122:3344:101::d]:61933 req_id = dafc1895-f05d-488a-89ca-81e8c45d2a7a response_code = 200 uri = /90ad0cc8-96db-48ff-b8fa-3f4895896eed
862025-07-29T19:00:15.852ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a904f883-2ab0-426c-b151-6e152497958a remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4c03fa72-0b50-4b34-bd1d-f72cff56ff19 uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-07-29T19:00:15.852437962Z }
872025-07-29T19:00:15.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4c03fa72-0b50-4b34-bd1d-f72cff56ff19 roles = RoleSet { roles: {} } uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
882025-07-29T19:00:15.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4c03fa72-0b50-4b34-bd1d-f72cff56ff19 resource = Database result = Ok(()) uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
892025-07-29T19:00:15.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 48561 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4c03fa72-0b50-4b34-bd1d-f72cff56ff19 response_code = 204 uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
902025-07-29T19:00:16.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b0973280-28aa-49bb-b5cc-55eaa8baf03d roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
912025-07-29T19:00:16.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b0973280-28aa-49bb-b5cc-55eaa8baf03d resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
922025-07-29T19:00:16.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b0973280-28aa-49bb-b5cc-55eaa8baf03d response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
932025-07-29T19:00:16.841ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 144 reason = Timeout
942025-07-29T19:00:16.841ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
952025-07-29T19:00:16.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
962025-07-29T19:00:16.842ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
972025-07-29T19:00:16.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
982025-07-29T19:00:16.846ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
992025-07-29T19:00:16.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
1002025-07-29T19:00:16.847ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
1012025-07-29T19:00:16.847ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.913443ms iteration = 144 status = {"chicken_switches_updated":false}
1022025-07-29T19:00:17.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7b304ac3-10bf-4251-ab15-c5d62f5dbdbe roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
1032025-07-29T19:00:17.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7b304ac3-10bf-4251-ab15-c5d62f5dbdbe resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
1042025-07-29T19:00:17.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2768 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7b304ac3-10bf-4251-ab15-c5d62f5dbdbe response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
1052025-07-29T19:00:18.358ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a904f883-2ab0-426c-b151-6e152497958a remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-07-29T19:00:15.901611585Z }
1062025-07-29T19:00:18.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f roles = RoleSet { roles: {} } uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1072025-07-29T19:00:18.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f resource = Database result = Ok(()) uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1082025-07-29T19:00:18.374ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = a904f883-2ab0-426c-b151-6e152497958a remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a vmm_needs_update = true
1092025-07-29T19:00:18.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f roles = RoleSet { roles: {} } uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1102025-07-29T19:00:18.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f resource = Database result = Ok(()) uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1112025-07-29T19:00:18.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f roles = RoleSet { roles: {} } uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1122025-07-29T19:00:18.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f resource = Database result = Ok(()) uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1132025-07-29T19:00:18.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f roles = RoleSet { roles: {} } uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1142025-07-29T19:00:18.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f resource = Database result = Ok(()) uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1152025-07-29T19:00:18.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f roles = RoleSet { roles: {} } uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1162025-07-29T19:00:18.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f resource = Database result = Ok(()) uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1172025-07-29T19:00:18.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f roles = RoleSet { roles: {} } uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1182025-07-29T19:00:18.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f resource = Database result = Ok(()) uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1192025-07-29T19:00:18.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f roles = RoleSet { roles: {} } uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1202025-07-29T19:00:18.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f resource = Database result = Ok(()) uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1212025-07-29T19:00:18.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1222025-07-29T19:00:18.392ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7849f1ec-cda6-460a-927c-8287cd3fb888, lookup_type: ById(7849f1ec-cda6-460a-927c-8287cd3fb888) }, key: a9bae9b2-13b6-4a2a-a1e5-3dff51f2bc22, lookup_type: ById(a9bae9b2-13b6-4a2a-a1e5-3dff51f2bc22) }, key: 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d, lookup_type: ById(11f79a57-5ad1-4bc4-87b8-a00b7ba5624d) } result = Ok(()) uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1232025-07-29T19:00:18.403ZINFOnexus (dropshot_internal): starting update saga for 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1603 instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-07-29T19:00:15.901611585Z }
1242025-07-29T19:00:18.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 49500 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f response_code = 204 uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1252025-07-29T19:00:18.410ZDEBGnexus (dropshot_internal): preparing instance-update saga for 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 32954d9f-471b-4cb6-a18b-f8a161309d1f uri = /vmms/a904f883-2ab0-426c-b151-6e152497958a
1262025-07-29T19:00:18.410ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update
1272025-07-29T19:00:18.412ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"11f79a57-5ad1-4bc4-87b8-a00b7ba5624d","lookup_type":{"ById":"11f79a57-5ad1-4bc4-87b8-a00b7ba5624d"},"parent":{"key":"a9bae9b2-13b6-4a2a-a1e5-3dff51f2bc22","lookup_type":{"ById":"a9bae9b2-13b6-4a2a-a1e5-3dff51f2bc22"},"parent":{"key":"7849f1ec-cda6-460a-927c-8287cd3fb888","lookup_type":{"ById":"7849f1ec-cda6-460a-927c-8287cd3fb888"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1282025-07-29T19:00:18.416ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update
1292025-07-29T19:00:18.459ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update
1302025-07-29T19:00:18.459ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1312025-07-29T19:00:18.462ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1322025-07-29T19:00:18.462ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726
1332025-07-29T19:00:18.467ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1342025-07-29T19:00:18.467ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726
1352025-07-29T19:00:18.474ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1362025-07-29T19:00:18.474ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726
1372025-07-29T19:00:18.484ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1382025-07-29T19:00:18.484ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("1e6abbfc-71b4-4d97-ab60-3ab04a8ed4c0")) node_id = 0 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726
1392025-07-29T19:00:18.489ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1402025-07-29T19:00:18.490ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726
1412025-07-29T19:00:18.510ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update
1422025-07-29T19:00:18.510ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1432025-07-29T19:00:18.510ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1442025-07-29T19:00:18.512ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1452025-07-29T19:00:18.513ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1462025-07-29T19:00:18.514ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1472025-07-29T19:00:18.514ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1482025-07-29T19:00:18.516ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1492025-07-29T19:00:18.516ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1502025-07-29T19:00:18.518ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1512025-07-29T19:00:18.518ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1522025-07-29T19:00:18.519ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1532025-07-29T19:00:18.520ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1542025-07-29T19:00:18.521ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1552025-07-29T19:00:18.524ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7849f1ec-cda6-460a-927c-8287cd3fb888, lookup_type: ById(7849f1ec-cda6-460a-927c-8287cd3fb888) }, key: a9bae9b2-13b6-4a2a-a1e5-3dff51f2bc22, lookup_type: ById(a9bae9b2-13b6-4a2a-a1e5-3dff51f2bc22) }, key: 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d, lookup_type: ById(11f79a57-5ad1-4bc4-87b8-a00b7ba5624d) } result = Ok(()) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1562025-07-29T19:00:18.524ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance updater_id = 1e6abbfc-71b4-4d97-ab60-3ab04a8ed4c0
1572025-07-29T19:00:18.524ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1582025-07-29T19:00:18.524ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1592025-07-29T19:00:18.542ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance updater_id = 1e6abbfc-71b4-4d97-ab60-3ab04a8ed4c0
1602025-07-29T19:00:18.542ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1612025-07-29T19:00:18.542ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance
1622025-07-29T19:00:18.546ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d locked_gen = Generation(Generation(2)) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = LockInstance updater_id = 1e6abbfc-71b4-4d97-ab60-3ab04a8ed4c0
1632025-07-29T19:00:18.550ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1642025-07-29T19:00:18.550ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("1e6abbfc-71b4-4d97-ab60-3ab04a8ed4c0")}) node_id = 1 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726
1652025-07-29T19:00:18.556ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1662025-07-29T19:00:18.556ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726
1672025-07-29T19:00:18.562ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
1682025-07-29T19:00:18.563ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
1692025-07-29T19:00:18.564ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
1702025-07-29T19:00:18.564ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
1712025-07-29T19:00:18.565ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
1722025-07-29T19:00:18.566ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
1732025-07-29T19:00:18.567ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
1742025-07-29T19:00:18.570ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7849f1ec-cda6-460a-927c-8287cd3fb888, lookup_type: ById(7849f1ec-cda6-460a-927c-8287cd3fb888) }, key: a9bae9b2-13b6-4a2a-a1e5-3dff51f2bc22, lookup_type: ById(a9bae9b2-13b6-4a2a-a1e5-3dff51f2bc22) }, key: 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d, lookup_type: ById(11f79a57-5ad1-4bc4-87b8-a00b7ba5624d) } result = Ok(()) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
1752025-07-29T19:00:18.570ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
1762025-07-29T19:00:18.571ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
1772025-07-29T19:00:18.579ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: a904f883-2ab0-426c-b151-6e152497958a, time_created: 2025-07-29T18:59:57.645641Z, time_deleted: None, instance_id: 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d, sled_id: 9c9e9bac-4b96-4da6-bd17-bdedf998a5df, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-07-29T19:00:15.901611Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-07-29T18:59:55.406334Z, gen: Generation(Generation(3)), propolis_id: Some(a904f883-2ab0-426c-b151-6e152497958a), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(a904f883-2ab0-426c-b151-6e152497958a (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-07-29T19:00:18.576748843Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
1782025-07-29T19:00:18.581ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
1792025-07-29T19:00:18.584ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"11f79a57-5ad1-4bc4-87b8-a00b7ba5624d","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"a904f883-2ab0-426c-b151-6e152497958a"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"11f79a57-5ad1-4bc4-87b8-a00b7ba5624d","lookup_type":{"ById":"11f79a57-5ad1-4bc4-87b8-a00b7ba5624d"},"parent":{"key":"a9bae9b2-13b6-4a2a-a1e5-3dff51f2bc22","lookup_type":{"ById":"a9bae9b2-13b6-4a2a-a1e5-3dff51f2bc22"},"parent":{"key":"7849f1ec-cda6-460a-927c-8287cd3fb888","lookup_type":{"ById":"7849f1ec-cda6-460a-927c-8287cd3fb888"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"1e6abbfc-71b4-4d97-ab60-3ab04a8ed4c0"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"a9bae9b2-13b6-4a2a-a1e5-3dff51f2bc22","ram_diff":1073741824},"destroy_active_vmm":"a904f883-2ab0-426c-b151-6e152497958a","destroy_target_vmm":null,"network_config":"Delete","new_intent":null,"new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-07-29T19:00:18.576748843Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1802025-07-29T19:00:18.584ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
1812025-07-29T19:00:18.588ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
1822025-07-29T19:00:18.588ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1832025-07-29T19:00:18.588ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1842025-07-29T19:00:18.588ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
1852025-07-29T19:00:18.591ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1862025-07-29T19:00:18.591ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
1872025-07-29T19:00:18.595ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1882025-07-29T19:00:18.595ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
1892025-07-29T19:00:18.598ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1902025-07-29T19:00:18.598ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("1eee6877-c168-45a0-92c8-b37631e08f78")) node_id = 0 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
1912025-07-29T19:00:18.602ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1922025-07-29T19:00:18.602ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
1932025-07-29T19:00:18.607ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d parent_lock = UpdaterLock { updater_id: 1e6abbfc-71b4-4d97-ab60-3ab04a8ed4c0, locked_gen: Generation(Generation(2)) } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
1942025-07-29T19:00:18.607ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = BecomeUpdater
1952025-07-29T19:00:18.608ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = BecomeUpdater
1962025-07-29T19:00:18.619ZDEBGnexus (SagaExecutor): inherited lock from 1e6abbfc-71b4-4d97-ab60-3ab04a8ed4c0 to 1eee6877-c168-45a0-92c8-b37631e08f78 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 1e6abbfc-71b4-4d97-ab60-3ab04a8ed4c0 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = BecomeUpdater updater_id = 1eee6877-c168-45a0-92c8-b37631e08f78
1972025-07-29T19:00:18.619ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:987 instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
1982025-07-29T19:00:18.619ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
1992025-07-29T19:00:18.619ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("1eee6877-c168-45a0-92c8-b37631e08f78")}) node_id = 1 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2002025-07-29T19:00:18.622ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2012025-07-29T19:00:18.622ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2022025-07-29T19:00:18.626ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2032025-07-29T19:00:18.626ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2042025-07-29T19:00:18.629ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2052025-07-29T19:00:18.629ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2062025-07-29T19:00:18.633ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1040 instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
2072025-07-29T19:00:18.636ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d
2082025-07-29T19:00:18.638ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = UpdateNetworkConfig
2092025-07-29T19:00:18.639ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = UpdateNetworkConfig
2102025-07-29T19:00:18.641ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = UpdateNetworkConfig
2112025-07-29T19:00:18.641ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = UpdateNetworkConfig
2122025-07-29T19:00:18.643ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
2132025-07-29T19:00:18.643ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = UpdateNetworkConfig
2142025-07-29T19:00:18.644ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = UpdateNetworkConfig
2152025-07-29T19:00:18.645ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
2162025-07-29T19:00:18.645ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
2172025-07-29T19:00:18.645ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
2182025-07-29T19:00:18.647ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
2192025-07-29T19:00:18.648ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
2202025-07-29T19:00:18.648ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
2212025-07-29T19:00:18.648ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
2222025-07-29T19:00:18.655ZDEBGnexus: notifying dendrite of updates instance_id = Some(11f79a57-5ad1-4bc4-87b8-a00b7ba5624d (instance)) switch = switch0
2232025-07-29T19:00:18.655ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1763, tv_nsec: 997878719 } })
2242025-07-29T19:00:18.656ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1186
2252025-07-29T19:00:18.691ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
2262025-07-29T19:00:18.691ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2272025-07-29T19:00:18.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f5a75d20-5994-47c3-b133-e8db10de6604 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
2282025-07-29T19:00:18.692ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d717272-d229-4621-933a-2adb1d9f9e21", "content-length": "26", "date": "Tue, 29 Jul 2025 19:00:18 GMT"} })
2292025-07-29T19:00:18.692ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2302025-07-29T19:00:18.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f5a75d20-5994-47c3-b133-e8db10de6604 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
2312025-07-29T19:00:18.693ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2322025-07-29T19:00:18.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f5a75d20-5994-47c3-b133-e8db10de6604 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
2332025-07-29T19:00:18.724ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2342025-07-29T19:00:18.724ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2352025-07-29T19:00:18.728ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2362025-07-29T19:00:18.728ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2372025-07-29T19:00:18.738ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
2382025-07-29T19:00:18.738ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
2392025-07-29T19:00:18.750ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1115 instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-07-29T19:00:18.739623Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 7849f1ec-cda6-460a-927c-8287cd3fb888, time_modified: Some(2025-07-29T19:00:18.739623Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: a9bae9b2-13b6-4a2a-a1e5-3dff51f2bc22, time_modified: Some(2025-07-29T19:00:18.739623Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
2402025-07-29T19:00:18.750ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2412025-07-29T19:00:18.750ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2422025-07-29T19:00:18.754ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2432025-07-29T19:00:18.754ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2442025-07-29T19:00:18.757ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1150 instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
2452025-07-29T19:00:18.757ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = UnassignOximeterProducer
2462025-07-29T19:00:18.757ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = UnassignOximeterProducer
2472025-07-29T19:00:18.761ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = b7eba1f4-771d-464b-b239-7b11b0c8ccfd producer_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
2482025-07-29T19:00:18.761ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = UnassignOximeterProducer
2492025-07-29T19:00:18.762ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = UnassignOximeterProducer
2502025-07-29T19:00:18.796ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
2512025-07-29T19:00:18.796ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/11f79a57-5ad1-4bc4-87b8-a00b7ba5624d
2522025-07-29T19:00:18.820ZDEBGnexus (SagaExecutor): client response oximeter-collector = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/11f79a57-5ad1-4bc4-87b8-a00b7ba5624d", status: 204, headers: {"x-request-id": "0e937b87-2df8-4966-8181-bfeb0164b71d", "date": "Tue, 29 Jul 2025 19:00:18 GMT"} }) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
2532025-07-29T19:00:18.820ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = b7eba1f4-771d-464b-b239-7b11b0c8ccfd producer_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
2542025-07-29T19:00:18.821ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2552025-07-29T19:00:18.821ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2562025-07-29T19:00:18.825ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2572025-07-29T19:00:18.825ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2582025-07-29T19:00:18.829ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d lock = UpdaterLock { updater_id: 1eee6877-c168-45a0-92c8-b37631e08f78, locked_gen: Generation(Generation(3)) } new_intent = None new_runtime = InstanceRuntimeState { time_updated: 2025-07-29T19:00:18.576748843Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
2592025-07-29T19:00:18.829ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = CommitInstanceUpdates
2602025-07-29T19:00:18.829ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = CommitInstanceUpdates
2612025-07-29T19:00:18.934ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1201 instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d new_runtime = InstanceRuntimeState { time_updated: 2025-07-29T19:00:18.576748843Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
2622025-07-29T19:00:18.934ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
2632025-07-29T19:00:18.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2642025-07-29T19:00:18.934ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2652025-07-29T19:00:18.934ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2662025-07-29T19:00:18.934ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
2672025-07-29T19:00:18.934ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
2682025-07-29T19:00:18.934ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2692025-07-29T19:00:18.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2702025-07-29T19:00:18.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2712025-07-29T19:00:18.937ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2722025-07-29T19:00:18.939ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2732025-07-29T19:00:18.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2742025-07-29T19:00:18.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2752025-07-29T19:00:18.940ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2762025-07-29T19:00:18.940ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2772025-07-29T19:00:18.941ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2782025-07-29T19:00:18.945ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2792025-07-29T19:00:18.945ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("11f79a57-5ad1-4bc4-87b8-a00b7ba5624d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a904f883-2ab0-426c-b151-6e152497958a")}) node_id = 7 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2802025-07-29T19:00:18.946ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2812025-07-29T19:00:18.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2822025-07-29T19:00:18.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2832025-07-29T19:00:18.950ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2842025-07-29T19:00:18.950ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2852025-07-29T19:00:18.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2862025-07-29T19:00:18.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2872025-07-29T19:00:18.955ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2882025-07-29T19:00:18.955ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2892025-07-29T19:00:18.958ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
2902025-07-29T19:00:18.958ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
2912025-07-29T19:00:18.959ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2922025-07-29T19:00:18.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2932025-07-29T19:00:18.961ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2942025-07-29T19:00:18.962ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:82 instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d propolis_id = a904f883-2ab0-426c-b151-6e152497958a saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
2952025-07-29T19:00:18.962ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = ReleaseSledResources
2962025-07-29T19:00:18.962ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = ReleaseSledResources
2972025-07-29T19:00:18.963ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2982025-07-29T19:00:18.963ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2992025-07-29T19:00:18.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3002025-07-29T19:00:18.965ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3012025-07-29T19:00:18.967ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3022025-07-29T19:00:18.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3032025-07-29T19:00:18.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3042025-07-29T19:00:18.981ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3052025-07-29T19:00:18.981ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
3062025-07-29T19:00:18.986ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3072025-07-29T19:00:18.987ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
3082025-07-29T19:00:18.991ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:113 instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d propolis_id = a904f883-2ab0-426c-b151-6e152497958a saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
3092025-07-29T19:00:18.991ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = MarkVmmDeleted
3102025-07-29T19:00:18.991ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = MarkVmmDeleted
3112025-07-29T19:00:19.002ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3122025-07-29T19:00:19.003ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
3132025-07-29T19:00:19.007ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3142025-07-29T19:00:19.007ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
3152025-07-29T19:00:19.010ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3162025-07-29T19:00:19.010ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
3172025-07-29T19:00:19.011ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3182025-07-29T19:00:19.012ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "87963cf5-dfdf-4463-b4a6-ca3eea99462d", "content-length": "691", "date": "Tue, 29 Jul 2025 19:00:19 GMT"} })
3192025-07-29T19:00:19.012ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
3202025-07-29T19:00:19.012ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
3212025-07-29T19:00:19.012ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
3222025-07-29T19:00:19.013ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3232025-07-29T19:00:19.013ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
3242025-07-29T19:00:19.014ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 79.922111ms iteration = 25 status = {}
3252025-07-29T19:00:19.017ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = ChainSuccessorSaga
3262025-07-29T19:00:19.017ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = ChainSuccessorSaga
3272025-07-29T19:00:19.019ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = ChainSuccessorSaga
3282025-07-29T19:00:19.019ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = ChainSuccessorSaga
3292025-07-29T19:00:19.021ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = ChainSuccessorSaga
3302025-07-29T19:00:19.021ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = ChainSuccessorSaga
3312025-07-29T19:00:19.023ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = ChainSuccessorSaga
3322025-07-29T19:00:19.026ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7849f1ec-cda6-460a-927c-8287cd3fb888, lookup_type: ById(7849f1ec-cda6-460a-927c-8287cd3fb888) }, key: a9bae9b2-13b6-4a2a-a1e5-3dff51f2bc22, lookup_type: ById(a9bae9b2-13b6-4a2a-a1e5-3dff51f2bc22) }, key: 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d, lookup_type: ById(11f79a57-5ad1-4bc4-87b8-a00b7ba5624d) } result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = ChainSuccessorSaga
3332025-07-29T19:00:19.026ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = ChainSuccessorSaga
3342025-07-29T19:00:19.026ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_node = ChainSuccessorSaga
3352025-07-29T19:00:19.031ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d intended_state = destroyed karmic_state = WillReincarnate needs_reincarnation = false saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update
3362025-07-29T19:00:19.031ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3372025-07-29T19:00:19.031ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
3382025-07-29T19:00:19.035ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3392025-07-29T19:00:19.035ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
3402025-07-29T19:00:19.039ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3412025-07-29T19:00:19.039ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
3422025-07-29T19:00:19.043ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3432025-07-29T19:00:19.043ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707
3442025-07-29T19:00:19.051ZINFOnexus (BackgroundTasks): VPC route manager sled 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3452025-07-29T19:00:19.051ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3462025-07-29T19:00:19.051ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2aae320d-3255-49f2-9454-d25c413839ec", "content-length": "372", "date": "Tue, 29 Jul 2025 19:00:19 GMT"} })
3472025-07-29T19:00:19.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3482025-07-29T19:00:19.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3492025-07-29T19:00:19.067ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
3502025-07-29T19:00:19.067ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3512025-07-29T19:00:19.067ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6bf457fa-c0dd-4581-8f6d-436917d9d67a", "date": "Tue, 29 Jul 2025 19:00:19 GMT"} })
3522025-07-29T19:00:19.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3532025-07-29T19:00:19.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3542025-07-29T19:00:19.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3552025-07-29T19:00:19.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3562025-07-29T19:00:19.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3572025-07-29T19:00:19.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3582025-07-29T19:00:19.075ZINFOnexus (BackgroundTasks): VPC route manager sled 9c9e9bac-4b96-4da6-bd17-bdedf998a5df push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3592025-07-29T19:00:19.075ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3602025-07-29T19:00:19.075ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e7fe5d8d-5fc6-49d2-ad2b-b03e6b9bdc4f", "date": "Tue, 29 Jul 2025 19:00:19 GMT"} })
3612025-07-29T19:00:19.077ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 142.763745ms iteration = 25 status = {}
3622025-07-29T19:00:19.087ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3632025-07-29T19:00:19.087ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 saga_name = instance-update saga_result = SagaResult { saga_id: d08f2439-6455-4b05-8f88-f9b4610f2707, saga_log: SagaLog { saga_id: d08f2439-6455-4b05-8f88-f9b4610f2707, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("1eee6877-c168-45a0-92c8-b37631e08f78")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("1eee6877-c168-45a0-92c8-b37631e08f78")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("11f79a57-5ad1-4bc4-87b8-a00b7ba5624d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a904f883-2ab0-426c-b151-6e152497958a")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("11f79a57-5ad1-4bc4-87b8-a00b7ba5624d"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a904f883-2ab0-426c-b151-6e152497958a")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("1eee6877-c168-45a0-92c8-b37631e08f78"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("1eee6877-c168-45a0-92c8-b37631e08f78")}} }) }
3642025-07-29T19:00:19.087ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = d08f2439-6455-4b05-8f88-f9b4610f2707 instance_id = 11f79a57-5ad1-4bc4-87b8-a00b7ba5624d saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update
3652025-07-29T19:00:19.087ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3662025-07-29T19:00:19.087ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726
3672025-07-29T19:00:19.092ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3682025-07-29T19:00:19.092ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726
3692025-07-29T19:00:19.095ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3702025-07-29T19:00:19.095ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726
3712025-07-29T19:00:19.099ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3722025-07-29T19:00:19.099ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726
3732025-07-29T19:00:19.139ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update sec_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
3742025-07-29T19:00:19.139ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 24ffb59c-db51-4ea7-9ed5-d277a554d726 saga_name = start-instance-update saga_result = SagaResult { saga_id: 24ffb59c-db51-4ea7-9ed5-d277a554d726, saga_log: SagaLog { saga_id: 24ffb59c-db51-4ea7-9ed5-d277a554d726, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("1e6abbfc-71b4-4d97-ab60-3ab04a8ed4c0")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("1e6abbfc-71b4-4d97-ab60-3ab04a8ed4c0")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("1e6abbfc-71b4-4d97-ab60-3ab04a8ed4c0"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("1e6abbfc-71b4-4d97-ab60-3ab04a8ed4c0")}} }) }
3752025-07-29T19:00:19.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 6383d8b8-49dd-40d4-97ff-b1872194c6ce roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
3762025-07-29T19:00:19.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 6383d8b8-49dd-40d4-97ff-b1872194c6ce resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
3772025-07-29T19:00:19.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 6383d8b8-49dd-40d4-97ff-b1872194c6ce response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
3782025-07-29T19:00:20.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = 566b4466-0204-4ae6-a142-dd2c1998ddd1 roles = RoleSet { roles: {} } uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?sort_by=id_ascending
3792025-07-29T19:00:20.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = 566b4466-0204-4ae6-a142-dd2c1998ddd1 resource = Database result = Ok(()) uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?sort_by=id_ascending
3802025-07-29T19:00:20.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = 566b4466-0204-4ae6-a142-dd2c1998ddd1 response_code = 200 uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?sort_by=id_ascending
3812025-07-29T19:00:20.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = d2287a30-f5ac-4a77-ba06-a338870e3567 roles = RoleSet { roles: {} } uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNDIwZTUxZC1lZTA5LTQ0ZGItYjc1ZS1hOTRmY2E5MjlmMjQifX0%3D
3822025-07-29T19:00:20.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = d2287a30-f5ac-4a77-ba06-a338870e3567 resource = Database result = Ok(()) uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNDIwZTUxZC1lZTA5LTQ0ZGItYjc1ZS1hOTRmY2E5MjlmMjQifX0%3D
3832025-07-29T19:00:20.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = d2287a30-f5ac-4a77-ba06-a338870e3567 response_code = 200 uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNDIwZTUxZC1lZTA5LTQ0ZGItYjc1ZS1hOTRmY2E5MjlmMjQifX0%3D
3842025-07-29T19:00:20.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4a880bd3-91d6-4d47-85d3-692523e8f3be roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
3852025-07-29T19:00:20.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4a880bd3-91d6-4d47-85d3-692523e8f3be resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
3862025-07-29T19:00:20.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4a880bd3-91d6-4d47-85d3-692523e8f3be response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
3872025-07-29T19:00:21.701ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
3882025-07-29T19:00:21.701ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625
3892025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
3902025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 23.671\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"0a28dc16-a065-459e-b1aa-d53bcbda4625"}
3912025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
3922025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
3932025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3942025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
3952025-07-29T19:00:21.702ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-29 18:50:21.701980786 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
3962025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
3972025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
3982025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
3992025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
4002025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
4012025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4022025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
4032025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4042025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
4052025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
4062025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
4072025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4082025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4092025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
4102025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4112025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4122025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4132025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4142025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4152025-07-29T19:00:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4162025-07-29T19:00:21.702ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f029ed2-cb9f-4a2a-abfb-658c8c935c5f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd3b3189-49d4-477c-a714-9ae9f7b62166.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bd3b3189-49d4-477c-a714-9ae9f7b62166.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1767, tv_nsec: 44703932 } })
4172025-07-29T19:00:21.702ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("06f95c1c-5c20-4b26-9468-cc969d04624c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b26eec37-84dc-4d06-a9f1-8c4aaa12bb61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e3550944-bdfd-4b05-a84f-d19ead76f5ae.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e3550944-bdfd-4b05-a84f-d19ead76f5ae.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1767, tv_nsec: 44726253 } })
4182025-07-29T19:00:21.703ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
4192025-07-29T19:00:21.703ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.016989ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
4202025-07-29T19:00:21.703ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
4212025-07-29T19:00:21.703ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.125172ms iteration = 13 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
4222025-07-29T19:00:21.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4232025-07-29T19:00:21.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4242025-07-29T19:00:21.705ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4252025-07-29T19:00:21.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4262025-07-29T19:00:21.705ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-29 18:50:21.701980786 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
4272025-07-29T19:00:21.705ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.776815ms iteration = 13 status = {"expiration":"2025-07-29T18:50:21.701980786Z","pruned":[]}
4282025-07-29T19:00:21.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4292025-07-29T19:00:21.706ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.101455ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4302025-07-29T19:00:21.707ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1767, tv_nsec: 49103895 } })
4312025-07-29T19:00:21.707ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
4322025-07-29T19:00:21.707ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1767, tv_nsec: 49698301 } })
4332025-07-29T19:00:21.707ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4342025-07-29T19:00:21.707ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4352025-07-29T19:00:21.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4362025-07-29T19:00:21.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4372025-07-29T19:00:21.708ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
4382025-07-29T19:00:21.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4392025-07-29T19:00:21.710ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4402025-07-29T19:00:21.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4412025-07-29T19:00:21.711ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4422025-07-29T19:00:21.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
4432025-07-29T19:00:21.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
4442025-07-29T19:00:21.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
4452025-07-29T19:00:21.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4462025-07-29T19:00:21.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4472025-07-29T19:00:21.719ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
4482025-07-29T19:00:21.719ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
4492025-07-29T19:00:21.719ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4502025-07-29T19:00:21.719ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
4512025-07-29T19:00:21.719ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
4522025-07-29T19:00:21.719ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4532025-07-29T19:00:21.719ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4542025-07-29T19:00:21.719ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 17 reason = Timeout
4552025-07-29T19:00:21.719ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
4562025-07-29T19:00:21.719ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 8.92\u{b5}s iteration = 17 status = "Disabled"
4572025-07-29T19:00:21.719ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
4582025-07-29T19:00:21.719ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4592025-07-29T19:00:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4602025-07-29T19:00:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4612025-07-29T19:00:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4622025-07-29T19:00:21.720ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4632025-07-29T19:00:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4642025-07-29T19:00:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4652025-07-29T19:00:21.720ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4662025-07-29T19:00:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4672025-07-29T19:00:21.720ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4682025-07-29T19:00:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4692025-07-29T19:00:21.720ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4702025-07-29T19:00:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4712025-07-29T19:00:21.722ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4722025-07-29T19:00:21.723ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4732025-07-29T19:00:21.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
4742025-07-29T19:00:21.724ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4752025-07-29T19:00:21.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4762025-07-29T19:00:21.725ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
4772025-07-29T19:00:21.725ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4782025-07-29T19:00:21.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4792025-07-29T19:00:21.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
4802025-07-29T19:00:21.725ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4812025-07-29T19:00:21.725ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
4822025-07-29T19:00:21.725ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
4832025-07-29T19:00:21.725ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 5.914286ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
4842025-07-29T19:00:21.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4852025-07-29T19:00:21.726ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4862025-07-29T19:00:21.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
4872025-07-29T19:00:21.729ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
4882025-07-29T19:00:21.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
4892025-07-29T19:00:21.730ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.121463ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
4902025-07-29T19:00:21.737ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 13 reason = Timeout
4912025-07-29T19:00:21.737ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 13 reason = Timeout
4922025-07-29T19:00:21.737ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
4932025-07-29T19:00:21.737ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
4942025-07-29T19:00:21.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
4952025-07-29T19:00:21.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
4962025-07-29T19:00:21.739ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
4972025-07-29T19:00:21.739ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 2.657024ms iteration = 13 status = {"by_rx":{},"error":null}
4982025-07-29T19:00:21.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 80911314-4e49-4959-861a-2e559d3eaec3 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
4992025-07-29T19:00:21.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 80911314-4e49-4959-861a-2e559d3eaec3 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
5002025-07-29T19:00:21.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 6516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 80911314-4e49-4959-861a-2e559d3eaec3 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
5012025-07-29T19:00:21.750ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
5022025-07-29T19:00:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
5032025-07-29T19:00:21.757ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 20.637636ms iteration = 13 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
5042025-07-29T19:00:21.778ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
5052025-07-29T19:00:21.778ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
5062025-07-29T19:00:21.778ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
5072025-07-29T19:00:21.778ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5082025-07-29T19:00:21.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5092025-07-29T19:00:21.782ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5102025-07-29T19:00:21.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5112025-07-29T19:00:21.792ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
5122025-07-29T19:00:21.793ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
5132025-07-29T19:00:21.793ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
5142025-07-29T19:00:21.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5152025-07-29T19:00:21.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5162025-07-29T19:00:21.801ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5172025-07-29T19:00:21.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5182025-07-29T19:00:21.806ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5192025-07-29T19:00:21.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5202025-07-29T19:00:21.811ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5212025-07-29T19:00:21.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5222025-07-29T19:00:21.814ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5232025-07-29T19:00:21.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5242025-07-29T19:00:21.819ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5252025-07-29T19:00:21.822ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
5262025-07-29T19:00:21.822ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
5272025-07-29T19:00:21.822ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 103.072527ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
5282025-07-29T19:00:21.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
5292025-07-29T19:00:21.823ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5302025-07-29T19:00:21.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5312025-07-29T19:00:21.825ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 106.03174ms iteration = 6 status = {"nsuccess":5}
5322025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 25 reason = Timeout
5332025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
5342025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 23.26\u{b5}s iteration = 25 status = {"disabled":true,"errors":[],"sps":[]}
5352025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5362025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
5372025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5382025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
5392025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5402025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
5412025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5422025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
5432025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
5442025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5452025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
5462025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5472025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
5482025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
5492025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
5502025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
5512025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5522025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5532025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
5542025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5552025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
5562025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
5572025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5582025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5592025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
5602025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5612025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
5622025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5632025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 145 reason = Timeout
5642025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
5652025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
5662025-07-29T19:00:21.841ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
5672025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5682025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
5692025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5702025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5712025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5722025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5732025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5742025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5752025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
5762025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5772025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5782025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5792025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5802025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5812025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5822025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5832025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5842025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
5852025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5862025-07-29T19:00:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5872025-07-29T19:00:21.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5882025-07-29T19:00:21.845ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
5892025-07-29T19:00:21.845ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5902025-07-29T19:00:21.846ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2623d83d-98e8-4a58-8db9-c515a3f55377", "content-length": "26", "date": "Tue, 29 Jul 2025 19:00:21 GMT"} })
5912025-07-29T19:00:21.846ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5922025-07-29T19:00:21.846ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5932025-07-29T19:00:21.848ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5942025-07-29T19:00:21.848ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5952025-07-29T19:00:21.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5962025-07-29T19:00:21.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5972025-07-29T19:00:21.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5982025-07-29T19:00:21.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5992025-07-29T19:00:21.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6002025-07-29T19:00:21.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
6012025-07-29T19:00:21.850ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6022025-07-29T19:00:21.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6032025-07-29T19:00:21.851ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6042025-07-29T19:00:21.852ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6052025-07-29T19:00:21.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6062025-07-29T19:00:21.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6072025-07-29T19:00:21.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6082025-07-29T19:00:21.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6092025-07-29T19:00:21.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6102025-07-29T19:00:21.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6112025-07-29T19:00:21.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6122025-07-29T19:00:21.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6132025-07-29T19:00:21.857ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6142025-07-29T19:00:21.857ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6152025-07-29T19:00:21.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6162025-07-29T19:00:21.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6172025-07-29T19:00:21.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6182025-07-29T19:00:21.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6192025-07-29T19:00:21.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6202025-07-29T19:00:21.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6212025-07-29T19:00:21.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6222025-07-29T19:00:21.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
6232025-07-29T19:00:21.859ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
6242025-07-29T19:00:21.859ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6252025-07-29T19:00:21.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6262025-07-29T19:00:21.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
6272025-07-29T19:00:21.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6282025-07-29T19:00:21.861ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6292025-07-29T19:00:21.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6302025-07-29T19:00:21.863ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
6312025-07-29T19:00:21.863ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 21.916132ms iteration = 145 status = {"chicken_switches_updated":false}
6322025-07-29T19:00:21.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6332025-07-29T19:00:21.874ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6342025-07-29T19:00:21.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6352025-07-29T19:00:21.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6362025-07-29T19:00:21.874ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6372025-07-29T19:00:21.875ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6382025-07-29T19:00:21.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6392025-07-29T19:00:21.879ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6402025-07-29T19:00:21.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6412025-07-29T19:00:21.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0a28dc16-a065-459e-b1aa-d53bcbda4625, lookup_type: ById(0a28dc16-a065-459e-b1aa-d53bcbda4625) } result = Ok(())
6422025-07-29T19:00:21.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6432025-07-29T19:00:21.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6442025-07-29T19:00:21.896ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
6452025-07-29T19:00:21.896ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6462025-07-29T19:00:21.897ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5290420-6ad3-47f5-955a-363d648595b8", "content-length": "26", "date": "Tue, 29 Jul 2025 19:00:21 GMT"} })
6472025-07-29T19:00:21.897ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6482025-07-29T19:00:21.900ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6492025-07-29T19:00:21.917ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.94189ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
6502025-07-29T19:00:21.918ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6512025-07-29T19:00:21.918ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6522025-07-29T19:00:21.918ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6532025-07-29T19:00:21.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6542025-07-29T19:00:21.924ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 83.176871ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
6552025-07-29T19:00:21.924ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6562025-07-29T19:00:21.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6572025-07-29T19:00:21.926ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6582025-07-29T19:00:21.926ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6592025-07-29T19:00:21.926ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6602025-07-29T19:00:21.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6612025-07-29T19:00:21.927ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6622025-07-29T19:00:21.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6632025-07-29T19:00:21.930ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 89.566979ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
6642025-07-29T19:00:21.930ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
6652025-07-29T19:00:21.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6662025-07-29T19:00:21.934ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6672025-07-29T19:00:21.935ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6682025-07-29T19:00:21.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6692025-07-29T19:00:21.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6702025-07-29T19:00:21.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6712025-07-29T19:00:21.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6722025-07-29T19:00:21.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6732025-07-29T19:00:21.939ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1767, tv_nsec: 281296275 } })
6742025-07-29T19:00:21.939ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6752025-07-29T19:00:21.939ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6762025-07-29T19:00:21.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6772025-07-29T19:00:21.939ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06
6782025-07-29T19:00:21.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6792025-07-29T19:00:21.941ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6802025-07-29T19:00:21.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6812025-07-29T19:00:21.941ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6822025-07-29T19:00:21.941ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 100.68945ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6832025-07-29T19:00:21.943ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6842025-07-29T19:00:21.943ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6852025-07-29T19:00:21.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6862025-07-29T19:00:21.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6872025-07-29T19:00:21.944ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6882025-07-29T19:00:21.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6892025-07-29T19:00:21.946ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6902025-07-29T19:00:21.948ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 original_time_created = 2025-07-29 18:48:16.280373 UTC target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 time_created = 2025-07-29 18:48:16.280373 UTC
6912025-07-29T19:00:21.948ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 107.004216ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0a28dc16-a065-459e-b1aa-d53bcbda4625","time_created":"2025-07-29T18:48:16.280373Z"}
6922025-07-29T19:00:21.950ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
6932025-07-29T19:00:21.950ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 38285aad-e399-45b9-b320-a1b8587dde71 dns_zone_name = oxide.test found_so_far = 0 version = 2
6942025-07-29T19:00:21.950ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6952025-07-29T19:00:21.950ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
6962025-07-29T19:00:21.950ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6972025-07-29T19:00:21.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6982025-07-29T19:00:21.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6992025-07-29T19:00:21.953ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:390
7002025-07-29T19:00:21.953ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 111.887123ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
7012025-07-29T19:00:21.957ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7022025-07-29T19:00:21.957ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2fde86c3-c290-45be-ba40-b0329a048813 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7032025-07-29T19:00:21.957ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7042025-07-29T19:00:21.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7052025-07-29T19:00:21.959ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7062025-07-29T19:00:21.962ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-29T18:48:16.146073Z, time_modified: 2025-07-29T18:48:16.146073Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 7849f1ec-cda6-460a-927c-8287cd3fb888, db_silo: Silo { identity: SiloIdentity { id: 7849f1ec-cda6-460a-927c-8287cd3fb888, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-29T18:48:50.390458Z, time_modified: 2025-07-29T18:48:50.390458Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1b8f4f66f00ad0ab9230664f0c2d86fec1b5c246e3aa63f4e554294f2ab9c68f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 7849f1ec-cda6-460a-927c-8287cd3fb888, db_silo: Silo { identity: SiloIdentity { id: 7849f1ec-cda6-460a-927c-8287cd3fb888, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-29T18:48:50.390458Z, time_modified: 2025-07-29T18:48:50.390458Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1b8f4f66f00ad0ab9230664f0c2d86fec1b5c246e3aa63f4e554294f2ab9c68f" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
7072025-07-29T19:00:21.962ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 260.025507ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"7849f1ec-cda6-460a-927c-8287cd3fb888","tls_certs":["1b8f4f66f00ad0ab9230664f0c2d86fec1b5c246e3aa63f4e554294f2ab9c68f"]}},"default_endpoint":{"silo_id":"7849f1ec-cda6-460a-927c-8287cd3fb888","tls_certs":["1b8f4f66f00ad0ab9230664f0c2d86fec1b5c246e3aa63f4e554294f2ab9c68f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
7082025-07-29T19:00:21.963ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7092025-07-29T19:00:21.963ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7102025-07-29T19:00:21.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7112025-07-29T19:00:21.970ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7122025-07-29T19:00:21.974ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2fde86c3-c290-45be-ba40-b0329a048813 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
7132025-07-29T19:00:21.974ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
7142025-07-29T19:00:21.974ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-29 18:48:49.884149 UTC dns_group = internal generation = 1
7152025-07-29T19:00:21.974ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 272.123985ms iteration = 13 status = {"generation":1}
7162025-07-29T19:00:21.990ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7172025-07-29T19:00:21.990ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7182025-07-29T19:00:21.990ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.766659ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7192025-07-29T19:00:21.995ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7202025-07-29T19:00:21.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7212025-07-29T19:00:21.996ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 155.301395ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7222025-07-29T19:00:22.001ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 160.079598ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7232025-07-29T19:00:22.008ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7242025-07-29T19:00:22.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7252025-07-29T19:00:22.012ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 310.217688ms iteration = 25 status = null
7262025-07-29T19:00:22.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 171.62228ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7272025-07-29T19:00:22.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7282025-07-29T19:00:22.015ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7292025-07-29T19:00:22.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7302025-07-29T19:00:22.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7312025-07-29T19:00:22.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7322025-07-29T19:00:22.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7332025-07-29T19:00:22.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7342025-07-29T19:00:22.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7352025-07-29T19:00:22.019ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 38285aad-e399-45b9-b320-a1b8587dde71 dns_zone_name = oxide.test found_so_far = 4 version = 2
7362025-07-29T19:00:22.019ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7372025-07-29T19:00:22.019ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
7382025-07-29T19:00:22.019ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-29 18:48:50.467734 UTC dns_group = external generation = 2
7392025-07-29T19:00:22.019ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 317.626245ms iteration = 13 status = {"generation":2}
7402025-07-29T19:00:22.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9c9e9bac-4b96-4da6-bd17-bdedf998a5df, lookup_type: ById(9c9e9bac-4b96-4da6-bd17-bdedf998a5df) } result = Ok(())
7412025-07-29T19:00:22.022ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7422025-07-29T19:00:22.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7432025-07-29T19:00:22.025ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 184.056567ms iteration = 25 status = 0
7442025-07-29T19:00:22.042ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 201.574756ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
7452025-07-29T19:00:22.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7462025-07-29T19:00:22.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7472025-07-29T19:00:22.067ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 365.006818ms iteration = 25 status = {}
7482025-07-29T19:00:22.085ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 244.340759ms iteration = 28 status = {"physical_disks_added":0}
7492025-07-29T19:00:22.092ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
7502025-07-29T19:00:22.092ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 372.266431ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7512025-07-29T19:00:22.098ZINFOnexus (BackgroundTasks): VPC route manager sled 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7522025-07-29T19:00:22.098ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7532025-07-29T19:00:22.099ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c142f96-fb60-401d-b616-75bab103fec0", "content-length": "372", "date": "Tue, 29 Jul 2025 19:00:21 GMT"} })
7542025-07-29T19:00:22.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7552025-07-29T19:00:22.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7562025-07-29T19:00:22.104ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 zone_address = fd00:1122:3344:101::2
7572025-07-29T19:00:22.104ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7582025-07-29T19:00:22.105ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "54bf9953-dbe9-4b68-9399-6a081a1c7dad", "content-length": "26", "date": "Tue, 29 Jul 2025 19:00:21 GMT"} })
7592025-07-29T19:00:22.105ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7602025-07-29T19:00:22.106ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06
7612025-07-29T19:00:22.183ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7622025-07-29T19:00:22.216ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
7632025-07-29T19:00:22.216ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7642025-07-29T19:00:22.217ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2a53ce63-d08d-4734-8829-0fafd29db8fd", "date": "Tue, 29 Jul 2025 19:00:21 GMT"} })
7652025-07-29T19:00:22.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7662025-07-29T19:00:22.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7672025-07-29T19:00:22.220ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
7682025-07-29T19:00:22.220ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "03cb69d1-5bd8-4a1d-ba5b-42d5de7b4508", "date": "Tue, 29 Jul 2025 19:00:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7692025-07-29T19:00:22.220ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7702025-07-29T19:00:22.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7712025-07-29T19:00:22.222ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "02765811-8d10-4b42-a2d2-5de18ebf4474", "date": "Tue, 29 Jul 2025 19:00:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7722025-07-29T19:00:22.222ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7732025-07-29T19:00:22.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7742025-07-29T19:00:22.224ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
7752025-07-29T19:00:22.224ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 522.654968ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7762025-07-29T19:00:22.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7772025-07-29T19:00:22.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7782025-07-29T19:00:22.233ZINFOnexus (BackgroundTasks): VPC route manager sled 9c9e9bac-4b96-4da6-bd17-bdedf998a5df push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7792025-07-29T19:00:22.233ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7802025-07-29T19:00:22.234ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b5c805ed-1ea3-4c5c-9f43-d7c30ef9fa78", "date": "Tue, 29 Jul 2025 19:00:22 GMT"} })
7812025-07-29T19:00:22.236ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 395.093248ms iteration = 26 status = {}
7822025-07-29T19:00:22.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7832025-07-29T19:00:22.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7842025-07-29T19:00:22.255ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7852025-07-29T19:00:22.258ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7862025-07-29T19:00:22.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7872025-07-29T19:00:22.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7882025-07-29T19:00:22.261ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7892025-07-29T19:00:22.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7902025-07-29T19:00:22.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7912025-07-29T19:00:22.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7922025-07-29T19:00:22.325ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7932025-07-29T19:00:22.326ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "68f7537b-80c2-4dcf-940d-2bf3be5af777", "date": "Tue, 29 Jul 2025 19:00:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7942025-07-29T19:00:22.326ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7952025-07-29T19:00:22.328ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c650f219-85b7-4c0a-8dd5-cdb140a00f85", "date": "Tue, 29 Jul 2025 19:00:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7962025-07-29T19:00:22.328ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7972025-07-29T19:00:22.330ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "eccf8b20-2313-429c-afd8-cef25b12738a", "date": "Tue, 29 Jul 2025 19:00:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7982025-07-29T19:00:22.330ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
7992025-07-29T19:00:22.332ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
8002025-07-29T19:00:22.332ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 630.282762ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
8012025-07-29T19:00:22.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8022025-07-29T19:00:22.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8032025-07-29T19:00:22.348ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: ecf15dcb-e6bf-4724-9d10-8d03668d718d, rack_id: 9cf1a0c8-2288-4125-b368-b3ae91a98a06, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(d63a586e-232f-4911-b7dc-0748d82c16ec) } rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch_location = Switch0
8042025-07-29T19:00:22.348ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8052025-07-29T19:00:22.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8062025-07-29T19:00:22.363ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
8072025-07-29T19:00:22.363ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = d63a586e-232f-4911-b7dc-0748d82c16ec
8082025-07-29T19:00:22.364ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8092025-07-29T19:00:22.364ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8102025-07-29T19:00:22.364ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8112025-07-29T19:00:22.364ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8122025-07-29T19:00:22.364ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8132025-07-29T19:00:22.364ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8142025-07-29T19:00:22.364ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8152025-07-29T19:00:22.364ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8162025-07-29T19:00:22.364ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06
8172025-07-29T19:00:22.364ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8182025-07-29T19:00:22.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8192025-07-29T19:00:22.367ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch_location = Switch0
8202025-07-29T19:00:22.367ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8212025-07-29T19:00:22.397ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8222025-07-29T19:00:22.398ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9448601a-87c8-4538-9b29-ddd189b1b32b", "content-length": "691", "date": "Tue, 29 Jul 2025 19:00:21 GMT"} })
8232025-07-29T19:00:22.398ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
8242025-07-29T19:00:22.398ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
8252025-07-29T19:00:22.398ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
8262025-07-29T19:00:22.400ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 559.229749ms iteration = 26 status = {}
8272025-07-29T19:00:22.484ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "321afafd-814e-4296-9601-a682057edfe2", "date": "Tue, 29 Jul 2025 19:00:21 GMT"} })
8282025-07-29T19:00:22.484ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch = Switch0
8292025-07-29T19:00:22.484ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8302025-07-29T19:00:22.484ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "49898ef5-93a3-4699-bf50-10f211ea1deb", "content-length": "682", "date": "Tue, 29 Jul 2025 19:00:21 GMT"} })
8312025-07-29T19:00:22.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8322025-07-29T19:00:22.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8332025-07-29T19:00:22.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8342025-07-29T19:00:22.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8352025-07-29T19:00:22.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8362025-07-29T19:00:22.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8372025-07-29T19:00:22.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8382025-07-29T19:00:22.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8392025-07-29T19:00:22.506ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 665.381602ms iteration = 25 status = {}
8402025-07-29T19:00:22.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 5141b808-f482-4fe0-8efc-ceb87007755e roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8412025-07-29T19:00:22.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 5141b808-f482-4fe0-8efc-ceb87007755e resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8422025-07-29T19:00:22.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 5141b808-f482-4fe0-8efc-ceb87007755e response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8432025-07-29T19:00:23.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = ff7235b1-b1cf-40e4-bb09-732f48b52cda roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8442025-07-29T19:00:23.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = ff7235b1-b1cf-40e4-bb09-732f48b52cda resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8452025-07-29T19:00:23.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = ff7235b1-b1cf-40e4-bb09-732f48b52cda response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8462025-07-29T19:00:24.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4f9ed0f8-09e2-463d-adbc-2b198eadcdb8 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8472025-07-29T19:00:24.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4f9ed0f8-09e2-463d-adbc-2b198eadcdb8 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8482025-07-29T19:00:24.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4f9ed0f8-09e2-463d-adbc-2b198eadcdb8 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8492025-07-29T19:00:25.626ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 639 local_addr = [fd00:1122:3344:101::c]:51026 method = GET remote_addr = [fd00:1122:3344:101::d]:61933 req_id = 2995561a-69fe-4c22-bdcc-12aef3c5e900 response_code = 200 uri = /90ad0cc8-96db-48ff-b8fa-3f4895896eed
8502025-07-29T19:00:25.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = c6f5c673-9623-410c-9636-c079d23f083f roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8512025-07-29T19:00:25.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = c6f5c673-9623-410c-9636-c079d23f083f resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8522025-07-29T19:00:25.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = c6f5c673-9623-410c-9636-c079d23f083f response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8532025-07-29T19:00:26.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4e55d659-7ab3-47e6-883f-c82f96a36604 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8542025-07-29T19:00:26.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4e55d659-7ab3-47e6-883f-c82f96a36604 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8552025-07-29T19:00:26.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2825 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4e55d659-7ab3-47e6-883f-c82f96a36604 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8562025-07-29T19:00:26.841ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 146 reason = Timeout
8572025-07-29T19:00:26.841ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
8582025-07-29T19:00:26.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
8592025-07-29T19:00:26.843ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8602025-07-29T19:00:26.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
8612025-07-29T19:00:26.845ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
8622025-07-29T19:00:26.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
8632025-07-29T19:00:26.848ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
8642025-07-29T19:00:26.848ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.16543ms iteration = 146 status = {"chicken_switches_updated":false}
8652025-07-29T19:00:27.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7e09e120-68f2-43d1-9fef-be314862403d roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8662025-07-29T19:00:27.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7e09e120-68f2-43d1-9fef-be314862403d resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8672025-07-29T19:00:27.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7e09e120-68f2-43d1-9fef-be314862403d response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8682025-07-29T19:00:28.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 5f16a548-5101-4611-9212-affc014661d8 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8692025-07-29T19:00:28.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 5f16a548-5101-4611-9212-affc014661d8 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8702025-07-29T19:00:28.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 5f16a548-5101-4611-9212-affc014661d8 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8712025-07-29T19:00:29.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a6f8d635-48c7-478d-a45d-983ebe511a87 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8722025-07-29T19:00:29.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a6f8d635-48c7-478d-a45d-983ebe511a87 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8732025-07-29T19:00:29.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a6f8d635-48c7-478d-a45d-983ebe511a87 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8742025-07-29T19:00:30.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 55e3b59a-9f90-4136-843a-8af37304a7b0 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8752025-07-29T19:00:30.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 55e3b59a-9f90-4136-843a-8af37304a7b0 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8762025-07-29T19:00:30.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 55e3b59a-9f90-4136-843a-8af37304a7b0 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
8772025-07-29T19:00:31.841ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
8782025-07-29T19:00:31.841ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
8792025-07-29T19:00:31.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8802025-07-29T19:00:31.841ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8812025-07-29T19:00:31.841ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 147 reason = Timeout
8822025-07-29T19:00:31.841ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
8832025-07-29T19:00:31.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8842025-07-29T19:00:31.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8852025-07-29T19:00:31.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
8862025-07-29T19:00:31.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8872025-07-29T19:00:31.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8882025-07-29T19:00:31.844ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8892025-07-29T19:00:31.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8902025-07-29T19:00:31.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.027392ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8912025-07-29T19:00:31.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
8922025-07-29T19:00:31.847ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
8932025-07-29T19:00:31.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8942025-07-29T19:00:31.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8952025-07-29T19:00:31.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
8962025-07-29T19:00:31.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8972025-07-29T19:00:31.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8982025-07-29T19:00:31.850ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
8992025-07-29T19:00:31.850ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.854186ms iteration = 147 status = {"chicken_switches_updated":false}
9002025-07-29T19:00:31.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9012025-07-29T19:00:31.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9022025-07-29T19:00:31.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0a28dc16-a065-459e-b1aa-d53bcbda4625, lookup_type: ById(0a28dc16-a065-459e-b1aa-d53bcbda4625) } result = Ok(())
9032025-07-29T19:00:31.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9042025-07-29T19:00:31.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9052025-07-29T19:00:31.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 original_time_created = 2025-07-29 18:48:16.280373 UTC target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 time_created = 2025-07-29 18:48:16.280373 UTC
9062025-07-29T19:00:31.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.652731ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0a28dc16-a065-459e-b1aa-d53bcbda4625","time_created":"2025-07-29T18:48:16.280373Z"}
9072025-07-29T19:00:31.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 73846dcf-0fa1-49ee-9b83-845543bf867a roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9082025-07-29T19:00:31.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 73846dcf-0fa1-49ee-9b83-845543bf867a resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9092025-07-29T19:00:31.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2058 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 73846dcf-0fa1-49ee-9b83-845543bf867a response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9102025-07-29T19:00:32.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 9729e9f1-cb26-4d53-b5fa-f160db86cf1a roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9112025-07-29T19:00:32.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 9729e9f1-cb26-4d53-b5fa-f160db86cf1a resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9122025-07-29T19:00:32.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 9729e9f1-cb26-4d53-b5fa-f160db86cf1a response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9132025-07-29T19:00:33.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = ca0739e2-71ec-493b-a5ec-e9795c60d602 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9142025-07-29T19:00:33.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = ca0739e2-71ec-493b-a5ec-e9795c60d602 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9152025-07-29T19:00:33.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = ca0739e2-71ec-493b-a5ec-e9795c60d602 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9162025-07-29T19:00:34.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b3901bc1-30a2-45a4-be46-0f06c78c4dad roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9172025-07-29T19:00:34.966ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b3901bc1-30a2-45a4-be46-0f06c78c4dad resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9182025-07-29T19:00:34.968ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b3901bc1-30a2-45a4-be46-0f06c78c4dad response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9192025-07-29T19:00:35.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = bbe624f6-e1bf-4d99-982c-fb3411059408 roles = RoleSet { roles: {} } uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?sort_by=id_ascending
9202025-07-29T19:00:35.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = bbe624f6-e1bf-4d99-982c-fb3411059408 resource = Database result = Ok(()) uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?sort_by=id_ascending
9212025-07-29T19:00:35.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2653 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = bbe624f6-e1bf-4d99-982c-fb3411059408 response_code = 200 uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?sort_by=id_ascending
9222025-07-29T19:00:35.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = 283c7d43-8f98-4dc6-a54d-cb2391177854 roles = RoleSet { roles: {} } uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNDIwZTUxZC1lZTA5LTQ0ZGItYjc1ZS1hOTRmY2E5MjlmMjQifX0%3D
9232025-07-29T19:00:35.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = 283c7d43-8f98-4dc6-a54d-cb2391177854 resource = Database result = Ok(()) uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNDIwZTUxZC1lZTA5LTQ0ZGItYjc1ZS1hOTRmY2E5MjlmMjQifX0%3D
9242025-07-29T19:00:35.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = 283c7d43-8f98-4dc6-a54d-cb2391177854 response_code = 200 uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNDIwZTUxZC1lZTA5LTQ0ZGItYjc1ZS1hOTRmY2E5MjlmMjQifX0%3D
9252025-07-29T19:00:35.627ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 765 local_addr = [fd00:1122:3344:101::c]:51026 method = GET remote_addr = [fd00:1122:3344:101::d]:61933 req_id = 214fdb21-ed3c-4106-af11-61cb280cbd7e response_code = 200 uri = /90ad0cc8-96db-48ff-b8fa-3f4895896eed
9262025-07-29T19:00:35.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = c7b81291-5aad-4cc7-9d46-a8f8e8454a45 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9272025-07-29T19:00:35.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = c7b81291-5aad-4cc7-9d46-a8f8e8454a45 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9282025-07-29T19:00:35.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = c7b81291-5aad-4cc7-9d46-a8f8e8454a45 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9292025-07-29T19:00:36.840ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 148 reason = Timeout
9302025-07-29T19:00:36.840ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
9312025-07-29T19:00:36.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
9322025-07-29T19:00:36.843ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9332025-07-29T19:00:36.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
9342025-07-29T19:00:36.846ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
9352025-07-29T19:00:36.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
9362025-07-29T19:00:36.849ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
9372025-07-29T19:00:36.849ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.347833ms iteration = 148 status = {"chicken_switches_updated":false}
9382025-07-29T19:00:36.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 711dbf0f-82f7-408a-8483-2d3ed8327682 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9392025-07-29T19:00:36.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 711dbf0f-82f7-408a-8483-2d3ed8327682 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9402025-07-29T19:00:37.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 711dbf0f-82f7-408a-8483-2d3ed8327682 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9412025-07-29T19:00:38.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 88d58285-0b3d-4f8b-85db-7dfcedee9561 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9422025-07-29T19:00:38.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 88d58285-0b3d-4f8b-85db-7dfcedee9561 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9432025-07-29T19:00:38.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 88d58285-0b3d-4f8b-85db-7dfcedee9561 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9442025-07-29T19:00:39.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f350fee8-e148-42e6-ac34-5b1938b397fc roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9452025-07-29T19:00:39.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f350fee8-e148-42e6-ac34-5b1938b397fc resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9462025-07-29T19:00:39.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f350fee8-e148-42e6-ac34-5b1938b397fc response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9472025-07-29T19:00:40.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7225424a-8cca-4d86-ae20-2aac88a3af7e roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9482025-07-29T19:00:40.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7225424a-8cca-4d86-ae20-2aac88a3af7e resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9492025-07-29T19:00:40.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7225424a-8cca-4d86-ae20-2aac88a3af7e response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9502025-07-29T19:00:41.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1a10e856-b579-4708-adfa-76dced9054b6 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9512025-07-29T19:00:41.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1a10e856-b579-4708-adfa-76dced9054b6 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9522025-07-29T19:00:41.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1a10e856-b579-4708-adfa-76dced9054b6 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9532025-07-29T19:00:41.841ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
9542025-07-29T19:00:41.841ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
9552025-07-29T19:00:41.841ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9562025-07-29T19:00:41.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9572025-07-29T19:00:41.841ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 149 reason = Timeout
9582025-07-29T19:00:41.841ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
9592025-07-29T19:00:41.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9602025-07-29T19:00:41.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9612025-07-29T19:00:41.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
9622025-07-29T19:00:41.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9632025-07-29T19:00:41.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9642025-07-29T19:00:41.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9652025-07-29T19:00:41.844ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9662025-07-29T19:00:41.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.994671ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9672025-07-29T19:00:41.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9682025-07-29T19:00:41.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9692025-07-29T19:00:41.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9702025-07-29T19:00:41.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
9712025-07-29T19:00:41.847ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
9722025-07-29T19:00:41.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
9732025-07-29T19:00:41.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9742025-07-29T19:00:41.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9752025-07-29T19:00:41.849ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
9762025-07-29T19:00:41.849ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.091865ms iteration = 149 status = {"chicken_switches_updated":false}
9772025-07-29T19:00:41.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9782025-07-29T19:00:41.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0a28dc16-a065-459e-b1aa-d53bcbda4625, lookup_type: ById(0a28dc16-a065-459e-b1aa-d53bcbda4625) } result = Ok(())
9792025-07-29T19:00:41.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9802025-07-29T19:00:41.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9812025-07-29T19:00:41.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 original_time_created = 2025-07-29 18:48:16.280373 UTC target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 time_created = 2025-07-29 18:48:16.280373 UTC
9822025-07-29T19:00:41.869ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.903368ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0a28dc16-a065-459e-b1aa-d53bcbda4625","time_created":"2025-07-29T18:48:16.280373Z"}
9832025-07-29T19:00:42.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7101f081-573e-43fb-afe0-15125d6e9864 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9842025-07-29T19:00:42.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7101f081-573e-43fb-afe0-15125d6e9864 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9852025-07-29T19:00:42.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7101f081-573e-43fb-afe0-15125d6e9864 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9862025-07-29T19:00:43.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 9b448b3c-b2dd-46b5-b948-79ed48f33aca roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9872025-07-29T19:00:43.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 9b448b3c-b2dd-46b5-b948-79ed48f33aca resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9882025-07-29T19:00:43.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 9b448b3c-b2dd-46b5-b948-79ed48f33aca response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9892025-07-29T19:00:44.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a12080d8-b26d-4a9a-978c-a71230d5040c roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9902025-07-29T19:00:44.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a12080d8-b26d-4a9a-978c-a71230d5040c resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9912025-07-29T19:00:44.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a12080d8-b26d-4a9a-978c-a71230d5040c response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9922025-07-29T19:00:45.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2a636eb6-bcc9-41b9-b805-c2239a545c36 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9932025-07-29T19:00:45.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2a636eb6-bcc9-41b9-b805-c2239a545c36 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9942025-07-29T19:00:45.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2a636eb6-bcc9-41b9-b805-c2239a545c36 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9952025-07-29T19:00:45.627ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 712 local_addr = [fd00:1122:3344:101::c]:51026 method = GET remote_addr = [fd00:1122:3344:101::d]:61933 req_id = 151a2174-b85c-43ad-9806-e3e66fc248f8 response_code = 200 uri = /90ad0cc8-96db-48ff-b8fa-3f4895896eed
9962025-07-29T19:00:46.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2fcadf95-ff2e-45b7-b040-9cf83e8615f9 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9972025-07-29T19:00:46.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2fcadf95-ff2e-45b7-b040-9cf83e8615f9 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9982025-07-29T19:00:46.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2fcadf95-ff2e-45b7-b040-9cf83e8615f9 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
9992025-07-29T19:00:46.841ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 150 reason = Timeout
10002025-07-29T19:00:46.841ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10012025-07-29T19:00:46.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10022025-07-29T19:00:46.843ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10032025-07-29T19:00:46.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
10042025-07-29T19:00:46.846ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10052025-07-29T19:00:46.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10062025-07-29T19:00:46.849ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
10072025-07-29T19:00:46.849ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.175638ms iteration = 150 status = {"chicken_switches_updated":false}
10082025-07-29T19:00:47.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 43046c97-3ec5-46b8-b5f8-6834f93ec15f roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10092025-07-29T19:00:47.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 43046c97-3ec5-46b8-b5f8-6834f93ec15f resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10102025-07-29T19:00:47.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 43046c97-3ec5-46b8-b5f8-6834f93ec15f response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10112025-07-29T19:00:48.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = c0ee2ba9-c374-4a33-9d0e-a0f65b7ca129 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10122025-07-29T19:00:48.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = c0ee2ba9-c374-4a33-9d0e-a0f65b7ca129 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10132025-07-29T19:00:48.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = c0ee2ba9-c374-4a33-9d0e-a0f65b7ca129 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10142025-07-29T19:00:49.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b3ddb09e-87d9-4617-ad58-01a522860475 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10152025-07-29T19:00:49.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b3ddb09e-87d9-4617-ad58-01a522860475 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10162025-07-29T19:00:49.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2627 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b3ddb09e-87d9-4617-ad58-01a522860475 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10172025-07-29T19:00:50.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 358ef583-ea01-4120-88ed-418c4716e2a0 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10182025-07-29T19:00:50.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 358ef583-ea01-4120-88ed-418c4716e2a0 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10192025-07-29T19:00:50.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 358ef583-ea01-4120-88ed-418c4716e2a0 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10202025-07-29T19:00:51.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = eda2cdb5-8c5b-4155-81fd-7dffcee5b5a4 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10212025-07-29T19:00:51.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = eda2cdb5-8c5b-4155-81fd-7dffcee5b5a4 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10222025-07-29T19:00:51.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = eda2cdb5-8c5b-4155-81fd-7dffcee5b5a4 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
10232025-07-29T19:00:51.701ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
10242025-07-29T19:00:51.701ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
10252025-07-29T19:00:51.701ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10262025-07-29T19:00:51.702ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
10272025-07-29T19:00:51.702ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10282025-07-29T19:00:51.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10292025-07-29T19:00:51.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10302025-07-29T19:00:51.705ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1797, tv_nsec: 47293364 } })
10312025-07-29T19:00:51.705ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
10322025-07-29T19:00:51.705ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1797, tv_nsec: 47920842 } })
10332025-07-29T19:00:51.705ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
10342025-07-29T19:00:51.706ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.494315ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10352025-07-29T19:00:51.766ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
10362025-07-29T19:00:51.767ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10372025-07-29T19:00:51.767ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "10794b9e-01b4-406c-a948-44ba164451d6", "content-length": "26", "date": "Tue, 29 Jul 2025 19:00:51 GMT"} })
10382025-07-29T19:00:51.767ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10392025-07-29T19:00:51.769ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10402025-07-29T19:00:51.772ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
10412025-07-29T19:00:51.772ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10422025-07-29T19:00:51.773ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "967451a3-7c09-4a73-b93c-2a93502865ff", "content-length": "26", "date": "Tue, 29 Jul 2025 19:00:51 GMT"} })
10432025-07-29T19:00:51.773ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10442025-07-29T19:00:51.774ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10452025-07-29T19:00:51.840ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 26 reason = Timeout
10462025-07-29T19:00:51.840ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
10472025-07-29T19:00:51.840ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 22.521\u{b5}s iteration = 26 status = {"disabled":true,"errors":[],"sps":[]}
10482025-07-29T19:00:51.840ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
10492025-07-29T19:00:51.840ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
10502025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10512025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10522025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10532025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
10542025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
10552025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10562025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10572025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
10582025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10592025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 151 reason = Timeout
10602025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
10612025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
10622025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
10632025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
10642025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10652025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
10662025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10672025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
10682025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10692025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
10702025-07-29T19:00:51.841ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10712025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
10722025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10732025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10742025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10752025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
10762025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10772025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
10782025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10792025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
10802025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10812025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
10822025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10832025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10842025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10852025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10862025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10872025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10882025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10892025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
10902025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10912025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10922025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10932025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10942025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10952025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
10962025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10972025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10982025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10992025-07-29T19:00:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11002025-07-29T19:00:51.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11012025-07-29T19:00:51.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11022025-07-29T19:00:51.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11032025-07-29T19:00:51.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11042025-07-29T19:00:51.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.419133ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
11052025-07-29T19:00:51.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11062025-07-29T19:00:51.845ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11072025-07-29T19:00:51.845ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11082025-07-29T19:00:51.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11092025-07-29T19:00:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11102025-07-29T19:00:51.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11112025-07-29T19:00:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11122025-07-29T19:00:51.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11132025-07-29T19:00:51.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.564783ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
11142025-07-29T19:00:51.847ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11152025-07-29T19:00:51.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11162025-07-29T19:00:51.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11172025-07-29T19:00:51.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11182025-07-29T19:00:51.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11192025-07-29T19:00:51.850ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11202025-07-29T19:00:51.850ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11212025-07-29T19:00:51.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11222025-07-29T19:00:51.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11232025-07-29T19:00:51.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11242025-07-29T19:00:51.850ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11252025-07-29T19:00:51.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11262025-07-29T19:00:51.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11272025-07-29T19:00:51.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11282025-07-29T19:00:51.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
11292025-07-29T19:00:51.851ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
11302025-07-29T19:00:51.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11312025-07-29T19:00:51.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
11322025-07-29T19:00:51.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
11332025-07-29T19:00:51.852ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11342025-07-29T19:00:51.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11352025-07-29T19:00:51.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11362025-07-29T19:00:51.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11372025-07-29T19:00:51.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11382025-07-29T19:00:51.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11392025-07-29T19:00:51.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11402025-07-29T19:00:51.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1797, tv_nsec: 197932649 } })
11412025-07-29T19:00:51.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06
11422025-07-29T19:00:51.857ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11432025-07-29T19:00:51.857ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11442025-07-29T19:00:51.857ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11452025-07-29T19:00:51.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11462025-07-29T19:00:51.858ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
11472025-07-29T19:00:51.859ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 17.990222ms iteration = 151 status = {"chicken_switches_updated":false}
11482025-07-29T19:00:51.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11492025-07-29T19:00:51.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11502025-07-29T19:00:51.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11512025-07-29T19:00:51.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11522025-07-29T19:00:51.860ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 19.846984ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
11532025-07-29T19:00:51.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11542025-07-29T19:00:51.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11552025-07-29T19:00:51.863ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11562025-07-29T19:00:51.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11572025-07-29T19:00:51.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11582025-07-29T19:00:51.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11592025-07-29T19:00:51.898ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11602025-07-29T19:00:51.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11612025-07-29T19:00:51.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11622025-07-29T19:00:51.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11632025-07-29T19:00:51.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 62.060902ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
11642025-07-29T19:00:51.904ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 202.331218ms iteration = 26 status = {}
11652025-07-29T19:00:51.908ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11662025-07-29T19:00:51.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11672025-07-29T19:00:51.909ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11682025-07-29T19:00:51.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11692025-07-29T19:00:51.910ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11702025-07-29T19:00:51.911ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11712025-07-29T19:00:51.911ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.318463ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11722025-07-29T19:00:51.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11732025-07-29T19:00:51.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.965419ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11742025-07-29T19:00:51.913ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
11752025-07-29T19:00:51.913ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11762025-07-29T19:00:51.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11772025-07-29T19:00:51.915ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11782025-07-29T19:00:51.915ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.558741ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11792025-07-29T19:00:51.918ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11802025-07-29T19:00:51.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11812025-07-29T19:00:51.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11822025-07-29T19:00:51.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11832025-07-29T19:00:51.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.561342ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11842025-07-29T19:00:51.921ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 219.289851ms iteration = 26 status = null
11852025-07-29T19:00:51.921ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11862025-07-29T19:00:51.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11872025-07-29T19:00:51.921ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11882025-07-29T19:00:51.921ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 80.746853ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11892025-07-29T19:00:51.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11902025-07-29T19:00:51.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11912025-07-29T19:00:51.931ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11922025-07-29T19:00:51.931ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11932025-07-29T19:00:51.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11942025-07-29T19:00:51.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11952025-07-29T19:00:51.932ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 zone_address = fd00:1122:3344:101::2
11962025-07-29T19:00:51.932ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11972025-07-29T19:00:51.932ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "33c81b19-a6f2-4371-b389-1ac0991e3703", "content-length": "26", "date": "Tue, 29 Jul 2025 19:00:51 GMT"} })
11982025-07-29T19:00:51.932ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11992025-07-29T19:00:51.934ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06
12002025-07-29T19:00:51.935ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0a28dc16-a065-459e-b1aa-d53bcbda4625, lookup_type: ById(0a28dc16-a065-459e-b1aa-d53bcbda4625) } result = Ok(())
12012025-07-29T19:00:51.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12022025-07-29T19:00:51.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12032025-07-29T19:00:51.949ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:390
12042025-07-29T19:00:51.949ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 108.738925ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
12052025-07-29T19:00:51.951ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 original_time_created = 2025-07-29 18:48:16.280373 UTC target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 time_created = 2025-07-29 18:48:16.280373 UTC
12062025-07-29T19:00:51.951ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 110.653079ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0a28dc16-a065-459e-b1aa-d53bcbda4625","time_created":"2025-07-29T18:48:16.280373Z"}
12072025-07-29T19:00:51.957ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12082025-07-29T19:00:51.960ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9c9e9bac-4b96-4da6-bd17-bdedf998a5df, lookup_type: ById(9c9e9bac-4b96-4da6-bd17-bdedf998a5df) } result = Ok(())
12092025-07-29T19:00:51.960ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12102025-07-29T19:00:51.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12112025-07-29T19:00:51.962ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 121.42841ms iteration = 26 status = 0
12122025-07-29T19:00:51.983ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12132025-07-29T19:00:51.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12142025-07-29T19:00:52.001ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.085388ms iteration = 29 status = {"physical_disks_added":0}
12152025-07-29T19:00:52.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12162025-07-29T19:00:52.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12172025-07-29T19:00:52.027ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12182025-07-29T19:00:52.029ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12192025-07-29T19:00:52.029ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12202025-07-29T19:00:52.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12212025-07-29T19:00:52.031ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12222025-07-29T19:00:52.032ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12232025-07-29T19:00:52.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12242025-07-29T19:00:52.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12252025-07-29T19:00:52.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12262025-07-29T19:00:52.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12272025-07-29T19:00:52.049ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: ecf15dcb-e6bf-4724-9d10-8d03668d718d, rack_id: 9cf1a0c8-2288-4125-b368-b3ae91a98a06, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(d63a586e-232f-4911-b7dc-0748d82c16ec) } rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch_location = Switch0
12282025-07-29T19:00:52.049ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12292025-07-29T19:00:52.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12302025-07-29T19:00:52.060ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
12312025-07-29T19:00:52.060ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = d63a586e-232f-4911-b7dc-0748d82c16ec
12322025-07-29T19:00:52.061ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
12332025-07-29T19:00:52.061ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12342025-07-29T19:00:52.061ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12352025-07-29T19:00:52.061ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12362025-07-29T19:00:52.061ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12372025-07-29T19:00:52.061ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12382025-07-29T19:00:52.061ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12392025-07-29T19:00:52.061ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12402025-07-29T19:00:52.061ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06
12412025-07-29T19:00:52.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12422025-07-29T19:00:52.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12432025-07-29T19:00:52.063ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch_location = Switch0
12442025-07-29T19:00:52.063ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12452025-07-29T19:00:52.069ZINFOnexus (BackgroundTasks): VPC route manager sled 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12462025-07-29T19:00:52.069ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12472025-07-29T19:00:52.073ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5966bfba-83e5-4fbe-ae66-c8bdd03a64fd", "content-length": "372", "date": "Tue, 29 Jul 2025 19:00:51 GMT"} })
12482025-07-29T19:00:52.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12492025-07-29T19:00:52.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12502025-07-29T19:00:52.083ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12512025-07-29T19:00:52.088ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5aac36c6-617c-4699-b59b-91d28db5eca3", "content-length": "691", "date": "Tue, 29 Jul 2025 19:00:52 GMT"} })
12522025-07-29T19:00:52.088ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
12532025-07-29T19:00:52.088ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
12542025-07-29T19:00:52.088ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
12552025-07-29T19:00:52.089ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 248.833045ms iteration = 27 status = {}
12562025-07-29T19:00:52.126ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
12572025-07-29T19:00:52.126ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12582025-07-29T19:00:52.130ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ec6f0013-5066-4138-99e4-758fdf3a7762", "date": "Tue, 29 Jul 2025 19:00:51 GMT"} })
12592025-07-29T19:00:52.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12602025-07-29T19:00:52.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12612025-07-29T19:00:52.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12622025-07-29T19:00:52.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12632025-07-29T19:00:52.136ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12642025-07-29T19:00:52.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12652025-07-29T19:00:52.138ZINFOnexus (BackgroundTasks): VPC route manager sled 9c9e9bac-4b96-4da6-bd17-bdedf998a5df push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12662025-07-29T19:00:52.138ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12672025-07-29T19:00:52.139ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b0c63d15-3970-42f9-9b9e-67f93a2e6e2b", "date": "Tue, 29 Jul 2025 19:00:51 GMT"} })
12682025-07-29T19:00:52.140ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 299.656424ms iteration = 27 status = {}
12692025-07-29T19:00:52.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = ae7ec6c1-c376-48b6-a449-3a91a0e72d5d roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12702025-07-29T19:00:52.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = ae7ec6c1-c376-48b6-a449-3a91a0e72d5d resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12712025-07-29T19:00:52.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = ae7ec6c1-c376-48b6-a449-3a91a0e72d5d response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12722025-07-29T19:00:52.311ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ad5fa5e2-8cf3-4950-8ee0-84378a0a5b5c", "date": "Tue, 29 Jul 2025 19:00:51 GMT"} })
12732025-07-29T19:00:52.311ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch = Switch0
12742025-07-29T19:00:52.311ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12752025-07-29T19:00:52.311ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd0b64e5-97fc-4cbc-8a66-e0df7c4fe656", "content-length": "682", "date": "Tue, 29 Jul 2025 19:00:51 GMT"} })
12762025-07-29T19:00:52.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12772025-07-29T19:00:52.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12782025-07-29T19:00:52.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12792025-07-29T19:00:52.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12802025-07-29T19:00:52.320ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12812025-07-29T19:00:52.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12822025-07-29T19:00:52.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12832025-07-29T19:00:52.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12842025-07-29T19:00:52.330ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 489.893604ms iteration = 26 status = {}
12852025-07-29T19:00:53.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = d55a7ee5-6634-4394-b68b-18ce2d7b1062 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12862025-07-29T19:00:53.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = d55a7ee5-6634-4394-b68b-18ce2d7b1062 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12872025-07-29T19:00:53.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = d55a7ee5-6634-4394-b68b-18ce2d7b1062 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12882025-07-29T19:00:54.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 60e8a86c-8c56-4eba-8844-9259a81bc367 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12892025-07-29T19:00:54.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 60e8a86c-8c56-4eba-8844-9259a81bc367 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12902025-07-29T19:00:54.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 60e8a86c-8c56-4eba-8844-9259a81bc367 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12912025-07-29T19:00:55.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 48478fd6-589a-4aec-ac91-fbb7443a2ac0 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12922025-07-29T19:00:55.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 48478fd6-589a-4aec-ac91-fbb7443a2ac0 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12932025-07-29T19:00:55.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2647 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 48478fd6-589a-4aec-ac91-fbb7443a2ac0 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12942025-07-29T19:00:55.626ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 561 local_addr = [fd00:1122:3344:101::c]:51026 method = GET remote_addr = [fd00:1122:3344:101::d]:61933 req_id = 42aa9b68-eac1-4bab-b278-13c31d8a8812 response_code = 200 uri = /90ad0cc8-96db-48ff-b8fa-3f4895896eed
12952025-07-29T19:00:56.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = c5db040e-8538-4686-bc54-4ec8663a8317 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12962025-07-29T19:00:56.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = c5db040e-8538-4686-bc54-4ec8663a8317 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12972025-07-29T19:00:56.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = c5db040e-8538-4686-bc54-4ec8663a8317 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
12982025-07-29T19:00:56.840ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 152 reason = Timeout
12992025-07-29T19:00:56.840ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
13002025-07-29T19:00:56.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
13012025-07-29T19:00:56.842ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13022025-07-29T19:00:56.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
13032025-07-29T19:00:56.846ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
13042025-07-29T19:00:56.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
13052025-07-29T19:00:56.848ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
13062025-07-29T19:00:56.848ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.634683ms iteration = 152 status = {"chicken_switches_updated":false}
13072025-07-29T19:00:57.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 467bf826-2199-4237-a3bd-5eaa0c59e71e roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13082025-07-29T19:00:57.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 467bf826-2199-4237-a3bd-5eaa0c59e71e resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13092025-07-29T19:00:57.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 467bf826-2199-4237-a3bd-5eaa0c59e71e response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13102025-07-29T19:00:58.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4732e751-1116-4f66-b7cc-655d9c1e619f roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13112025-07-29T19:00:58.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4732e751-1116-4f66-b7cc-655d9c1e619f resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13122025-07-29T19:00:58.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4732e751-1116-4f66-b7cc-655d9c1e619f response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13132025-07-29T19:00:59.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3d19d77b-966a-41de-8937-270eac710adc roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13142025-07-29T19:00:59.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3d19d77b-966a-41de-8937-270eac710adc resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13152025-07-29T19:00:59.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3d19d77b-966a-41de-8937-270eac710adc response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13162025-07-29T19:01:00.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b043aeb1-f2e0-4fc0-b130-09793bd109ed roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13172025-07-29T19:01:00.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b043aeb1-f2e0-4fc0-b130-09793bd109ed resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13182025-07-29T19:01:00.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b043aeb1-f2e0-4fc0-b130-09793bd109ed response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13192025-07-29T19:01:01.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 324a1819-4175-47bd-8fc1-2008ede37a84 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13202025-07-29T19:01:01.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 324a1819-4175-47bd-8fc1-2008ede37a84 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13212025-07-29T19:01:01.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 324a1819-4175-47bd-8fc1-2008ede37a84 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13222025-07-29T19:01:01.840ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
13232025-07-29T19:01:01.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13242025-07-29T19:01:01.840ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
13252025-07-29T19:01:01.840ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 153 reason = Timeout
13262025-07-29T19:01:01.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13272025-07-29T19:01:01.840ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
13282025-07-29T19:01:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13292025-07-29T19:01:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13302025-07-29T19:01:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
13312025-07-29T19:01:01.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13322025-07-29T19:01:01.843ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13332025-07-29T19:01:01.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13342025-07-29T19:01:01.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13352025-07-29T19:01:01.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13362025-07-29T19:01:01.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
13372025-07-29T19:01:01.847ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
13382025-07-29T19:01:01.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
13392025-07-29T19:01:01.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13402025-07-29T19:01:01.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13412025-07-29T19:01:01.848ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
13422025-07-29T19:01:01.848ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.288151ms iteration = 153 status = {"chicken_switches_updated":false}
13432025-07-29T19:01:01.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13442025-07-29T19:01:01.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0a28dc16-a065-459e-b1aa-d53bcbda4625, lookup_type: ById(0a28dc16-a065-459e-b1aa-d53bcbda4625) } result = Ok(())
13452025-07-29T19:01:01.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13462025-07-29T19:01:01.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13472025-07-29T19:01:01.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 original_time_created = 2025-07-29 18:48:16.280373 UTC target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 time_created = 2025-07-29 18:48:16.280373 UTC
13482025-07-29T19:01:01.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.3104ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0a28dc16-a065-459e-b1aa-d53bcbda4625","time_created":"2025-07-29T18:48:16.280373Z"}
13492025-07-29T19:01:01.880ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13502025-07-29T19:01:01.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13512025-07-29T19:01:01.883ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.700142ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13522025-07-29T19:01:02.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 87fbd5b0-0d9f-4f5a-bd2a-a7cf188f449e roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13532025-07-29T19:01:02.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 87fbd5b0-0d9f-4f5a-bd2a-a7cf188f449e resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13542025-07-29T19:01:02.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 87fbd5b0-0d9f-4f5a-bd2a-a7cf188f449e response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13552025-07-29T19:01:03.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = faace54f-d49e-49a1-8d2d-e776665f6407 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13562025-07-29T19:01:03.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = faace54f-d49e-49a1-8d2d-e776665f6407 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13572025-07-29T19:01:03.423ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = faace54f-d49e-49a1-8d2d-e776665f6407 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13582025-07-29T19:01:04.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a74c747e-ff6d-434a-b712-9bc0e3a41b40 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13592025-07-29T19:01:04.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a74c747e-ff6d-434a-b712-9bc0e3a41b40 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13602025-07-29T19:01:04.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a74c747e-ff6d-434a-b712-9bc0e3a41b40 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13612025-07-29T19:01:05.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 97b62129-6330-4e50-b7b7-b5dc9bd6e5af roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13622025-07-29T19:01:05.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 97b62129-6330-4e50-b7b7-b5dc9bd6e5af resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13632025-07-29T19:01:05.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 97b62129-6330-4e50-b7b7-b5dc9bd6e5af response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13642025-07-29T19:01:05.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = c8f5eaab-1f6b-4dd2-a463-4a651879212c roles = RoleSet { roles: {} } uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?sort_by=id_ascending
13652025-07-29T19:01:05.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = c8f5eaab-1f6b-4dd2-a463-4a651879212c resource = Database result = Ok(()) uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?sort_by=id_ascending
13662025-07-29T19:01:05.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = c8f5eaab-1f6b-4dd2-a463-4a651879212c response_code = 200 uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?sort_by=id_ascending
13672025-07-29T19:01:05.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = 2500d420-260f-4b47-8373-77aa40252a5e roles = RoleSet { roles: {} } uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNDIwZTUxZC1lZTA5LTQ0ZGItYjc1ZS1hOTRmY2E5MjlmMjQifX0%3D
13682025-07-29T19:01:05.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = 2500d420-260f-4b47-8373-77aa40252a5e resource = Database result = Ok(()) uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNDIwZTUxZC1lZTA5LTQ0ZGItYjc1ZS1hOTRmY2E5MjlmMjQifX0%3D
13692025-07-29T19:01:05.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48374 req_id = 2500d420-260f-4b47-8373-77aa40252a5e response_code = 200 uri = /metrics/collectors/b7eba1f4-771d-464b-b239-7b11b0c8ccfd/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmNDIwZTUxZC1lZTA5LTQ0ZGItYjc1ZS1hOTRmY2E5MjlmMjQifX0%3D
13702025-07-29T19:01:05.627ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 652 local_addr = [fd00:1122:3344:101::c]:51026 method = GET remote_addr = [fd00:1122:3344:101::d]:61933 req_id = 30fdb21c-bc1c-47d9-be8a-8746bccd9f4d response_code = 200 uri = /90ad0cc8-96db-48ff-b8fa-3f4895896eed
13712025-07-29T19:01:06.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3388deb0-e7ae-44aa-9a51-c7b8aeb26b4f roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13722025-07-29T19:01:06.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3388deb0-e7ae-44aa-9a51-c7b8aeb26b4f resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13732025-07-29T19:01:06.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3388deb0-e7ae-44aa-9a51-c7b8aeb26b4f response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13742025-07-29T19:01:06.840ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 154 reason = Timeout
13752025-07-29T19:01:06.840ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
13762025-07-29T19:01:06.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
13772025-07-29T19:01:06.842ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13782025-07-29T19:01:06.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
13792025-07-29T19:01:06.845ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
13802025-07-29T19:01:06.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
13812025-07-29T19:01:06.847ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
13822025-07-29T19:01:06.847ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.711337ms iteration = 154 status = {"chicken_switches_updated":false}
13832025-07-29T19:01:07.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3bfa3240-9c8a-4e0d-ab81-285dc70ec2ca roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13842025-07-29T19:01:07.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3bfa3240-9c8a-4e0d-ab81-285dc70ec2ca resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13852025-07-29T19:01:07.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3bfa3240-9c8a-4e0d-ab81-285dc70ec2ca response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13862025-07-29T19:01:08.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3b4f1148-d3b2-4fd3-a19d-1be0ed1b2670 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13872025-07-29T19:01:08.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3b4f1148-d3b2-4fd3-a19d-1be0ed1b2670 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13882025-07-29T19:01:08.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3b4f1148-d3b2-4fd3-a19d-1be0ed1b2670 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13892025-07-29T19:01:09.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4d69dbac-1ad8-4033-81aa-a1f867340b4b roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13902025-07-29T19:01:09.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4d69dbac-1ad8-4033-81aa-a1f867340b4b resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13912025-07-29T19:01:09.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 4d69dbac-1ad8-4033-81aa-a1f867340b4b response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13922025-07-29T19:01:10.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 5d63416d-d0f5-4593-a2b2-7df76cd90485 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13932025-07-29T19:01:10.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 5d63416d-d0f5-4593-a2b2-7df76cd90485 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13942025-07-29T19:01:10.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 5d63416d-d0f5-4593-a2b2-7df76cd90485 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13952025-07-29T19:01:11.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = baf4a3b5-a1f7-4054-b695-b40a7b568d5f roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13962025-07-29T19:01:11.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = baf4a3b5-a1f7-4054-b695-b40a7b568d5f resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13972025-07-29T19:01:11.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = baf4a3b5-a1f7-4054-b695-b40a7b568d5f response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
13982025-07-29T19:01:11.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
13992025-07-29T19:01:11.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
14002025-07-29T19:01:11.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14012025-07-29T19:01:11.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14022025-07-29T19:01:11.840ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 155 reason = Timeout
14032025-07-29T19:01:11.840ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
14042025-07-29T19:01:11.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14052025-07-29T19:01:11.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14062025-07-29T19:01:11.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
14072025-07-29T19:01:11.841ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14082025-07-29T19:01:11.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14092025-07-29T19:01:11.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14102025-07-29T19:01:11.842ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14112025-07-29T19:01:11.843ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.884618ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14122025-07-29T19:01:11.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14132025-07-29T19:01:11.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14142025-07-29T19:01:11.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14152025-07-29T19:01:11.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
14162025-07-29T19:01:11.846ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
14172025-07-29T19:01:11.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
14182025-07-29T19:01:11.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14192025-07-29T19:01:11.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14202025-07-29T19:01:11.848ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
14212025-07-29T19:01:11.848ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.473846ms iteration = 155 status = {"chicken_switches_updated":false}
14222025-07-29T19:01:11.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14232025-07-29T19:01:11.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0a28dc16-a065-459e-b1aa-d53bcbda4625, lookup_type: ById(0a28dc16-a065-459e-b1aa-d53bcbda4625) } result = Ok(())
14242025-07-29T19:01:11.851ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14252025-07-29T19:01:11.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14262025-07-29T19:01:11.866ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 original_time_created = 2025-07-29 18:48:16.280373 UTC target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 time_created = 2025-07-29 18:48:16.280373 UTC
14272025-07-29T19:01:11.866ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.53712ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0a28dc16-a065-459e-b1aa-d53bcbda4625","time_created":"2025-07-29T18:48:16.280373Z"}
14282025-07-29T19:01:12.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b846549a-6e3f-49ab-bc8e-842db3863b92 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14292025-07-29T19:01:12.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b846549a-6e3f-49ab-bc8e-842db3863b92 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14302025-07-29T19:01:12.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b846549a-6e3f-49ab-bc8e-842db3863b92 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14312025-07-29T19:01:13.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 031ddf0f-b67b-437e-8024-b33bfa6e472f roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14322025-07-29T19:01:13.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 031ddf0f-b67b-437e-8024-b33bfa6e472f resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14332025-07-29T19:01:13.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 031ddf0f-b67b-437e-8024-b33bfa6e472f response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14342025-07-29T19:01:14.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 12ba3073-24b5-4375-b43d-daefa29bc3d9 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14352025-07-29T19:01:14.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 12ba3073-24b5-4375-b43d-daefa29bc3d9 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14362025-07-29T19:01:14.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 12ba3073-24b5-4375-b43d-daefa29bc3d9 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14372025-07-29T19:01:15.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = e0554c8d-8ec3-46c7-98d1-77bb2cd2924a roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14382025-07-29T19:01:15.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = e0554c8d-8ec3-46c7-98d1-77bb2cd2924a resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14392025-07-29T19:01:15.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = e0554c8d-8ec3-46c7-98d1-77bb2cd2924a response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14402025-07-29T19:01:15.626ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 567 local_addr = [fd00:1122:3344:101::c]:51026 method = GET remote_addr = [fd00:1122:3344:101::d]:61933 req_id = 9079f3d3-82a6-410a-b09b-c7247d4a49b0 response_code = 200 uri = /90ad0cc8-96db-48ff-b8fa-3f4895896eed
14412025-07-29T19:01:16.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = e5c5bb72-4853-48b0-bfec-d1a047f7185a roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14422025-07-29T19:01:16.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = e5c5bb72-4853-48b0-bfec-d1a047f7185a resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14432025-07-29T19:01:16.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = e5c5bb72-4853-48b0-bfec-d1a047f7185a response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14442025-07-29T19:01:16.840ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 156 reason = Timeout
14452025-07-29T19:01:16.840ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
14462025-07-29T19:01:16.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
14472025-07-29T19:01:16.842ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14482025-07-29T19:01:16.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
14492025-07-29T19:01:16.845ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
14502025-07-29T19:01:16.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
14512025-07-29T19:01:16.847ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
14522025-07-29T19:01:16.847ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.588434ms iteration = 156 status = {"chicken_switches_updated":false}
14532025-07-29T19:01:17.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2cb9c715-0f85-47ba-9c7e-b2d78fea93ab roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14542025-07-29T19:01:17.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2cb9c715-0f85-47ba-9c7e-b2d78fea93ab resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14552025-07-29T19:01:17.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2cb9c715-0f85-47ba-9c7e-b2d78fea93ab response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14562025-07-29T19:01:18.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 6909d5a4-476b-4bd6-bb9c-abca90022e7a roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14572025-07-29T19:01:18.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 6909d5a4-476b-4bd6-bb9c-abca90022e7a resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14582025-07-29T19:01:18.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2550 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 6909d5a4-476b-4bd6-bb9c-abca90022e7a response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14592025-07-29T19:01:19.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3df803cc-c264-4653-82f7-268705863e74 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14602025-07-29T19:01:19.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3df803cc-c264-4653-82f7-268705863e74 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14612025-07-29T19:01:19.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3df803cc-c264-4653-82f7-268705863e74 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14622025-07-29T19:01:20.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2eff2d93-817e-4c79-9f26-75ce22b8366e roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14632025-07-29T19:01:20.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2eff2d93-817e-4c79-9f26-75ce22b8366e resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14642025-07-29T19:01:20.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2eff2d93-817e-4c79-9f26-75ce22b8366e response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
14652025-07-29T19:01:21.701ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
14662025-07-29T19:01:21.701ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625
14672025-07-29T19:01:21.701ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 21.351\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"0a28dc16-a065-459e-b1aa-d53bcbda4625"}
14682025-07-29T19:01:21.701ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
14692025-07-29T19:01:21.701ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
14702025-07-29T19:01:21.701ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
14712025-07-29T19:01:21.701ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
14722025-07-29T19:01:21.701ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14732025-07-29T19:01:21.701ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
14742025-07-29T19:01:21.701ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14752025-07-29T19:01:21.701ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
14762025-07-29T19:01:21.701ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
14772025-07-29T19:01:21.701ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
14782025-07-29T19:01:21.702ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-07-29 18:51:21.701868096 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
14792025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14802025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
14812025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
14822025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
14832025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
14842025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14852025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
14862025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14872025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14882025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14892025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
14902025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14912025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14922025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14932025-07-29T19:01:21.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14942025-07-29T19:01:21.702ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5f029ed2-cb9f-4a2a-abfb-658c8c935c5f.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd3b3189-49d4-477c-a714-9ae9f7b62166.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("bd3b3189-49d4-477c-a714-9ae9f7b62166.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::9)) }], valid_until: Instant { tv_sec: 1827, tv_nsec: 45123804 } })
14952025-07-29T19:01:21.702ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("06f95c1c-5c20-4b26-9468-cc969d04624c.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b26eec37-84dc-4d06-a9f1-8c4aaa12bb61.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e3550944-bdfd-4b05-a84f-d19ead76f5ae.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("e3550944-bdfd-4b05-a84f-d19ead76f5ae.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:1::1)) }], valid_until: Instant { tv_sec: 1827, tv_nsec: 45144234 } })
14962025-07-29T19:01:21.703ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
14972025-07-29T19:01:21.703ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.475752ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
14982025-07-29T19:01:21.703ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
14992025-07-29T19:01:21.703ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.585195ms iteration = 14 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
15002025-07-29T19:01:21.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15012025-07-29T19:01:21.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15022025-07-29T19:01:21.705ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1827, tv_nsec: 47790508 } })
15032025-07-29T19:01:21.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15042025-07-29T19:01:21.705ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
15052025-07-29T19:01:21.705ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-07-29 18:51:21.701868096 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
15062025-07-29T19:01:21.705ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.997921ms iteration = 14 status = {"expiration":"2025-07-29T18:51:21.701868096Z","pruned":[]}
15072025-07-29T19:01:21.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15082025-07-29T19:01:21.705ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15092025-07-29T19:01:21.706ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.794083ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15102025-07-29T19:01:21.707ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1827, tv_nsec: 49961089 } })
15112025-07-29T19:01:21.707ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
15122025-07-29T19:01:21.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15132025-07-29T19:01:21.709ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15142025-07-29T19:01:21.709ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15152025-07-29T19:01:21.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15162025-07-29T19:01:21.711ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15172025-07-29T19:01:21.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15182025-07-29T19:01:21.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3fcdeed3-52fe-4572-9716-8717d76db9a8 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
15192025-07-29T19:01:21.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15202025-07-29T19:01:21.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3fcdeed3-52fe-4572-9716-8717d76db9a8 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
15212025-07-29T19:01:21.713ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15222025-07-29T19:01:21.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 3fcdeed3-52fe-4572-9716-8717d76db9a8 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
15232025-07-29T19:01:21.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15242025-07-29T19:01:21.717ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15252025-07-29T19:01:21.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15262025-07-29T19:01:21.719ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15272025-07-29T19:01:21.719ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_planner iteration = 18 reason = Timeout
15282025-07-29T19:01:21.719ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
15292025-07-29T19:01:21.719ZDEBGnexus (BackgroundTasks): blueprint planning disabled, doing nothing background_task = blueprint_planner
15302025-07-29T19:01:21.719ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
15312025-07-29T19:01:21.719ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_planner elapsed = 11.791\u{b5}s iteration = 18 status = "Disabled"
15322025-07-29T19:01:21.720ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15332025-07-29T19:01:21.720ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
15342025-07-29T19:01:21.720ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
15352025-07-29T19:01:21.720ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
15362025-07-29T19:01:21.720ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15372025-07-29T19:01:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15382025-07-29T19:01:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15392025-07-29T19:01:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15402025-07-29T19:01:21.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
15412025-07-29T19:01:21.722ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15422025-07-29T19:01:21.724ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
15432025-07-29T19:01:21.724ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
15442025-07-29T19:01:21.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
15452025-07-29T19:01:21.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
15462025-07-29T19:01:21.726ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15472025-07-29T19:01:21.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15482025-07-29T19:01:21.726ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 2.538011ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
15492025-07-29T19:01:21.736ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 14 reason = Timeout
15502025-07-29T19:01:21.736ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
15512025-07-29T19:01:21.736ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 14 reason = Timeout
15522025-07-29T19:01:21.736ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
15532025-07-29T19:01:21.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
15542025-07-29T19:01:21.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
15552025-07-29T19:01:21.746ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:204 num_receivers = 0
15562025-07-29T19:01:21.746ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 10.201495ms iteration = 14 status = {"by_rx":{},"error":null}
15572025-07-29T19:01:21.756ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
15582025-07-29T19:01:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
15592025-07-29T19:01:21.760ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 23.742243ms iteration = 14 status = {"dispatched":[],"errors":[],"glob_version":"173.0.0","globs_reprocessed":{},"no_receivers":[]}
15602025-07-29T19:01:21.785ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15612025-07-29T19:01:21.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15622025-07-29T19:01:21.793ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15632025-07-29T19:01:21.795ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15642025-07-29T19:01:21.795ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15652025-07-29T19:01:21.795ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15662025-07-29T19:01:21.795ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15672025-07-29T19:01:21.795ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15682025-07-29T19:01:21.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15692025-07-29T19:01:21.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15702025-07-29T19:01:21.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15712025-07-29T19:01:21.796ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
15722025-07-29T19:01:21.796ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:170 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
15732025-07-29T19:01:21.796ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 76.228837ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
15742025-07-29T19:01:21.808ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15752025-07-29T19:01:21.808ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:138 found = 0 not_ready_to_be_deleted = 0
15762025-07-29T19:01:21.808ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 88.181422ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15772025-07-29T19:01:21.834ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15782025-07-29T19:01:21.838ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15792025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 27 reason = Timeout
15802025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 19.391\u{b5}s iteration = 27 status = {"disabled":true,"errors":[],"sps":[]}
15812025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
15822025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
15832025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
15842025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
15852025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15862025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15872025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
15882025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
15892025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15902025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15912025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
15922025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15932025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15942025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
15952025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
15962025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15972025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15982025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
15992025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16002025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
16012025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
16022025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16032025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16042025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
16052025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16062025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 157 reason = Timeout
16072025-07-29T19:01:21.840ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16082025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
16092025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
16102025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
16112025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
16122025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
16132025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16142025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
16152025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16162025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
16172025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16182025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
16192025-07-29T19:01:21.841ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16202025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16212025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16222025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16232025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
16242025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16252025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16262025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16272025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16282025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16292025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16302025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
16312025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16322025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
16332025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16342025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16352025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16362025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16372025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16382025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16392025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16402025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16412025-07-29T19:01:21.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16422025-07-29T19:01:21.842ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16432025-07-29T19:01:21.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16442025-07-29T19:01:21.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16452025-07-29T19:01:21.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16462025-07-29T19:01:21.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16472025-07-29T19:01:21.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16482025-07-29T19:01:21.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16492025-07-29T19:01:21.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16502025-07-29T19:01:21.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16512025-07-29T19:01:21.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16522025-07-29T19:01:21.849ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-07-29T18:48:16.146073Z, time_modified: 2025-07-29T18:48:16.146073Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 7849f1ec-cda6-460a-927c-8287cd3fb888, db_silo: Silo { identity: SiloIdentity { id: 7849f1ec-cda6-460a-927c-8287cd3fb888, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-29T18:48:50.390458Z, time_modified: 2025-07-29T18:48:50.390458Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1b8f4f66f00ad0ab9230664f0c2d86fec1b5c246e3aa63f4e554294f2ab9c68f" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 7849f1ec-cda6-460a-927c-8287cd3fb888, db_silo: Silo { identity: SiloIdentity { id: 7849f1ec-cda6-460a-927c-8287cd3fb888, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-07-29T18:48:50.390458Z, time_modified: 2025-07-29T18:48:50.390458Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "1b8f4f66f00ad0ab9230664f0c2d86fec1b5c246e3aa63f4e554294f2ab9c68f" }] }) }
16532025-07-29T19:01:21.849ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 146.937751ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"7849f1ec-cda6-460a-927c-8287cd3fb888","tls_certs":["1b8f4f66f00ad0ab9230664f0c2d86fec1b5c246e3aa63f4e554294f2ab9c68f"]}},"default_endpoint":{"silo_id":"7849f1ec-cda6-460a-927c-8287cd3fb888","tls_certs":["1b8f4f66f00ad0ab9230664f0c2d86fec1b5c246e3aa63f4e554294f2ab9c68f"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
16542025-07-29T19:01:21.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16552025-07-29T19:01:21.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16562025-07-29T19:01:21.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16572025-07-29T19:01:21.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16582025-07-29T19:01:21.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
16592025-07-29T19:01:21.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16602025-07-29T19:01:21.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16612025-07-29T19:01:21.851ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16622025-07-29T19:01:21.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16632025-07-29T19:01:21.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16642025-07-29T19:01:21.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16652025-07-29T19:01:21.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
16662025-07-29T19:01:21.855ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
16672025-07-29T19:01:21.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
16682025-07-29T19:01:21.860ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
16692025-07-29T19:01:21.860ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16702025-07-29T19:01:21.860ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff525c46-1bea-4e27-85f2-ebfab9239e47", "content-length": "26", "date": "Tue, 29 Jul 2025 19:01:21 GMT"} })
16712025-07-29T19:01:21.860ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16722025-07-29T19:01:21.862ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 21.530911ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
16732025-07-29T19:01:21.863ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16742025-07-29T19:01:21.863ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16752025-07-29T19:01:21.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16762025-07-29T19:01:21.863ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16772025-07-29T19:01:21.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16782025-07-29T19:01:21.865ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1827, tv_nsec: 208303388 } })
16792025-07-29T19:01:21.866ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06
16802025-07-29T19:01:21.866ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
16812025-07-29T19:01:21.866ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 26.109338ms iteration = 157 status = {"chicken_switches_updated":false}
16822025-07-29T19:01:21.885ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16832025-07-29T19:01:21.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16842025-07-29T19:01:21.909ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16852025-07-29T19:01:21.910ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
16862025-07-29T19:01:21.912ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16872025-07-29T19:01:21.912ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 38285aad-e399-45b9-b320-a1b8587dde71 dns_zone_name = oxide.test found_so_far = 0 version = 2
16882025-07-29T19:01:21.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16892025-07-29T19:01:21.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16902025-07-29T19:01:21.912ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16912025-07-29T19:01:21.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16922025-07-29T19:01:21.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16932025-07-29T19:01:21.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.332857ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
16942025-07-29T19:01:21.915ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16952025-07-29T19:01:21.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16962025-07-29T19:01:21.916ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16972025-07-29T19:01:21.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16982025-07-29T19:01:21.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16992025-07-29T19:01:21.919ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17002025-07-29T19:01:21.919ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17012025-07-29T19:01:21.919ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17022025-07-29T19:01:21.919ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.792478ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17032025-07-29T19:01:21.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17042025-07-29T19:01:21.920ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17052025-07-29T19:01:21.920ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17062025-07-29T19:01:21.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17072025-07-29T19:01:21.921ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 80.643991ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
17082025-07-29T19:01:21.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17092025-07-29T19:01:21.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17102025-07-29T19:01:21.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17112025-07-29T19:01:21.922ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17122025-07-29T19:01:21.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17132025-07-29T19:01:21.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17142025-07-29T19:01:21.923ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17152025-07-29T19:01:21.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17162025-07-29T19:01:21.924ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 38285aad-e399-45b9-b320-a1b8587dde71 dns_zone_name = oxide.test found_so_far = 4 version = 2
17172025-07-29T19:01:21.924ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
17182025-07-29T19:01:21.924ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-07-29 18:48:50.467734 UTC dns_group = external generation = 2
17192025-07-29T19:01:21.924ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 222.626103ms iteration = 14 status = {"generation":2}
17202025-07-29T19:01:21.925ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17212025-07-29T19:01:21.925ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17222025-07-29T19:01:21.925ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17232025-07-29T19:01:21.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17242025-07-29T19:01:21.925ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17252025-07-29T19:01:21.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17262025-07-29T19:01:21.927ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17272025-07-29T19:01:21.928ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17282025-07-29T19:01:21.928ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.246303ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17292025-07-29T19:01:21.929ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
17302025-07-29T19:01:21.929ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 2fde86c3-c290-45be-ba40-b0329a048813 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
17312025-07-29T19:01:21.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17322025-07-29T19:01:21.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17332025-07-29T19:01:21.930ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17342025-07-29T19:01:21.930ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17352025-07-29T19:01:21.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17362025-07-29T19:01:21.930ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17372025-07-29T19:01:21.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17382025-07-29T19:01:21.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17392025-07-29T19:01:21.931ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17402025-07-29T19:01:21.934ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17412025-07-29T19:01:21.934ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17422025-07-29T19:01:21.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17432025-07-29T19:01:21.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17442025-07-29T19:01:21.936ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17452025-07-29T19:01:21.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17462025-07-29T19:01:21.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17472025-07-29T19:01:21.939ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0a28dc16-a065-459e-b1aa-d53bcbda4625, lookup_type: ById(0a28dc16-a065-459e-b1aa-d53bcbda4625) } result = Ok(())
17482025-07-29T19:01:21.939ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17492025-07-29T19:01:21.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17502025-07-29T19:01:21.946ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 2fde86c3-c290-45be-ba40-b0329a048813 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
17512025-07-29T19:01:21.946ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17522025-07-29T19:01:21.946ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-07-29 18:48:49.884149 UTC dns_group = internal generation = 1
17532025-07-29T19:01:21.946ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 244.167934ms iteration = 14 status = {"generation":1}
17542025-07-29T19:01:21.946ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17552025-07-29T19:01:21.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17562025-07-29T19:01:21.948ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17572025-07-29T19:01:21.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17582025-07-29T19:01:21.950ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17592025-07-29T19:01:21.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17602025-07-29T19:01:21.950ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17612025-07-29T19:01:21.952ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17622025-07-29T19:01:21.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17632025-07-29T19:01:21.953ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17642025-07-29T19:01:21.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17652025-07-29T19:01:21.956ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9c9e9bac-4b96-4da6-bd17-bdedf998a5df, lookup_type: ById(9c9e9bac-4b96-4da6-bd17-bdedf998a5df) } result = Ok(())
17662025-07-29T19:01:21.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17672025-07-29T19:01:21.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17682025-07-29T19:01:21.959ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.527278ms iteration = 27 status = 0
17692025-07-29T19:01:21.960ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 original_time_created = 2025-07-29 18:48:16.280373 UTC target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 time_created = 2025-07-29 18:48:16.280373 UTC
17702025-07-29T19:01:21.960ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 119.465144ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0a28dc16-a065-459e-b1aa-d53bcbda4625","time_created":"2025-07-29T18:48:16.280373Z"}
17712025-07-29T19:01:21.969ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 129.38282ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
17722025-07-29T19:01:21.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17732025-07-29T19:01:21.977ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 136.491809ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17742025-07-29T19:01:21.978ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17752025-07-29T19:01:21.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17762025-07-29T19:01:21.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17772025-07-29T19:01:21.979ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
17782025-07-29T19:01:21.979ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17792025-07-29T19:01:21.980ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e76d2f4c-9180-4d6e-996f-379d1f2eeff7", "content-length": "26", "date": "Tue, 29 Jul 2025 19:01:21 GMT"} })
17802025-07-29T19:01:21.980ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17812025-07-29T19:01:21.982ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17822025-07-29T19:01:21.982ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17832025-07-29T19:01:21.982ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17842025-07-29T19:01:21.982ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.24797ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17852025-07-29T19:01:21.984ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
17862025-07-29T19:01:21.984ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9b4c6ea2-5f62-43f2-b673-2c2fab248bd5", "date": "Tue, 29 Jul 2025 19:01:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17872025-07-29T19:01:21.984ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17882025-07-29T19:01:21.987ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ce0a8b5f-79c1-43db-8dd5-853513014b93", "date": "Tue, 29 Jul 2025 19:01:21 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17892025-07-29T19:01:21.987ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17902025-07-29T19:01:21.989ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17912025-07-29T19:01:21.989ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 287.793913ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
17922025-07-29T19:01:21.990ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:390
17932025-07-29T19:01:21.990ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 150.031887ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
17942025-07-29T19:01:21.994ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 153.393191ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17952025-07-29T19:01:22.008ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.546976ms iteration = 30 status = {"physical_disks_added":0}
17962025-07-29T19:01:22.012ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 311.189475ms iteration = 27 status = {}
17972025-07-29T19:01:22.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17982025-07-29T19:01:22.019ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 zone_address = fd00:1122:3344:101::2
17992025-07-29T19:01:22.019ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18002025-07-29T19:01:22.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18012025-07-29T19:01:22.019ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "59ef1e5c-e9d3-485a-a84c-2a913a4d975f", "content-length": "26", "date": "Tue, 29 Jul 2025 19:01:21 GMT"} })
18022025-07-29T19:01:22.019ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18032025-07-29T19:01:22.021ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06
18042025-07-29T19:01:22.056ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
18052025-07-29T19:01:22.074ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
18062025-07-29T19:01:22.074ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 354.36633ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
18072025-07-29T19:01:22.076ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18082025-07-29T19:01:22.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18092025-07-29T19:01:22.077ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18102025-07-29T19:01:22.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18112025-07-29T19:01:22.079ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18122025-07-29T19:01:22.079ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 377.345902ms iteration = 27 status = null
18132025-07-29T19:01:22.081ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18142025-07-29T19:01:22.081ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18152025-07-29T19:01:22.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18162025-07-29T19:01:22.083ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18172025-07-29T19:01:22.085ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18182025-07-29T19:01:22.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18192025-07-29T19:01:22.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18202025-07-29T19:01:22.135ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
18212025-07-29T19:01:22.136ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "aaaccfa4-eb18-48e9-aa59-a1d2fa9d84a1", "date": "Tue, 29 Jul 2025 19:01:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
18222025-07-29T19:01:22.136ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
18232025-07-29T19:01:22.138ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ab8ace39-31c9-4ce7-bf72-ecea76552658", "date": "Tue, 29 Jul 2025 19:01:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
18242025-07-29T19:01:22.138ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
18252025-07-29T19:01:22.140ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e25235b9-bb6c-4703-a38f-e855272f3ee1", "date": "Tue, 29 Jul 2025 19:01:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
18262025-07-29T19:01:22.140ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
18272025-07-29T19:01:22.141ZINFOnexus (BackgroundTasks): VPC route manager sled 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
18282025-07-29T19:01:22.141ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18292025-07-29T19:01:22.142ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff91c699-2fd7-4023-a696-6b79bb0e1dc6", "content-length": "372", "date": "Tue, 29 Jul 2025 19:01:21 GMT"} })
18302025-07-29T19:01:22.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18312025-07-29T19:01:22.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18322025-07-29T19:01:22.143ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
18332025-07-29T19:01:22.143ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 441.273806ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
18342025-07-29T19:01:22.170ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
18352025-07-29T19:01:22.170ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
18362025-07-29T19:01:22.170ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7bb29129-1057-4ddf-9076-811c74c3d3b8", "date": "Tue, 29 Jul 2025 19:01:21 GMT"} })
18372025-07-29T19:01:22.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18382025-07-29T19:01:22.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18392025-07-29T19:01:22.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18402025-07-29T19:01:22.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18412025-07-29T19:01:22.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18422025-07-29T19:01:22.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18432025-07-29T19:01:22.188ZINFOnexus (BackgroundTasks): VPC route manager sled 9c9e9bac-4b96-4da6-bd17-bdedf998a5df push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18442025-07-29T19:01:22.188ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18452025-07-29T19:01:22.188ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "12b60dc5-2bd3-458c-9fce-e0e558e3f216", "date": "Tue, 29 Jul 2025 19:01:21 GMT"} })
18462025-07-29T19:01:22.191ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 350.275557ms iteration = 28 status = {}
18472025-07-29T19:01:22.240ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18482025-07-29T19:01:22.240ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6576d23-dea3-4d3a-883b-06ddb9c96843", "content-length": "691", "date": "Tue, 29 Jul 2025 19:01:21 GMT"} })
18492025-07-29T19:01:22.240ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
18502025-07-29T19:01:22.240ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18512025-07-29T19:01:22.240ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18522025-07-29T19:01:22.243ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 402.791383ms iteration = 28 status = {}
18532025-07-29T19:01:22.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18542025-07-29T19:01:22.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18552025-07-29T19:01:22.259ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: ecf15dcb-e6bf-4724-9d10-8d03668d718d, rack_id: 9cf1a0c8-2288-4125-b368-b3ae91a98a06, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(d63a586e-232f-4911-b7dc-0748d82c16ec) } rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch_location = Switch0
18562025-07-29T19:01:22.259ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18572025-07-29T19:01:22.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18582025-07-29T19:01:22.273ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
18592025-07-29T19:01:22.274ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = d63a586e-232f-4911-b7dc-0748d82c16ec
18602025-07-29T19:01:22.274ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18612025-07-29T19:01:22.274ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18622025-07-29T19:01:22.274ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18632025-07-29T19:01:22.274ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18642025-07-29T19:01:22.274ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18652025-07-29T19:01:22.274ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18662025-07-29T19:01:22.274ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18672025-07-29T19:01:22.274ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18682025-07-29T19:01:22.275ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06
18692025-07-29T19:01:22.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18702025-07-29T19:01:22.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18712025-07-29T19:01:22.278ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch_location = Switch0
18722025-07-29T19:01:22.278ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18732025-07-29T19:01:22.489ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4c677914-eff3-4022-a230-7c4d6911b373", "date": "Tue, 29 Jul 2025 19:01:21 GMT"} })
18742025-07-29T19:01:22.489ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch = Switch0
18752025-07-29T19:01:22.489ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18762025-07-29T19:01:22.490ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b6c66e1-38b6-49c9-bf9b-20d7a9ec1ae8", "content-length": "682", "date": "Tue, 29 Jul 2025 19:01:22 GMT"} })
18772025-07-29T19:01:22.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18782025-07-29T19:01:22.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18792025-07-29T19:01:22.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18802025-07-29T19:01:22.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18812025-07-29T19:01:22.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18822025-07-29T19:01:22.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18832025-07-29T19:01:22.499ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18842025-07-29T19:01:22.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18852025-07-29T19:01:22.507ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 666.75239ms iteration = 27 status = {}
18862025-07-29T19:01:22.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 349aa838-8354-4c45-bb49-230350180fbf roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
18872025-07-29T19:01:22.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 349aa838-8354-4c45-bb49-230350180fbf resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
18882025-07-29T19:01:22.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 349aa838-8354-4c45-bb49-230350180fbf response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
18892025-07-29T19:01:23.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 8c05d132-e4a6-4bf3-bba4-2a3f750a3b61 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
18902025-07-29T19:01:23.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 8c05d132-e4a6-4bf3-bba4-2a3f750a3b61 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
18912025-07-29T19:01:23.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 8c05d132-e4a6-4bf3-bba4-2a3f750a3b61 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
18922025-07-29T19:01:24.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f5a2f163-ef3d-4e4f-93f5-c987a09607d2 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
18932025-07-29T19:01:24.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f5a2f163-ef3d-4e4f-93f5-c987a09607d2 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
18942025-07-29T19:01:24.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f5a2f163-ef3d-4e4f-93f5-c987a09607d2 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
18952025-07-29T19:01:25.626ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 906 local_addr = [fd00:1122:3344:101::c]:51026 method = GET remote_addr = [fd00:1122:3344:101::d]:61933 req_id = ec46bfe4-d47d-4cb9-a1f0-c7bd034b07b1 response_code = 200 uri = /90ad0cc8-96db-48ff-b8fa-3f4895896eed
18962025-07-29T19:01:25.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 22fb1910-d486-436b-86b1-8ffb5f87419f roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
18972025-07-29T19:01:25.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 22fb1910-d486-436b-86b1-8ffb5f87419f resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
18982025-07-29T19:01:25.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 22fb1910-d486-436b-86b1-8ffb5f87419f response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
18992025-07-29T19:01:26.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 744a8759-a858-4a57-9fd5-4dec14da9777 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19002025-07-29T19:01:26.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 744a8759-a858-4a57-9fd5-4dec14da9777 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19012025-07-29T19:01:26.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 744a8759-a858-4a57-9fd5-4dec14da9777 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19022025-07-29T19:01:26.840ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 158 reason = Timeout
19032025-07-29T19:01:26.840ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
19042025-07-29T19:01:26.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
19052025-07-29T19:01:26.842ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19062025-07-29T19:01:26.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
19072025-07-29T19:01:26.845ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
19082025-07-29T19:01:26.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
19092025-07-29T19:01:26.847ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
19102025-07-29T19:01:26.848ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.722355ms iteration = 158 status = {"chicken_switches_updated":false}
19112025-07-29T19:01:27.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b4fdc570-6710-42c8-b0b1-4b166a6668bf roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19122025-07-29T19:01:27.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b4fdc570-6710-42c8-b0b1-4b166a6668bf resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19132025-07-29T19:01:27.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b4fdc570-6710-42c8-b0b1-4b166a6668bf response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19142025-07-29T19:01:28.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f307cfc1-7462-4608-87b9-d91f655b1391 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19152025-07-29T19:01:28.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f307cfc1-7462-4608-87b9-d91f655b1391 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19162025-07-29T19:01:28.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f307cfc1-7462-4608-87b9-d91f655b1391 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19172025-07-29T19:01:29.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1420ec22-a6d7-446b-8233-702422d5e937 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19182025-07-29T19:01:29.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1420ec22-a6d7-446b-8233-702422d5e937 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19192025-07-29T19:01:29.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1420ec22-a6d7-446b-8233-702422d5e937 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19202025-07-29T19:01:30.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1f27cb74-4398-4005-996b-4c49a875c2e3 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19212025-07-29T19:01:30.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1f27cb74-4398-4005-996b-4c49a875c2e3 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19222025-07-29T19:01:30.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1f27cb74-4398-4005-996b-4c49a875c2e3 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19232025-07-29T19:01:31.840ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
19242025-07-29T19:01:31.840ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
19252025-07-29T19:01:31.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19262025-07-29T19:01:31.840ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 159 reason = Timeout
19272025-07-29T19:01:31.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19282025-07-29T19:01:31.840ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
19292025-07-29T19:01:31.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
19302025-07-29T19:01:31.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19312025-07-29T19:01:31.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19322025-07-29T19:01:31.842ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19332025-07-29T19:01:31.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19342025-07-29T19:01:31.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19352025-07-29T19:01:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19362025-07-29T19:01:31.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.274676ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19372025-07-29T19:01:31.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
19382025-07-29T19:01:31.846ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
19392025-07-29T19:01:31.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
19402025-07-29T19:01:31.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19412025-07-29T19:01:31.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19422025-07-29T19:01:31.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19432025-07-29T19:01:31.847ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
19442025-07-29T19:01:31.847ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.330054ms iteration = 159 status = {"chicken_switches_updated":false}
19452025-07-29T19:01:31.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19462025-07-29T19:01:31.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19472025-07-29T19:01:31.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19482025-07-29T19:01:31.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0a28dc16-a065-459e-b1aa-d53bcbda4625, lookup_type: ById(0a28dc16-a065-459e-b1aa-d53bcbda4625) } result = Ok(())
19492025-07-29T19:01:31.853ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19502025-07-29T19:01:31.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19512025-07-29T19:01:31.865ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 original_time_created = 2025-07-29 18:48:16.280373 UTC target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 time_created = 2025-07-29 18:48:16.280373 UTC
19522025-07-29T19:01:31.865ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.871103ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0a28dc16-a065-459e-b1aa-d53bcbda4625","time_created":"2025-07-29T18:48:16.280373Z"}
19532025-07-29T19:01:31.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 715e2b69-8142-4915-9725-8eee5c88bad1 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19542025-07-29T19:01:31.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 715e2b69-8142-4915-9725-8eee5c88bad1 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19552025-07-29T19:01:31.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 715e2b69-8142-4915-9725-8eee5c88bad1 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19562025-07-29T19:01:32.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 46982361-a05f-4cbe-aaf8-fecb7b3b82b6 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19572025-07-29T19:01:32.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 46982361-a05f-4cbe-aaf8-fecb7b3b82b6 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19582025-07-29T19:01:32.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 46982361-a05f-4cbe-aaf8-fecb7b3b82b6 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19592025-07-29T19:01:33.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f91b5728-22e9-41bb-99be-de9762444bb8 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19602025-07-29T19:01:33.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f91b5728-22e9-41bb-99be-de9762444bb8 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19612025-07-29T19:01:33.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f91b5728-22e9-41bb-99be-de9762444bb8 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19622025-07-29T19:01:34.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1989dae6-d973-465d-a033-90a062371ddb roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19632025-07-29T19:01:34.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1989dae6-d973-465d-a033-90a062371ddb resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19642025-07-29T19:01:34.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1989dae6-d973-465d-a033-90a062371ddb response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19652025-07-29T19:01:35.626ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 588 local_addr = [fd00:1122:3344:101::c]:51026 method = GET remote_addr = [fd00:1122:3344:101::d]:61933 req_id = 14f6ba99-454a-424d-8356-b77fce96da2b response_code = 200 uri = /90ad0cc8-96db-48ff-b8fa-3f4895896eed
19662025-07-29T19:01:35.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 6f0fa668-b4f6-42a8-9fc2-f85b15bf0778 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19672025-07-29T19:01:35.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 6f0fa668-b4f6-42a8-9fc2-f85b15bf0778 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19682025-07-29T19:01:35.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 6f0fa668-b4f6-42a8-9fc2-f85b15bf0778 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19692025-07-29T19:01:36.839ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 160 reason = Timeout
19702025-07-29T19:01:36.839ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
19712025-07-29T19:01:36.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
19722025-07-29T19:01:36.841ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19732025-07-29T19:01:36.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
19742025-07-29T19:01:36.844ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
19752025-07-29T19:01:36.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
19762025-07-29T19:01:36.845ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
19772025-07-29T19:01:36.845ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.176512ms iteration = 160 status = {"chicken_switches_updated":false}
19782025-07-29T19:01:36.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 628a1f63-b1cc-43c1-b3b6-1e2fb1c5a6d3 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19792025-07-29T19:01:36.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 628a1f63-b1cc-43c1-b3b6-1e2fb1c5a6d3 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19802025-07-29T19:01:36.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 628a1f63-b1cc-43c1-b3b6-1e2fb1c5a6d3 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19812025-07-29T19:01:37.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = d0299762-a81b-4bf3-9a17-2566d5d4723f roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19822025-07-29T19:01:37.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = d0299762-a81b-4bf3-9a17-2566d5d4723f resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19832025-07-29T19:01:37.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = d0299762-a81b-4bf3-9a17-2566d5d4723f response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19842025-07-29T19:01:38.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 0aee0fe8-3cce-4134-be25-b3c305114286 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19852025-07-29T19:01:38.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 0aee0fe8-3cce-4134-be25-b3c305114286 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19862025-07-29T19:01:38.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 0aee0fe8-3cce-4134-be25-b3c305114286 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19872025-07-29T19:01:40.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b0e55673-1b7c-4077-8f89-5bc2034145bc roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19882025-07-29T19:01:40.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b0e55673-1b7c-4077-8f89-5bc2034145bc resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19892025-07-29T19:01:40.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = b0e55673-1b7c-4077-8f89-5bc2034145bc response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19902025-07-29T19:01:41.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 16ac62c9-caaf-49fe-8c78-ecfaa3c70331 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19912025-07-29T19:01:41.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 16ac62c9-caaf-49fe-8c78-ecfaa3c70331 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19922025-07-29T19:01:41.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 16ac62c9-caaf-49fe-8c78-ecfaa3c70331 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
19932025-07-29T19:01:41.840ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
19942025-07-29T19:01:41.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19952025-07-29T19:01:41.840ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
19962025-07-29T19:01:41.840ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 161 reason = Timeout
19972025-07-29T19:01:41.840ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19982025-07-29T19:01:41.840ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
19992025-07-29T19:01:41.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20002025-07-29T19:01:41.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
20012025-07-29T19:01:41.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20022025-07-29T19:01:41.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20032025-07-29T19:01:41.843ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20042025-07-29T19:01:41.843ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20052025-07-29T19:01:41.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20062025-07-29T19:01:41.845ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.224596ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20072025-07-29T19:01:41.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20082025-07-29T19:01:41.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20092025-07-29T19:01:41.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20102025-07-29T19:01:41.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
20112025-07-29T19:01:41.847ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
20122025-07-29T19:01:41.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
20132025-07-29T19:01:41.848ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20142025-07-29T19:01:41.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20152025-07-29T19:01:41.849ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
20162025-07-29T19:01:41.849ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 8.492827ms iteration = 161 status = {"chicken_switches_updated":false}
20172025-07-29T19:01:41.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20182025-07-29T19:01:41.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0a28dc16-a065-459e-b1aa-d53bcbda4625, lookup_type: ById(0a28dc16-a065-459e-b1aa-d53bcbda4625) } result = Ok(())
20192025-07-29T19:01:41.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20202025-07-29T19:01:41.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20212025-07-29T19:01:41.864ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 original_time_created = 2025-07-29 18:48:16.280373 UTC target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 time_created = 2025-07-29 18:48:16.280373 UTC
20222025-07-29T19:01:41.864ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.575468ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0a28dc16-a065-459e-b1aa-d53bcbda4625","time_created":"2025-07-29T18:48:16.280373Z"}
20232025-07-29T19:01:42.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 717c9c6b-facb-430c-9cee-77a214b742c4 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20242025-07-29T19:01:42.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 717c9c6b-facb-430c-9cee-77a214b742c4 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20252025-07-29T19:01:42.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2145 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 717c9c6b-facb-430c-9cee-77a214b742c4 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20262025-07-29T19:01:43.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f2fc48c7-6533-4952-9681-11944710dac1 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20272025-07-29T19:01:43.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f2fc48c7-6533-4952-9681-11944710dac1 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20282025-07-29T19:01:43.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f2fc48c7-6533-4952-9681-11944710dac1 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20292025-07-29T19:01:44.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f77d68f7-e003-4417-b017-f1a7b156ac2a roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20302025-07-29T19:01:44.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f77d68f7-e003-4417-b017-f1a7b156ac2a resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20312025-07-29T19:01:44.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f77d68f7-e003-4417-b017-f1a7b156ac2a response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20322025-07-29T19:01:45.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = afa5b8ce-d407-43ff-abc8-3b1a895cd1b7 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20332025-07-29T19:01:45.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = afa5b8ce-d407-43ff-abc8-3b1a895cd1b7 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20342025-07-29T19:01:45.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = afa5b8ce-d407-43ff-abc8-3b1a895cd1b7 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20352025-07-29T19:01:45.626ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 684 local_addr = [fd00:1122:3344:101::c]:51026 method = GET remote_addr = [fd00:1122:3344:101::d]:61933 req_id = bd5431de-bdd4-42d9-b1fa-6239d388253c response_code = 200 uri = /90ad0cc8-96db-48ff-b8fa-3f4895896eed
20362025-07-29T19:01:46.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 9377364c-2092-4fed-aafa-f52e159a46e3 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20372025-07-29T19:01:46.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 9377364c-2092-4fed-aafa-f52e159a46e3 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20382025-07-29T19:01:46.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 9377364c-2092-4fed-aafa-f52e159a46e3 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20392025-07-29T19:01:46.839ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 162 reason = Timeout
20402025-07-29T19:01:46.839ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
20412025-07-29T19:01:46.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
20422025-07-29T19:01:46.841ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20432025-07-29T19:01:46.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
20442025-07-29T19:01:46.844ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
20452025-07-29T19:01:46.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
20462025-07-29T19:01:46.845ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
20472025-07-29T19:01:46.845ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 6.121741ms iteration = 162 status = {"chicken_switches_updated":false}
20482025-07-29T19:01:47.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 527f2a46-391e-4696-9090-c91571d5427e roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20492025-07-29T19:01:47.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 527f2a46-391e-4696-9090-c91571d5427e resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20502025-07-29T19:01:47.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 527f2a46-391e-4696-9090-c91571d5427e response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20512025-07-29T19:01:48.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 652599ba-8a54-4d45-b422-b86dc1f5c629 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20522025-07-29T19:01:48.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 652599ba-8a54-4d45-b422-b86dc1f5c629 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20532025-07-29T19:01:48.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 652599ba-8a54-4d45-b422-b86dc1f5c629 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20542025-07-29T19:01:49.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a420b3c3-7812-4d21-bd1d-3517b072c80a roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20552025-07-29T19:01:49.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a420b3c3-7812-4d21-bd1d-3517b072c80a resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20562025-07-29T19:01:49.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = a420b3c3-7812-4d21-bd1d-3517b072c80a response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20572025-07-29T19:01:50.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1476e7f4-686f-4719-b989-66e32a2cd7fd roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20582025-07-29T19:01:50.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1476e7f4-686f-4719-b989-66e32a2cd7fd resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20592025-07-29T19:01:50.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2360 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 1476e7f4-686f-4719-b989-66e32a2cd7fd response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20602025-07-29T19:01:51.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2ddee818-4bc8-4eeb-868f-fd23f63df218 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20612025-07-29T19:01:51.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2ddee818-4bc8-4eeb-868f-fd23f63df218 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20622025-07-29T19:01:51.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 2ddee818-4bc8-4eeb-868f-fd23f63df218 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
20632025-07-29T19:01:51.700ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
20642025-07-29T19:01:51.701ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
20652025-07-29T19:01:51.701ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
20662025-07-29T19:01:51.701ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20672025-07-29T19:01:51.701ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20682025-07-29T19:01:51.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20692025-07-29T19:01:51.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20702025-07-29T19:01:51.703ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1857, tv_nsec: 46673367 } })
20712025-07-29T19:01:51.704ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186
20722025-07-29T19:01:51.704ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1857, tv_nsec: 47320495 } })
20732025-07-29T19:01:51.704ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1186
20742025-07-29T19:01:51.705ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.608458ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20752025-07-29T19:01:51.777ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
20762025-07-29T19:01:51.777ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20772025-07-29T19:01:51.777ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6019d1a-3b97-4ea1-b48c-139cb81b69bf", "content-length": "26", "date": "Tue, 29 Jul 2025 19:01:51 GMT"} })
20782025-07-29T19:01:51.777ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20792025-07-29T19:01:51.779ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20802025-07-29T19:01:51.783ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1194 zone_address = fd00:1122:3344:101::2
20812025-07-29T19:01:51.783ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20822025-07-29T19:01:51.784ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c589b948-e939-4582-a99c-fc21ea318ebb", "content-length": "26", "date": "Tue, 29 Jul 2025 19:01:51 GMT"} })
20832025-07-29T19:01:51.784ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1197 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20842025-07-29T19:01:51.785ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20852025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activating background_task = sp_ereport_ingester iteration = 28 reason = Timeout
20862025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activation complete background_task = sp_ereport_ingester elapsed = 19.79\u{b5}s iteration = 28 status = {"disabled":true,"errors":[],"sps":[]}
20872025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
20882025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
20892025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20902025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20912025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20922025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
20932025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
20942025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
20952025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
20962025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
20972025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20982025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
20992025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21002025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 28 reason = Timeout
21012025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
21022025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
21032025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21042025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
21052025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21062025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
21072025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21082025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
21092025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21102025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
21112025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
21122025-07-29T19:01:51.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21132025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21142025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 163 reason = Timeout
21152025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21162025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
21172025-07-29T19:01:51.840ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
21182025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
21192025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21202025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21212025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
21222025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21232025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21242025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21252025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21262025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
21272025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21282025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21292025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
21302025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21312025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21322025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
21332025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21342025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21352025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21362025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21372025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21382025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21392025-07-29T19:01:51.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21402025-07-29T19:01:51.841ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21412025-07-29T19:01:51.843ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 142.164308ms iteration = 28 status = {}
21422025-07-29T19:01:51.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21432025-07-29T19:01:51.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21442025-07-29T19:01:51.844ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21452025-07-29T19:01:51.844ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
21462025-07-29T19:01:51.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21472025-07-29T19:01:51.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21482025-07-29T19:01:51.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
21492025-07-29T19:01:51.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
21502025-07-29T19:01:51.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
21512025-07-29T19:01:51.845ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21522025-07-29T19:01:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21532025-07-29T19:01:51.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21542025-07-29T19:01:51.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21552025-07-29T19:01:51.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
21562025-07-29T19:01:51.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21572025-07-29T19:01:51.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21582025-07-29T19:01:51.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21592025-07-29T19:01:51.848ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21602025-07-29T19:01:51.848ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21612025-07-29T19:01:51.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21622025-07-29T19:01:51.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21632025-07-29T19:01:51.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
21642025-07-29T19:01:51.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21652025-07-29T19:01:51.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21662025-07-29T19:01:51.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
21672025-07-29T19:01:51.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21682025-07-29T19:01:51.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21692025-07-29T19:01:51.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 10.865893ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21702025-07-29T19:01:51.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21712025-07-29T19:01:51.850ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21722025-07-29T19:01:51.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21732025-07-29T19:01:51.851ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
21742025-07-29T19:01:51.851ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
21752025-07-29T19:01:51.851ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21762025-07-29T19:01:51.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21772025-07-29T19:01:51.852ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 151.57045ms iteration = 28 status = null
21782025-07-29T19:01:51.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21792025-07-29T19:01:51.852ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21802025-07-29T19:01:51.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21812025-07-29T19:01:51.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21822025-07-29T19:01:51.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21832025-07-29T19:01:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21842025-07-29T19:01:51.853ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal.") }) }, Record { name_labels: Name("dendrite-9c9e9bac-4b96-4da6-bd17-bdedf998a5df.host.control-plane.oxide.internal."), dns_class: IN, ttl: 0, rdata: AAAA(AAAA(fd00:1122:3344:101::2)) }], valid_until: Instant { tv_sec: 1857, tv_nsec: 196179950 } })
21852025-07-29T19:01:51.853ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21862025-07-29T19:01:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
21872025-07-29T19:01:51.853ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
21882025-07-29T19:01:51.853ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06
21892025-07-29T19:01:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
21902025-07-29T19:01:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21912025-07-29T19:01:51.853ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21922025-07-29T19:01:51.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21932025-07-29T19:01:51.854ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21942025-07-29T19:01:51.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21952025-07-29T19:01:51.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21962025-07-29T19:01:51.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21972025-07-29T19:01:51.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21982025-07-29T19:01:51.860ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
21992025-07-29T19:01:51.860ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 20.409339ms iteration = 163 status = {"chicken_switches_updated":false}
22002025-07-29T19:01:51.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22012025-07-29T19:01:51.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22022025-07-29T19:01:51.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22032025-07-29T19:01:51.887ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1194 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 zone_address = fd00:1122:3344:101::2
22042025-07-29T19:01:51.887ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22052025-07-29T19:01:51.888ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f688bae4-1724-47dd-a203-6420cbc0f8fd", "content-length": "26", "date": "Tue, 29 Jul 2025 19:01:51 GMT"} })
22062025-07-29T19:01:51.888ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1197 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22072025-07-29T19:01:51.889ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1231 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06
22082025-07-29T19:01:51.894ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:550 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
22092025-07-29T19:01:51.894ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 54.163912ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
22102025-07-29T19:01:51.896ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22112025-07-29T19:01:51.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.203576ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
22122025-07-29T19:01:51.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22132025-07-29T19:01:51.897ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 57.478655ms iteration = 28 status = {"errors":[],"requests_created_ok":[]}
22142025-07-29T19:01:51.898ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22152025-07-29T19:01:51.898ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
22162025-07-29T19:01:51.898ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 58.37638ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
22172025-07-29T19:01:51.898ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22182025-07-29T19:01:51.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22192025-07-29T19:01:51.900ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22202025-07-29T19:01:51.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22212025-07-29T19:01:51.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.664621ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
22222025-07-29T19:01:51.901ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22232025-07-29T19:01:51.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22242025-07-29T19:01:51.903ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22252025-07-29T19:01:51.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22262025-07-29T19:01:51.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22272025-07-29T19:01:51.903ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 0a28dc16-a065-459e-b1aa-d53bcbda4625, lookup_type: ById(0a28dc16-a065-459e-b1aa-d53bcbda4625) } result = Ok(())
22282025-07-29T19:01:51.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22292025-07-29T19:01:51.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22302025-07-29T19:01:51.903ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22312025-07-29T19:01:51.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22322025-07-29T19:01:51.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22332025-07-29T19:01:51.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22342025-07-29T19:01:51.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22352025-07-29T19:01:51.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22362025-07-29T19:01:51.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22372025-07-29T19:01:51.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9c9e9bac-4b96-4da6-bd17-bdedf998a5df, lookup_type: ById(9c9e9bac-4b96-4da6-bd17-bdedf998a5df) } result = Ok(())
22382025-07-29T19:01:51.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22392025-07-29T19:01:51.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22402025-07-29T19:01:51.918ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 78.47257ms iteration = 28 status = 0
22412025-07-29T19:01:51.920ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 original_time_created = 2025-07-29 18:48:16.280373 UTC target_id = 0a28dc16-a065-459e-b1aa-d53bcbda4625 time_created = 2025-07-29 18:48:16.280373 UTC
22422025-07-29T19:01:51.920ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.604929ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"0a28dc16-a065-459e-b1aa-d53bcbda4625","time_created":"2025-07-29T18:48:16.280373Z"}
22432025-07-29T19:01:51.940ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22442025-07-29T19:01:51.942ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
22452025-07-29T19:01:51.942ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22462025-07-29T19:01:51.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22472025-07-29T19:01:51.944ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:390
22482025-07-29T19:01:51.944ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 104.450285ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
22492025-07-29T19:01:51.946ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22502025-07-29T19:01:51.946ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.281947ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
22512025-07-29T19:01:51.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22522025-07-29T19:01:51.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.168189ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
22532025-07-29T19:01:51.950ZINFOnexus (BackgroundTasks): VPC route manager sled 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
22542025-07-29T19:01:51.950ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22552025-07-29T19:01:51.951ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ba9727f-0d5b-4d41-94c7-e1d0e96e5671", "content-length": "372", "date": "Tue, 29 Jul 2025 19:01:51 GMT"} })
22562025-07-29T19:01:51.951ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22572025-07-29T19:01:51.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22582025-07-29T19:01:51.968ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
22592025-07-29T19:01:51.968ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
22602025-07-29T19:01:51.968ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "992e4b60-3b84-4054-8023-cf078c233dc3", "date": "Tue, 29 Jul 2025 19:01:51 GMT"} })
22612025-07-29T19:01:51.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22622025-07-29T19:01:51.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22632025-07-29T19:01:51.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22642025-07-29T19:01:51.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22652025-07-29T19:01:51.974ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22662025-07-29T19:01:51.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22672025-07-29T19:01:51.977ZINFOnexus (BackgroundTasks): VPC route manager sled 9c9e9bac-4b96-4da6-bd17-bdedf998a5df push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22682025-07-29T19:01:51.977ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22692025-07-29T19:01:51.977ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "86f56e44-79ef-47da-b3fb-36945b1beb2f", "date": "Tue, 29 Jul 2025 19:01:51 GMT"} })
22702025-07-29T19:01:51.979ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 139.194115ms iteration = 29 status = {}
22712025-07-29T19:01:51.985ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 145.887372ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
22722025-07-29T19:01:51.986ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 146.53172ms iteration = 31 status = {"physical_disks_added":0}
22732025-07-29T19:01:52.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22742025-07-29T19:01:52.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22752025-07-29T19:01:52.003ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: ecf15dcb-e6bf-4724-9d10-8d03668d718d, rack_id: 9cf1a0c8-2288-4125-b368-b3ae91a98a06, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(d63a586e-232f-4911-b7dc-0748d82c16ec) } rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch_location = Switch0
22762025-07-29T19:01:52.003ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22772025-07-29T19:01:52.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22782025-07-29T19:01:52.005ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22792025-07-29T19:01:52.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22802025-07-29T19:01:52.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22812025-07-29T19:01:52.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22822025-07-29T19:01:52.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22832025-07-29T19:01:52.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22842025-07-29T19:01:52.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22852025-07-29T19:01:52.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
22862025-07-29T19:01:52.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22872025-07-29T19:01:52.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22882025-07-29T19:01:52.015ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
22892025-07-29T19:01:52.015ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = d63a586e-232f-4911-b7dc-0748d82c16ec
22902025-07-29T19:01:52.015ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22912025-07-29T19:01:52.015ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22922025-07-29T19:01:52.015ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22932025-07-29T19:01:52.015ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22942025-07-29T19:01:52.015ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22952025-07-29T19:01:52.015ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22962025-07-29T19:01:52.015ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22972025-07-29T19:01:52.015ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22982025-07-29T19:01:52.015ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06
22992025-07-29T19:01:52.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23002025-07-29T19:01:52.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23012025-07-29T19:01:52.017ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch_location = Switch0
23022025-07-29T19:01:52.017ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
23032025-07-29T19:01:52.045ZDEBGnexus (BackgroundTasks): client request SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
23042025-07-29T19:01:52.046ZDEBGnexus (BackgroundTasks): client response SledAgent = 9c9e9bac-4b96-4da6-bd17-bdedf998a5df background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3f4c840-e79a-4365-833c-60339f12ac81", "content-length": "691", "date": "Tue, 29 Jul 2025 19:01:51 GMT"} })
23052025-07-29T19:01:52.046ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
23062025-07-29T19:01:52.046ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
23072025-07-29T19:01:52.046ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
23082025-07-29T19:01:52.047ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 207.254315ms iteration = 29 status = {}
23092025-07-29T19:01:52.130ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e2aa12ca-786e-4e6b-bff8-62ffdd284e39", "date": "Tue, 29 Jul 2025 19:01:52 GMT"} })
23102025-07-29T19:01:52.130ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 switch = Switch0
23112025-07-29T19:01:52.130ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
23122025-07-29T19:01:52.136ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 9cf1a0c8-2288-4125-b368-b3ae91a98a06 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e133cc2-c26e-446c-946f-a867d4f0547d", "content-length": "682", "date": "Tue, 29 Jul 2025 19:01:51 GMT"} })
23132025-07-29T19:01:52.136ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23142025-07-29T19:01:52.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23152025-07-29T19:01:52.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23162025-07-29T19:01:52.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23172025-07-29T19:01:52.144ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23182025-07-29T19:01:52.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23192025-07-29T19:01:52.146ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23202025-07-29T19:01:52.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23212025-07-29T19:01:52.154ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 314.362404ms iteration = 28 status = {}
23222025-07-29T19:01:52.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 982e15b9-1d0c-45d0-ab4d-a3b40fc1a1fe roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23232025-07-29T19:01:52.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 982e15b9-1d0c-45d0-ab4d-a3b40fc1a1fe resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23242025-07-29T19:01:52.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 982e15b9-1d0c-45d0-ab4d-a3b40fc1a1fe response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23252025-07-29T19:01:52.623ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 5
23262025-07-29T19:01:52.623ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221
23272025-07-29T19:01:52.654ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
23282025-07-29T19:01:52.654ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:52659
23292025-07-29T19:01:52.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52659 req_id = cfbac6fd-96c8-4583-b3bc-a35d7b3c7c91 roles = RoleSet { roles: {} } uri = /metrics/producers
23302025-07-29T19:01:52.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52659 req_id = cfbac6fd-96c8-4583-b3bc-a35d7b3c7c91 resource = Database result = Ok(()) uri = /metrics/producers
23312025-07-29T19:01:52.726ZINFOnexus: assigned collector to new producer collector_id = b7eba1f4-771d-464b-b239-7b11b0c8ccfd file = nexus/src/app/oximeter.rs:76 producer_id = 90ad0cc8-96db-48ff-b8fa-3f4895896eed
23322025-07-29T19:01:52.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 71918 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:52659 req_id = cfbac6fd-96c8-4583-b3bc-a35d7b3c7c91 response_code = 201 uri = /metrics/producers
23332025-07-29T19:01:52.726ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "cfbac6fd-96c8-4583-b3bc-a35d7b3c7c91", "content-length": "41", "date": "Tue, 29 Jul 2025 19:01:52 GMT"} })
23342025-07-29T19:01:52.727ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
23352025-07-29T19:01:53.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 6532aaef-2aaa-49d5-baa6-d5481255f1ee roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23362025-07-29T19:01:53.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 6532aaef-2aaa-49d5-baa6-d5481255f1ee resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23372025-07-29T19:01:53.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 6532aaef-2aaa-49d5-baa6-d5481255f1ee response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23382025-07-29T19:01:54.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 96032eb1-6122-4460-88ac-2ee49432add9 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23392025-07-29T19:01:54.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 96032eb1-6122-4460-88ac-2ee49432add9 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23402025-07-29T19:01:54.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 96032eb1-6122-4460-88ac-2ee49432add9 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23412025-07-29T19:01:55.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f93f5a97-a952-4c7b-b3ee-10bc9cdca193 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23422025-07-29T19:01:55.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f93f5a97-a952-4c7b-b3ee-10bc9cdca193 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23432025-07-29T19:01:55.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = f93f5a97-a952-4c7b-b3ee-10bc9cdca193 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23442025-07-29T19:01:55.626ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 734 local_addr = [fd00:1122:3344:101::c]:51026 method = GET remote_addr = [fd00:1122:3344:101::d]:61933 req_id = 25eb5cd3-d686-4ebe-9045-7f4e51431cf5 response_code = 200 uri = /90ad0cc8-96db-48ff-b8fa-3f4895896eed
23452025-07-29T19:01:56.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 30cfdb92-79c5-4731-9b87-1527737dcce6 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23462025-07-29T19:01:56.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 30cfdb92-79c5-4731-9b87-1527737dcce6 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23472025-07-29T19:01:56.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 30cfdb92-79c5-4731-9b87-1527737dcce6 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23482025-07-29T19:01:56.839ZDEBGnexus (BackgroundTasks): activating background_task = chicken_switches_watcher iteration = 164 reason = Timeout
23492025-07-29T19:01:56.839ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
23502025-07-29T19:01:56.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
23512025-07-29T19:01:56.841ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23522025-07-29T19:01:56.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = BlueprintConfig result = Ok(())
23532025-07-29T19:01:56.844ZDEBGnexus (BackgroundTasks): roles background_task = chicken_switches_watcher roles = RoleSet { roles: {} }
23542025-07-29T19:01:56.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = chicken_switches_watcher resource = Database result = Ok(())
23552025-07-29T19:01:56.846ZDEBGnexus (BackgroundTasks): chicken switches load complete background_task = chicken_switches_watcher
23562025-07-29T19:01:56.846ZDEBGnexus (BackgroundTasks): activation complete background_task = chicken_switches_watcher elapsed = 7.011385ms iteration = 164 status = {"chicken_switches_updated":false}
23572025-07-29T19:01:57.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7378f988-2312-4050-8dc3-ed9df98f0599 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23582025-07-29T19:01:57.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7378f988-2312-4050-8dc3-ed9df98f0599 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23592025-07-29T19:01:57.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 7378f988-2312-4050-8dc3-ed9df98f0599 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23602025-07-29T19:01:58.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 99711627-83d4-4746-974d-f9c6fa3e88fd roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23612025-07-29T19:01:58.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 99711627-83d4-4746-974d-f9c6fa3e88fd resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23622025-07-29T19:01:58.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 99711627-83d4-4746-974d-f9c6fa3e88fd response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23632025-07-29T19:01:59.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 36ed578e-7339-464c-935c-4877b972cac0 roles = RoleSet { roles: {} } uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23642025-07-29T19:01:59.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 36ed578e-7339-464c-935c-4877b972cac0 resource = Database result = Ok(()) uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df
23652025-07-29T19:01:59.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43478 req_id = 36ed578e-7339-464c-935c-4877b972cac0 response_code = 200 uri = /probes/9c9e9bac-4b96-4da6-bd17-bdedf998a5df